Yeah, I think math is still one of the most difficult frontiers of what LLMs can do. I wouldn't say this model is amazing yet, but it's still a clear leap forward compared to what we could do a year ago. It's also one of the models that makes me appreciate how much knowledge work is going to change in the future.
Can it prove that addition in the set of natural numbers (with usual succession) is commutative? If so, how long does it take and how many steps are in the proof?
This is great! I often hear "LLMs will never be able to do math". This shows otherwise 😎
Yeah, I think math is still one of the most difficult frontiers of what LLMs can do. I wouldn't say this model is amazing yet, but it's still a clear leap forward compared to what we could do a year ago. It's also one of the models that makes me appreciate how much knowledge work is going to change in the future.
Can it prove that addition in the set of natural numbers (with usual succession) is commutative? If so, how long does it take and how many steps are in the proof?