Ilya from OpenAI have published a paper (2020) about Q* : a GPT-f model have capabilities in understand and resolve Math, Automated Theorem Proving.
https://arxiv.org/abs/2009.03393
When AI model can understand and really doing Math, that a critical jump.
PRM8k, made the rounds maybe 6+ months but they never publicly released the model.
I’ve recently just got into LLM’s have you tried these math models? They seem to follow math related instructions reasonably well.
wizard-math:13b-q6_KMathLLM-MathCoder-CL-7B.Q8_0.ggufmetamath-mistral-7b.Q5_K_M.gguf