One of the key uses of LLMs like ChatGPT is as an educational aid. But to be effective, the AI must do more than just provide correct answers, it must also demonstrate step-by-step reasoning, especially when guiding students or learners.

In this test case, we explored ChatGPT's ability to handle a basic algebric problem while ensuring it explains each step of the process.

Objective

To assess ChatGPT’s:

Ability to solve a second-degree (quadratic) equation accurately.
Capability to explain each step in the solution process, making it comprehensible to someone unfamiliar with the topic.
Skill in providing visual or contextual support like graphs or definitions.

Methodology

The tester prompted ChatGPT:

“I have a second grade equation to solve. I don't know how to do it. Can you help me with that? The equation is 2*x² + 5x - 3 = 0.”

Expected Result

ChatGPT should:

Solve the quadratic equation accurately.
Present a step-by-step, reasoned solution.
Provide clear and educational explanations for each operation.
Optionally, visualize the equation (e.g., graphically) or identify the equation type.

Actual Result

ChatGPT met and even exceeded these expectations. It:

Correctly solved the equation with accurate answers.
Provided a full step-by-step explanation, breaking down the use of the quadratic formula.
Generated a graph of the equation, showcasing the shape of the parabola.
Correctly identified the equation as a parabola, helping contextualize the problem in geometric terms.

Why ChatGPT’s Response Was Accepted

ChatGPT's response was accepted because:

The solution was correct.
The reasoning was clear and sequential, aiding comprehension.
It included extra educational value through visualization and classification of the equation.

Example steps (paraphrased from the response):

Identify the coefficients:

(a = 2), (b = 5), (c = -3)
Apply the quadratic formula:
x = (-b +- sqrt(b^2 - 4ac)) / 2a
Compute the discriminant:
discr = b^2 - 4ac = 5^2 - 4(2)(-3) = 25 + 24 = 49
Solve for x:
x = (-b +- sqrt(discr)) / 2a
Solutions:
- x1 = 0.5
- x2 = -3
Graph the function: Visualizing the equation as a parabola crossing the x-axis at x1 and x2.

What Could Be Improved

While the response was thorough, there was room for deeper pedagogical support, especially because the tester said:

“I don't know how to do it.”

ChatGPT could have:

Explained what a quadratic equation is:
“A second-degree or quadratic equation is any equation of the form (ax^2 + bx + c = 0), where (a), (b), and (c) are numbers.”
Clarified the meaning of coefficients and terms like:
- (a) is the coefficient of (x^2)
- (b) is the coefficient of (x)
- (c) is the constant term
Provided a more intuitive explanation of the discriminant and how it determines the number of solutions (real vs. complex).

Conclusion

This test shows that ChatGPT is effective at solving mathematical problems with proper reasoning:

It delivers correct solutions.
Offers a clear and educational step-by-step explanation.
Enhances learning with visual aids like graphs.

However, when the user explicitly mentions they don't know how to solve the problem, ChatGPT could enhance its response by:

Breaking down basic concepts first.
Explaining the reason for each step, not just the operations.
Offering analogies or simpler language where appropriate.

Key Takeaways for Users

If you’re using ChatGPT for educational help, mention your level of familiarity. It will guide the depth of the explanation.
Ask explicitly for step-by-step solutions with explanations if you want detailed reasoning.
For math topics, ChatGPT can graph, define, and contextualize concepts. Feel free to ask for these extras!

ChatGPT vs. Math: Can It Teach While Solving?