Artificial intelligence is rapidly changing how students do homework, but research shows that faster completion times often hide a steep drop in actual learning. When AI tools instantly provide answers, they bypass the mental effort required to build lasting skills, leaving students unprepared for exams. Educators and parents must now look beyond high completion rates to ensure technology is helping, not hurting, academic progress.
What Happened
Three studies show a stark divide in how AI impacts student performance depending on how the tool is structured. In a randomized controlled trial published in Scientific Reports, researchers evaluated a custom AI tutor named "PS2 Pal" in Harvard's introductory physics course. Students using the custom AI tutor at home doubled their learning gains compared to those in an active-learning classroom, achieving these gains in 49 minutes instead of 75 minutes. However, this success occurred because the AI was strictly programmed to act as a scaffold, offering hints rather than direct answers.
When those guardrails are removed, educational outcomes collapse. A study of nearly 1,000 high school math students in Turkey, published in the Proceedings of the National Academy of Sciences (PNAS), compared students using standard ChatGPT with those using a customized tutoring prompt and a textbook-only control group. While students using standard ChatGPT performed 48% better during practice sessions, they scored 17% worse on their final exams than students who had no AI access at all. The standard chatbot quickly gave away answers, meaning students copied the results without understanding the math.
The Bigger Picture
This decline in test scores is not an isolated incident. One study analyzed 3.2 million learning interactions on McGraw Hill's ALEKS online math platform to measure the impact of consumer chatbots. Researchers from the University of California, Irvine, found that after ChatGPT was released, college and high school students experienced a cumulative 25% drop in performance on proctored exams for topics where the questions could easily be copied and pasted into a chatbot.
This trend represents a phenomenon known as "cognitive bypass." As detailed by the Learning Guild, cognitive bypass occurs when an AI system performs the heavy lifting of reasoning and learning. Because the AI does the mental work, the student's brain never builds the necessary neural pathways to retain the information. This leads to what researchers call "cognitive surrender," where students value speed and completion over comprehension. As we previously reported on the risk of instant AI answers, accelerating the feedback loop to a near-instant speed can prevent students from developing deep critical thinking skills.
To reverse this trend, AI tools must be built around the concept of "productive struggle." A five-month study of high school Python students in Taipei published by the Wharton School demonstrated that personalized AI tutors that carefully pace problem difficulty can improve student exam scores by 0.15 standard deviations, which is equivalent to several months of additional school learning. The difference lies entirely in whether the technology is a thoughtful tutor or a simple shortcut.
What This Means for Families
For parents and educators, these findings mean that high grades and fast homework completion are no longer reliable indicators of a student's actual understanding. If a student finishes their math homework in record time without showing signs of frustration or effort, they may be using AI to bypass the learning process.
This issue is particularly difficult to track because traditional academic surveys fail to show a rise in self-reported cheating. Yet, the backend behavioral data proves that students are quietly offloading their cognitive workload. To protect students from skill atrophy, families and schools must shift their focus from checking off completed assignments to validating actual, unassisted comprehension. As we have observed with the broader shift from asking to doing in AI education, the role of technology must transition from an answer generator to an active learning partner.
What You Can Do
Parents can start by monitoring homework workflows and paying attention to how quickly children complete assignments. If they finish complex word problems in seconds, ask them to explain their steps to ensure they are not copying answers from standard chatbots.
It also helps to choose guardrailed tools. When selecting learning apps, look for platforms explicitly designed to act as tutors. These tools should offer step-by-step guidance and Socratic hints rather than direct answers.
Finally, parents should encourage productive struggle. Normalizing the feeling of being stuck shows students that struggle is a sign that the brain is building the memory and reasoning skills required to pass future exams.