Generative AI has the potential to transform personalization and
accessibility of education. However, it raises serious concerns about accuracy
and helping students become independent critical thinkers. In this study, we
designed a helpful AI "Peer" to help students correct fundamental physics
misconceptions related to Newtonian mechanic concepts. In contrast to
approaches that seek near-perfect accuracy to create an authoritative AI tutor
or teacher, we directly inform students that this AI can answer up to 40% of
questions incorrectly. In a randomized controlled trial with 165 students,
those who engaged in targeted dialogue with the AI Peer achieved post-test
scores that were, on average, 10.5 percentage points higher - with over 20
percentage points higher normalized gain - than a control group that discussed
physics history. Qualitative feedback indicated that 91% of the treatment
group's AI interactions were rated as helpful. Furthermore, by comparing
student performance on pre- and post-test questions about the same concept,
along with experts' annotations of the AI interactions, we find initial
evidence suggesting the improvement in performance does not depend on the
correctness of the AI. With further research, the AI Peer paradigm described
here could open new possibilities for how we learn, adapt to, and grow with AI.