RESEARCH · RESEARCH · #2773
Google DeepMind publishes classroom studies showing Gemini can match human tutors on in-platform math tasks
Google DeepMind reports results from a 10-week randomized controlled trial in the UK with over 1,100 students (ages 12–15) showing AI tutoring combining Gemini and Eedi matched human tutors on in-platform tasks and quizzes when responses were reviewed by experts in real time; gains did not appear on STAR standardized tests, likely because AI tutoring took longer per problem. Separately, a yearlong study across 31 schools in Italy with ~1,600 teachers (24,500 students) found teachers using Gemini for Education felt more creative and saw more collaborative classroom dynamics.
KEY POINTS
- Google DeepMind reports results from a 10-week randomized controlled trial in the UK with over 1,100 students (ages 12–15) showing AI tutoring combining Gemini and Eedi matched human tutors on in-platform tasks and quizzes when responses were reviewed by experts in real time; gains did not appear on STAR standardized tests, likely because AI tutoring took longer per problem.
- Separately, a yearlong study across 31 schools in Italy with ~1,600 teachers (24,500 students) found teachers using Gemini for Education felt more creative and saw more collaborative classroom dynamics.
- These controlled classroom studies provide evidence that a deployed large model (Gemini) can deliver pedagogical support comparable to human tutors on typical classroom tasks while highlighting limits in standardized-outcome translation and the need for teacher oversight.
WHY IT MATTERS
These controlled classroom studies provide evidence that a deployed large model (Gemini) can deliver pedagogical support comparable to human tutors on typical classroom tasks while highlighting limits in standardized-outcome translation and the need for teacher oversight.