tutorAI

AI tutors are everywhere. But are they actually working? Today's AI tutors are patient, available 24/7, and far less intimidating than a human teacher. Yet there's a glaring blind spot: no one is measuring their effectiveness in a rigorous, scalable way. That's the problem tutorAI solves. Instead of waiting for real students to give feedback, we deploy simulated AI student agents on DigitalOcean that interact with any AI tutor in real time — asking questions, making mistakes, and responding the way real learners do. We then evaluate the tutor's responses across dimensions like clarity, scaffolding quality, pacing, and knowledge retention proxy scores. In addition, we also evaluate the student understanding because even the best students can only help so much, right? After all, they can't just inject knowledge into a human brain. The result: a live benchmarking layer for AI tutors — think of it as an automated eval harness, but for pedagogy.