Beyond the Chatbot: Building a Socratic AI That Actually Teaches
The upcoming Math curriculum launch on July 31 is a huge test for this architecture—scaling these precise "rungs" of the ladder to a full subject area is where the real engineering happens.

Automation needs a narrow first win
The best first AI workflow is usually a repeated task with a clear input, clear output, and a human approval step.
Bloomy is tackling the Bloom 2-sigma problem by ditching the "blank chat window" trend. Most AI tools just spit out answers, which is the opposite of learning. Bloomy builds a Socratic AI tutor that refuses to do the work for the student. It uses a scaffolded tutoring ladder and a knowledge graph—built in collaboration with the Learning Commons and Chan Zuckerberg Initiative—to create personalized paths based on actual diagnostic skill gaps.
Engineering the Mastery Gate
As builders, we know that "personalized learning" is often just a buzzword for randomized content. Bloomy takes a different path by focusing on gatekeeping logic. Students have to hit 90% mastery on independent assessments called Summits before they can move forward. This creates a structured loop: diagnosis, instruction, and practice.
Technically, this is a heavy lift. You aren't just prompting an LLM; you're building a state machine that tracks progress across a knowledge graph. By integrating Anthropic and OpenAI models with Zero Data Retention agreements, the platform handles the high-level reasoning required for Socratic tutoring while meeting the non-negotiable privacy standards of K-12 education. The upcoming Math curriculum launch on July 31 is a huge test for this architecture—scaling these precise "rungs" of the ladder to a full subject area is where the real engineering happens.
Scaling "Observant" AI
The jump from a polished demo to a production environment with thousands of concurrent students is where most AI projects break. The challenge isn't just "can the AI tutor?" but "can it stay observant?" BloomyBot is designed to be a live, interactive tutor providing context-aware help rather than binary "correct/incorrect" pings.
This is the hard part. If the AI gives too much help, the student doesn't learn. If it gives too little, the student checks out. The success of this model hinges on the precision of that knowledge graph. The AI needs to know exactly which concept the student is tripping over so it can provide the specific nudge needed to get them over the hurdle. It’s about maintaining that "scaffold" without letting it collapse into frustration or circular loops.
From Content Generation to Process Management
The real story here is a massive shift in how we think about AI in education. We’re moving away from "content generation" (the easy stuff) toward "process management" (the hard stuff). The value isn't in the AI's ability to explain a math problem—a calculator can do that. The value is in the AI's ability to recognize a specific misconception and steer the student toward self-correction.
For those of us building in this space, this is the high-stakes frontier. It requires a system smart enough to know when to stay silent. That’s significantly harder to debug than a hallucination, but it’s the only way to actually solve the 2-sigma problem. We aren't just building a tutor; we're building a system that manages the act of learning.

Got a question about how this applies to you? →
Keep reading
Follow the thread
The Linux Kernel's AI Pivot: Technical Merit vs. The Verification Bottleneck
If we're strictly chasing technical excellence, what happens when the 'best' code is just the code that aligns with a corporate owner's hidden priorities?
Read this noteSame lane, different angle
The Robustness-Generation Gap: Why Dialect Adaptation Isn't Just a Fine-Tuning Problem
Most researchers think high benchmark scores mean a model has mastered a dialect. DiaLLM research shows that's not true: understanding a dialect and actually speaking it are governed by two different parts of the training pipeline.
The Shortcut Problem: Why LRM Thinking Traces Aren't Always Reasoning
If the model can reach the right answer by basically guessing the pattern, your 'reasoning' logs are just expensive noise.