Three Layers of AI Infrastructure, Thirty-Three Minutes Apart: Debugging a Multi-Provider AI Orchestration Stack
In thirty-three minutes, MockEvalio went from calling Groq directly from five different services to a centralized orchestrator with versioned prompts and cost-aware multi-provider routing. What built on what, and what's never been touched since.