I Built a Tiny Local Model That Outperforms Opus! (by using Orchestration)

AICodeKing

18.1K views • 2 days ago

YouTube

Why it's worth watching

Picked by AIShows a practical AI orchestration system for routing work between models, with training details, eval numbers, and product updates. Useful if you care about programming tools that help a solo developer move faster.

Chapters

The creator did not add chapters to this video.

About this video

PandaCode: https://github.com/aicodeking/pandacode PandaOrchestrator: https://github.com/aicodeking/PandaOrchestrator In this video, I'll show you PandaOrchestrator and Panda Router, a tiny local model I built to decide which model each worker in an agent team should use. I'll go through how it works, how I trained it on a budget with Ettin, Modal and an attempt-and-grade setup, and the numbers on 150 held-out tasks, including the escalation ladder that gets it close to perfect routing. Then I'll show all the new updates inside PandaCode: the router built into the app, the Team menu with Chea