Tag: Agents

I wanted one place to decide which model answers and how hard it thinks. That surfaced a bug one event from the end of every stream. I fixed the wrong thing first, the schema proved the router right, and the real fix is now upstream in vLLM.

A laptop, a single GH200, and a semantic router between them, built to answer trivial requests locally and send the hard ones to the big card. Along the way, eleven things in that stack told me a confident falsehood. Not one of them was the model, and three of them were my own measurements.