#LLM Ops

2 articles tagged with LLM Ops

Building Cost Dashboards for Multi-Model AI Products

Once a product routes across three or four models, 'what are we spending on AI' stops being an invoice question and becomes a dashboard you have to build. Here's how I structure that dashboard.

7/24/202610 min read

Building a Model Router: Picking the Cheapest Model That Still Works

A step-by-step walkthrough of building a request router that sends each query to the cheapest model likely to answer it correctly, with fallback and confidence scoring baked in.

7/9/202612 min read