AI, Explored

  • Solution Architecture

    Self-Learning Prompt Router for Bedrock: Route Smarter, Save More

    How a lightweight, open prompt router cuts LLM costs by sending easy questions to cheap models, escalating only when needed, and training itself to route better over time. Solution github The problem: every prompt pays the premium price If you run an application on large language models, you have probably noticed something uncomfortable in your…

    Saeed Barghi

  • Monitoring Amazon Bedrock: find out before your users do

    LLM features need everything a normal API needs, plus a second layer: time to first token, variable per-request cost, and failure modes that don’t look like 500s. Here’s a runnable CloudWatch reference implementation for Amazon Bedrock.

    Saeed Barghi