Model-Agnostic Architecture

A model-agnostic architecture puts an abstraction layer between your application and any single LLM provider, so you can swap or route between models — Anthropic, OpenAI, open-weight, self-hosted — without rewriting the application. It protects against price changes, deprecations, and capability shifts from any one vendor, and lets different workloads route to whichever model is cheapest or best suited. It's a deliberate design decision, not a default — most teams retrofit it after their first vendor lock-in scare.

← Back to the full glossary