Instrumenting an LLM router: what New Relic sees, Prometheus doesn't
While routing prompts to different LLM tiers optimizes costs, it introduces complex risks—such as model drift, legal liability, and data privacy leaks—that standard "service up" me…