#Infrastructure

2 articles tagged Infrastructure.

• Cost-Optimized Inference Routing: Dynamic Cascading Across Model Tiers Inference & Infrastructure • 2026-10-29 • Daniel Jaffa

  How dynamic model cascading reduces LLM inference costs by 75% and slashes P95 latency by routing queries through tiered SLMs, escalating only on verified errors.

• Streaming JSON-RPC over HTTP: The Evolution of MCP Transports Inference & Infrastructure • 2026-10-29 • Daniel Jaffa

  A deep architectural comparison of legacy SSE and modern Streamable HTTP MCP transports, including session management, proxy buffering, and Express implementations.