#Foundation Models

3 articles tagged Foundation Models.

• Fine-Tuning vs RAG vs In-Context Learning: An Empirical Decision Matrix Foundation Models • 2026-10-29 • Dr. Elena Rostova

  An empirical engineering framework for choosing between RAG, LoRA fine-tuning, and in-context learning based on data velocity, hallucination tolerance, and inference cost.

• Context Window Optimization: KV Cache Eviction and Hierarchical Attention Foundation Models • 2026-10-29 • Dr. Elena Rostova

  An architectural exploration of KV-cache memory scaling, attention sinks, StreamingLLM, and Heavy Hitter eviction for serving 128k+ token agent workflows efficiently.

• Mixture of Experts Routing Topologies: Load Balancing and Token Sharding Foundation Models • 2026-10-29 • Marcus Vance

  An architectural breakdown of MoE gating functions, auxiliary load-balancing losses, and all-to-all token dispatching across distributed GPU clusters.