LLM Observability in Production: OpenTelemetry GenAI Semantic Conventions vs. OpenInference, Distributed Trace Propagation Across Multi-Agent Graphs, and High-Throughput Sampling Economics
Production large language model (LLM) architectures have transitioned from isolated completion endpoints to complex, distributed directed acyclic graphs (DAGs). Modern AI systems incorporate multi-agent orchestration, iterative tool execution, vector retrieval pipelines, and speculative decoding loops. Operating these workloads at enterprise scale exposes critical observability gaps that traditional application performance monitoring (APM) tools cannot address. Standard request-response APM metr



















