Market — AI Eval & Observability

Verified claims and product-axis read for AI Eval & Observability. Every fact below is sourced; every product judgment traces back to underlying signals.

Verified facts

• Anthropic and OpenAI both shipped batch-eval APIs at 50% discount in 2024 enabling cheap large-scale judge calls. ↗ _(historical_event)_
• Inspect AI by the UK AI Safety Institute reached 2,000+ GitHub stars in 2024 as a research-grade eval framework. ↗ _(historical_event)_
• Braintrust requires logging via its proprietary SDK with no OpenTelemetry ingestion path as of 2024. ↗ (other)
• The MLflow project added LLM tracing and eval features in MLflow 2.14 (mid-2024). ↗ (other)
• Langfuse open-sourced its self-host Helm chart with documented support for HA Postgres + ClickHouse in 2024. ↗ _(historical_event)_
• Sentry added AI/LLM monitoring as a feature in 2024 covering token usage and error tracking on LLM calls. ↗ _(historical_event)_
• LangSmith's tracing pricing as of 2025 is $0.50 per 1,000 base traces and $5.00 per 1,000 extended traces. ↗ (financial)
• Helicone is fully open source under Apache 2.0 and offers self-hosting via Docker Compose. ↗ (other)
• BerriAI's LiteLLM proxy integrated Langfuse, LangSmith, and Helicone as logging targets by 2024. ↗ (other)
• Snowflake Cortex added LLM eval primitives in late 2024. ↗ (other)

Cross-cutting opportunities (industry read)

• PCIe Gen5/Gen6 & CXL Retimer / Switch IC — Hyperscale AI racks need PCIe Gen5→Gen6 + CXL retimers/switches just to keep host-to-accelerator links alive at scale; this is Astera Labs' core ALAB-listed business.
• 800G / 1.6T Co-Packaged Optics & Silicon Photonics module — Scale-out beyond ~100K GPU clusters (verified Colossus class) is bandwidth-bound; pluggable optics are hitting reach/power limits, so the industry is racing to ship CPO at 800G→1.6T while still selling AEC for short reach.
• UALink AI Scale-Up Fabric (GPU-to-GPU) — NVLink lock-in is the single biggest non-NVIDIA accelerator pain point; the UALink consortium is the answer and Astera is the first merchant silicon making it ship-worthy.

See the Products and Strategy modules for the full product list and forward-looking judgment.