Layer L7
Middleware
The plumbing between models and applications.
Vector DBs, agent frameworks & MCP, eval & observability, AI gateways, data+AI platforms
vector databasesagent frameworks & MCPeval & observabilityAI gatewaysdata+AI platforms
Topics in this layer
AI Agent Frameworks & MCP
LangChain, CrewAI, LlamaIndex, MCP: the orchestration layer wiring models to tools, memory, and data.
Vector Databases
Pinecone vs Weaviate vs Qdrant vs Chroma: the retrieval layer every RAG and agent stack is built on.
AI Eval & Observability
LangSmith, Arize, Langfuse, Braintrust: shipping agents to production needs eval + tracing.
AI Gateways & LLM Routing
OpenRouter, LiteLLM, Portkey: the FinOps + routing layer controlling inference spend.
Companies (16)
Ranked leaderboard →Ranked suppliers for Middleware
Estimated share, products, and customers — sourced provenance per row.
View the L7 leaderboard →Engineering reference, not investment advice.