Who Provides LLM Observability and Evaluation Tooling
Leading companies providing LLM observability and evaluation tooling include Arize AI, Comet, Braintrust Data, Langfuse, and Honeycomb. Their platforms cover agent tracing, evaluations, prompt management, and monitoring for production AI.
Show moreShow less
Open-source LLM evaluation
Langfuse and Comet compete in the open-source segment. Langfuse is an open-source LLM engineering platform with tracing, prompt management, and evaluations used by over 2,300 companies, while Comet's Opik provides tracing and LLM-as-a-judge evaluation metrics for developers building LLM and agentic systems.
Enterprise AI observability
Arize AI and Braintrust Data target enterprise teams. Arize AX provides agent tracing, online and offline evaluations, and prompt management, while Braintrust ingests production agent traces and surfaces behavior patterns with evals and experiments against versioned datasets.
Results not what you wanted?
Companies 26
- Reading your search
- Choosing filters
- Counting matches

Braintrust DataLocation: San Francisco, CA, USFounded 20235 employeesRaised $5.1MMatched product: Braintrust
Braintrust Data builds a platform for evaluating, observing, and shipping LLM applications and AI agents.
LangfuseOperating Status: ClickHouseLocation: Berlin, DEFounded 20223 employeesRaised $4MMatched product: Langfuse Platform
Langfuse: Open-source LLM engineering platform for tracing, prompt management, evaluations, and continuous improvement of AI agents in production.
Confident AILocation: San Francisco, CA, US7 employeesRaised $500kThe LLM Eval and Observability Platform for AI Quality.
HoneycombLocation: San Francisco, CA, USFounded 2016350 employeesRaised $146.9MPrivate companyMatched product: Honeycomb Agent and LLM Observability
Honeycomb gives engineering teams a shared view of production with high-cardinality observability across traces, metrics, and logs.
OpenlayerLocation: San Francisco, CA, USFounded 20216 employeesRaised $4.9MAI monitoring & error analysis platform for efficient model testing.
FiddlerLocation: Palo Alto, CA, USFounded 201867 employeesRaised $45.2MMatched product: AI Control Plane
Fiddler: Pioneering AI Observability with a unified platform for trusted, explainable ML/AI operations.

Helicone develops an open-source LLM observability platform, acquired by Mintlify to enhance AI developer tooling.
TraceloopOperating Status: ServiceNowLocation: Tel Aviv, Tel Aviv District, ILFounded 20223 employeesRaised $500kTraceloop developed observability and evaluation platforms for generative AI before its acquisition by ServiceNow.
Lunary.aiLocation: San Francisco, CA, USFounded 2021Lunary provides an observability and evaluation platform for large language model applications.

LogSpendLocation: Stockholm, Stockholm County, SE5 employeesRaised $120kStockholm-based LogSpend offers an end-to-end LLMOps platform for performance evaluation.
Show 14 more companies
Portkey AIOperating Status: Palo Alto NetworksLocation: San Francisco, CA, USFounded 20235 employeesRaised $3MMatched product: LLM Gateway and Observability
Portkey, a San Francisco-based software company, accelerates AI app development and management for businesses.
LaminarLocation: London, GB6 employeesRaised $500kLaminar offers open-source observability tooling for AI agents, including tracing, debugging, and anomaly detection.
KubitLocation: Fremont, CA, USFounded 201840 employeesRaised $22.8MMatched product: Warehouse-Native Product Analytics
Kubit is an agent analytics platform that maps user behavior and intent to LLM traces for debugging AI agents.
Cumulus LabsLocation: San Francisco, CA, USFounded 20253 employeesMatched product: Cumulus Inference Platform
Production AI-inference platform with a proprietary engine, routing, caching, and observability for multimodal models.
Evidently AILocation: San Francisco, CA, USFounded 20205 employeesRaised $125kMatched product: ML Monitoring
Evidently AI: Open-source tool for reliable ML model monitoring.
RaindropLocation: San Francisco, CA, USFounded 20239 employeesRaised $50.5MMatched product: Monitoring Platform for AI Agents
Sentry for AI Agents.
GalileoOperating Status: Cisco SystemsLocation: San Francisco, CA, USFounded 202126 employeesRaised $23.1MMatched product: Eval Engineering Platform
Galileo: Next-gen ML data intelligence platform building advanced tools for ML teams.
AporiaLocation: San Jose, CA, USFounded 201949 employeesRaised $30MPrivate companyAporia, a San Jose-based software company, offers a customizable ML observability platform for monitoring and improving ML models globally.
FoamLocation: San Francisco, CA, USFounded 202411-50 employeesRaised $8.4MMatched product: Foam Observability Platform
Foam is an AI-native observability platform that autonomously detects, diagnoses, and fixes production errors.
Telem AILocation: Sunnyvale, CA, USPrivate companyMatched product: Observability
Infrastructure for AI agents: search routing, fetch routing, and observability.
PareaLocation: New York City, NY, USFounded 20238 employeesRaised $500kParea AI: NYC-based platform for LLM app development, testing, and monitoring.
CombineHealthLocation: San Francisco, CA, USFounded 202219 employeesRaised $1MCombineHealth builds AI agents that automate healthcare revenue cycle work, including medical coding, billing, eligibility, denials, and appeals.
DatabricksLocation: San Francisco, CA, USFounded 20134k employeesRaised $20.2BMatched product: Databricks Artificial Intelligence
Databricks provides a unified platform for enterprise data analytics and AI.
AppenLocation: Sydney, NSW, AUFounded 19961.2k employeesMatched service: LLM-as-a-Judge Rubric Design
Appen supplies human-generated training data, expert annotation, and evaluation services for AI models.
People
Hassieb PakzadFounding EngineerLangfuse
Marlies MayerhoferFounding EngineerLangfuse
Dinmukhamed MailibayFounderLaminar
Nimrod LahavCo-FounderComet
Marc KlingenFounderLangfuse



