Datadog LLM Observability
by Datadog
LLM observability for tracing, monitoring and evaluating production AI applications.
About
LLM observability for tracing, monitoring and evaluating production AI applications.
Datadog LLM Observability lets teams trace, monitor and evaluate production AI applications and agents, with offline experimentation and production observability in one platform. It is for AI engineers and SRE or DevOps teams already working in Datadog.
Capabilities include tracing every step of a run with latency, token usage, errors and cost, evaluations, human review and annotations, and datasets built from production traces. Traces can be correlated with APM, infrastructure and RUM data, and a Sensitive Data Scanner is included. The vendor lists a free tier of up to 40k LLM spans and a Pro tier at $160 per month, billed per LLM span.
Key features
Product details
Vendor
Datadog
Category
AI Agent Observability & Evals
Starting price
Contact for pricing
Free trial
No
Deployment
Cloud
Pricing
Similar software
AgentOps
by AgentOps
Agent monitoring, replay and evaluation platform.
Arize AX
by Arize AI
Arize AX is an AI engineering platform for agent observability, evaluation, tracing and experimentation.
Arize Phoenix
by Arize AI
Open-source AI observability and evaluation platform.
Braintrust
by Braintrust
Evaluation and observability platform for AI products.
Comet Opik
by Comet
Open-source evaluation, testing and monitoring platform for LLM applications.
Confident AI
by Confident AI
LLM evaluation, testing, tracing and monitoring platform with regression testing, online evals and real-time alerting.
