LangWatch
by LangWatch
Platform to build, test, evaluate and observe AI agents and LLM applications with agent simulations, evals and tracing.
About
Platform to build, test, evaluate and observe AI agents and LLM applications with agent simulations, evals and tracing.
LangWatch is a platform for building, testing, evaluating and observing AI agents and LLM applications. Its agent simulations use simulated users, multi-turn conversations and judge agents with configurable success criteria, and run locally or in CI/CD through the open-source Scenario SDK.
The platform also covers evaluations, LLM observability with traces, session and cost tracking, prompt management and guardrails. SDKs for Python and TypeScript with OpenTelemetry support make integration simple, and Enterprise adds SSO, RBAC, SCIM, audit logs and self-hosted or hybrid deployment.
Key features
Product details
Vendor
LangWatch
Category
AI Agent Observability & Evals
Pricing model
freemium
Starting price
Free Developer plan; Growth per core seat; Enterprise custom
Free trial
No
Deployment
Cloud; self-hosted with docker compose; hybrid or on-prem (Enterprise)
Pricing
Pricing model: freemium
Plans
- Developer: free, 50k events per month, 2 users, 14-day data access; Growth: paid per core seat per month plus usage; Enterprise: custom pricing
Similar software
AgentOps
by AgentOps
Agent monitoring, replay and evaluation platform.
Arize AX
by Arize AI
Arize AX is an AI engineering platform for agent observability, evaluation, tracing and experimentation.
Arize Phoenix
by Arize AI
Open-source AI observability and evaluation platform.
Braintrust
by Braintrust
Evaluation and observability platform for AI products.
Comet Opik
by Comet
Open-source evaluation, testing and monitoring platform for LLM applications.
Confident AI
by Confident AI
LLM evaluation, testing, tracing and monitoring platform with regression testing, online evals and real-time alerting.