New Relic AI Monitoring
by New Relic
Full-stack observability for AI applications with LLM tracing, agent and MCP call visibility, token cost tracking and model comparison.
About
Full-stack observability for AI applications with LLM tracing, agent and MCP call visibility, token cost tracking and model comparison.
New Relic AI Monitoring gives teams full-stack observability for AI-powered applications, with performance insights and cost control across the apps, infrastructure and AI layer. It works without new instrumentation and ships built-in integrations for models such as OpenAI, vector databases such as Pinecone and frameworks such as LangChain.
Teams can trace entire requests from prompt to response, map interactions between AI agents, inspect tool calls and follow the full Model Context Protocol request lifecycle. Token usage tracking with custom alerts, model comparison on cost, performance and quality, and checks for bias, hallucination and toxicity round out the product.
Key features
Product details
Vendor
New Relic
Category
AI Agent Observability & Evals
Starting price
Free tier: 100 GB and 1 user free
Free trial
No
Pricing
Similar software
AgentOps
by AgentOps
Agent monitoring, replay and evaluation platform.
Arize AX
by Arize AI
Arize AX is an AI engineering platform for agent observability, evaluation, tracing and experimentation.
Arize Phoenix
by Arize AI
Open-source AI observability and evaluation platform.
Braintrust
by Braintrust
Evaluation and observability platform for AI products.
Comet Opik
by Comet
Open-source evaluation, testing and monitoring platform for LLM applications.
Confident AI
by Confident AI
LLM evaluation, testing, tracing and monitoring platform with regression testing, online evals and real-time alerting.
