AgentOps

AgentOps-AI/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more.

Open-source alternative to LangSmith

What it replaces

LangSmith

All LangSmith alternatives

Langfuse
#1 by stars

Open source LLM engineering platform for AI-powered applications

Stars
36.8k
Growth
+1.9k
Launched
May 2023
Custom licenseupdated today
Opik
#2 by stars

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and…

Stars
23.1k
Growth
–
Launched
May 2023
Apache-2.0updated today
Arize Phoenix
#3 by stars

Open-source LLM tracing & evaluation for AI optimization

Stars
12.1k
Growth
+523
Launched
Nov 2022
Custom licenseupdated today
OpenLLMetry
#4 by stars

Monitor LLM performance with open-source observability

Stars
7.5k
Growth
+73
Launched
Sep 2023
Apache-2.0updated 12d ago
Helicone
#5 by stars

Build reliable AI apps with comprehensive observability

Stars
6.2k
Growth
+82
Launched
Jan 2023
Apache-2.0updated 3d ago
LangWatch
#6 by stars

Simulation-based testing and evaluation for AI agents

Stars
5k
Growth
+162
Launched
Sep 2023
Apache-2.0updated today
SaaS is dead
Esc

Type to search every entry. ↑↓ to move, Enter to open.

Your cart

Nothing in here yet. The receipt is blank for once.

Browse the gift shop