GH Repository · AgentOps-AI
agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
- stars
- 5,819
- 30-day movement
- +62/day
- Related entries
- 60
- Connections
- 1
Pythonpython/uvagents-sdkopenaiollamaagentagent-appopenai-agentsagentopspythonllmevalscost-estimationevaluation-metricsanthropicaigroqautogencrewailangchainmistral
AgentOps is a Python SDK for monitoring AI agents, tracking LLM costs, and benchmarking runs. It integrates with most major LLMs and agent frameworks, including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI.
You need visibility into what your agents do, what they cost, and how they perform without building your own instrumentation.
Use it to
- Track LLM costs across agent runs
- Monitor agent behavior and execution
- Benchmark agent performance
- Evaluate agents with eval metrics
- Instrument CrewAI or Langchain apps
For Python developers building and operating LLM agent applications
- Role
- agent-app
- Language
- Python
- Licence
- MIT
- Forks
- 622
- Open issues
- 114
- Last push
- 2026-06-25
- Latest release
- 0.0.2 · 2023-08-28
topicsagentllmmonitoringcost-trackingevalspython-sdk