Git.Top Guide

AI Observability Tools

Open-source tracing, prompt logging, evaluation, cost tracking, and runtime analysis tools for AI products.

Guide

What To Inspect

Evaluate AI observability projects by tracing depth, prompt and completion capture, evaluation workflows, privacy controls, integrations, and whether the project is production-ready or analysis-focused.

Guide

Best Use

Use this page when selecting tools for monitoring LLM apps, debugging agent runs, tracking costs, reviewing prompts, or comparing quality across model and retrieval changes.

Data Source

d1 / d1_query

1067 loaded projects. Generated at 2026-08-13T13:36:08.300Z.

Project

pydantic/logfire

83

AI observability platform for production LLM and agent systems.

Ai ObservabilityLibrary OnlyLocalCloud
Quality46
Agent83

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Ai ObservabilityLibrary OnlyLocalCloud
Quality37
Agent80

LangSmith Client SDK Implementations

Ai ObservabilityLibrary OnlyLocalCloud
Quality45
Agent81

Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.

Ai ObservabilityDockerKubernetesLibrary Only
Quality40
Agent75

CNCF Jaeger, a Distributed Tracing Platform

Ai ObservabilityDockerLocalCloud
Quality36
Agent82

Self-hosted AI SRE for Kubernetes — zero-instrumentation eBPF observability plus a copilot that fixes issues through guardrailed, self-verifying actions. BYO-LLM, air-gapped capable.

Ai ObservabilityDockerKubernetesLibrary Only
Quality28
Agent67

🪢 Langfuse JS/TS SDKs - Instrument your LLM app and get detailed tracing/observability. Works with any LLM or framework

Ai ObservabilityVercelServerlessLibrary Only
Quality27
Agent70

system-level profiler/monitor and skills for Agents in eBPF or Mac

Ai ObservabilityDockerLibrary OnlyLocal
Quality33
Agent71

OpenTelemetry SDK for AI agent observability, tracing, debugging, governance, and runtime policy enforcement. Monitor and debug OpenAI Agents, LangGraph, CrewAI, and LLM applications in production.

Ai ObservabilityLibrary OnlyLocalCloud
Quality21
Agent62

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Ai ObservabilityLibrary OnlyLocalCloud
Quality17
Agent63

OpenTelemetry Instrumentation for AI Observability

Ai ObservabilityVercelServerlessLocal
Quality44
Agent81

Project

traceloop/hub

63

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Ai ObservabilityDockerKubernetesLibrary Only
Quality15
Agent63