Git.Top Guide

AI Observability Tools

Open-source tracing, prompt logging, evaluation, cost tracking, and runtime analysis tools for AI products.

Guide

What To Inspect

Evaluate AI observability projects by tracing depth, prompt and completion capture, evaluation workflows, privacy controls, integrations, and whether the project is production-ready or analysis-focused.

Guide

Best Use

Use this page when selecting tools for monitoring LLM apps, debugging agent runs, tracking costs, reviewing prompts, or comparing quality across model and retrieval changes.

Data Source

d1 / d1_query

1215 loaded projects. Generated at 2026-09-04T13:58:38.649Z.

Project

pydantic/logfire

83

AI observability platform for production LLM and agent systems.

Ai ObservabilityLibrary OnlyLocalCloud
Quality45
Agent83

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Ai ObservabilityLibrary OnlyLocalCloud
Quality36
Agent78

LangSmith Client SDK Implementations

Ai ObservabilityLibrary OnlyLocalCloud
Quality43
Agent80

lightweight system-level observability for AI Agents

Ai ObservabilityDockerLibrary OnlyLocal
Quality33
Agent71

CNCF Jaeger, a Distributed Tracing Platform

Ai ObservabilityDockerLocalCloud
Quality39
Agent82

Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.

Ai ObservabilityDockerKubernetesLibrary Only
Quality38
Agent76

Project

apache/hertzbeat

81

An AI-powered next-generation open source real-time observability system.

Ai ObservabilityDockerKubernetesLibrary Only
Quality28
Agent81

🪢 Langfuse JS/TS SDKs - Instrument your LLM app and get detailed tracing/observability. Works with any LLM or framework

Ai ObservabilityVercelServerlessLibrary Only
Quality27
Agent70

CLI for managing Dynatrace platform resources - built for humans and AI agents alike

Ai ObservabilityKubernetesLocalCloud
Quality29
Agent72

Self-hosted AI SRE for Kubernetes — zero-instrumentation eBPF observability plus a copilot that fixes issues through guardrailed, self-verifying actions. BYO-LLM, air-gapped capable.

Ai ObservabilityDockerKubernetesLibrary Only
Quality19
Agent63

OpenTelemetry Instrumentation for AI Observability

Ai ObservabilityVercelServerlessLocal
Quality46
Agent81

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Ai ObservabilityLibrary OnlyLocalCloud
Quality16
Agent62