← Back to all projects

OpenLLMetry

OpenTelemetry instrumentation for LLM apps — the traces land in the backend you already operate

OfficialApache-2.0
Stars
7.5k
Forks
1.2k
Open issues
820
Last commit
19 Oct 2026

What is OpenLLMetry?

Every other option in this category is a product with its own backend, which means adopting one adds a system to run and a place where half your telemetry lives apart from the rest. This is the instrumentation layer instead: it emits standard OpenTelemetry spans for model and vector-database calls, and those go to Datadog, Grafana, New Relic, Splunk, Honeycomb or wherever your existing traces go. The trade is that a general-purpose backend shows spans and latencies, not the prompt-versioning and evaluation views a dedicated platform is built around.

What can you do with OpenLLMetry?

  • Send LLM traces where the other traces go — Because the output is standard OpenTelemetry, more than twenty-five destinations are supported, including Datadog, Grafana, New Relic, Splunk and Honeycomb, alongside Traceloop's own dashboard.
  • Instrument without restructuring — Tracing attaches non-intrusively, whether the application uses a supported framework or calls a foundation-model API directly, so adoption does not start with a refactor.
  • Attribute the slow hop correctly — Vector-database calls are reported alongside model calls, which is what lets a slow answer be traced to retrieval rather than to the model, or the other way around.
  • Change observability vendor without re-instrumenting — The spans are vendor-neutral by construction, so switching backend is an exporter configuration rather than a second pass through the codebase.
  • Report by hand where automation stops — Calls to models and vector databases can be reported manually for code paths no automatic instrumentation covers, so coverage is not limited to the supported integration list.

Before you choose OpenLLMetry

  • A general-purpose observability backend renders spans and latencies but not the LLM-specific surfaces — prompt versioning, evaluation scores, dataset curation — the dedicated platforms are built around.

Star history

21 Aug to 30 Oct · +126

7.4k7.5k

Frequently asked questions

Is OpenLLMetry free for commercial use?

OpenLLMetry is released under the Apache-2.0 licence — OSI-approved open source, which permits commercial use.

How can OpenLLMetry be deployed?

OpenLLMetry is available as Self-hosted / Runs locally.