convez.ai
MCP ServerDevOps & InfraestruturaIntermediário
traceloop

OpenLLMetry-JS

traceloop/openllmetry-js

Observabilidade open-source para aplicações LLM em Node.js e Next.js

Ver no GitHub
BomPluginScore · de 0 a 100

MCP server para instrumentação e observabilidade de aplicações com LLM em JavaScript/TypeScript. Fornece rastreamento completo de chamadas a provedores de LLM e bancos de dados vetoriais usando OpenTelemetry, compatível com ferramentas como Datadog e Honeycomb.

Instalação

$npx convez-ai traceloop/openllmetry-js

1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.

Métricas

Estrelas
414
Forks
77
Acompanhando
1
Saúde
62%
Último commit
há 5 meses
Versão
0.27.0
Issues abertas
122
Contribuidores
25

Casos de uso

  • Monitorar performance de chamadas a APIs de LLM
  • Rastrear logs e traces de aplicações com agentes de IA
  • Integrar observabilidade com stacks existentes (Datadog, Honeycomb)

Veredito

Solução sólida para observabilidade de LLM applications em JS/TS, mantida por time respeitado (Y Combinator) e alinhada com padrões OpenTelemetry. Ideal para equipes que precisam de visibilidade profunda em produção.

README

A tradução para o português deste README ainda está na fila.

🎉 New: Our semantic conventions are now part of OpenTelemetry! Join the discussion and help us shape the future of LLM observability.

OpenLLMetry-JS is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others.

It's built and maintained by Traceloop under the Apache 2.0 license.

The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started with OpenLLMetry-JS, while still outputting standard OpenTelemetry data that can be connected to your observability stack. If you already have OpenTelemetry instrumented, you can just add any of our instrumentations directly.

🚀 Getting Started

The easiest way to get started is to use our SDK. For a complete guide, go to our docs.

Install the SDK:

npm install --save @traceloop/node-server-sdk

Then, to start instrumenting your code, just add these 2 lines to your code:

import * as traceloop from "@traceloop/node-server-sdk";

traceloop.initialize();

Make sure to import the SDK before importing any LLM module.

That's it. You're now tracing your code with OpenLLMetry-JS! If you're running this locally, you may want to disable batch sending, so you can see the traces immediately:

traceloop.initialize({ disableBatch: true });

Now, you need to decide where to export the traces to.

⏫ Supported (and tested) destinations

See our docs for instructions on connecting to each one.

🪗 What do we instrument?

OpenLLMetry-JS can instrument everything that OpenTelemetry already instruments - so things like your DB, API calls, and more. On top of that, we built a set of custom extensions that instrument things like your calls to OpenAI or Anthropic, or your Vector DB like Pinecone, Chroma, or Weaviate.

LLM Providers

  • ✅ OpenAI
  • ✅ Azure OpenAI
  • ✅ Anthropic
  • ✅ Cohere
  • ⏳ Replicate
  • ⏳ HuggingFace
  • ✅ Vertex AI (GCP)
  • ✅ Bedrock (AWS)

Vector DBs

  • ✅ Pinecone
  • ✅ Chroma
  • ✅ Qdrant
  • ⏳ Weaviate
  • ⏳ Milvus

Frameworks

  • ✅ LangChain
  • ✅ LlamaIndex

🔎 Telemetry

We no longer log or collect any telemetry in the SDK or in the instrumentations. Make sure to bump to v0.21.1 and above.

🌱 Contributing

Whether it's big or small, we love contributions ❤️ Check out our guide to see how to get started.

Not sure where to get started? You can:

💚 Community & Support

  • Slack (For live discussion with the community and the Traceloop team)
  • GitHub Discussions (For help with building and deeper conversations about features)
  • GitHub Issues (For any bugs and errors you encounter using OpenLLMetry)
  • Twitter (Get news fast)
Ver o original no GitHub

Bom para

Relacionados