LLM Observability with Middleware and OpenLLMetry

1

Get your Middleware credentials

2

Add the following lines to your application code:

Python
Typescript (Node js)

from traceloop.sdk import Traceloop

Traceloop.init(
    app_name="YOUR_APPLICATION_NAME",
    api_endpoint="<MW_TARGET>",
    headers={
        "Authorization": "<MW_API_KEY>",
        "X-Trace-Source": "traceloop",
    },
    resource_attributes={"key": "value"},
)

import * as traceloop from "@traceloop/node-server-sdk";
traceloop.initialize({
  appName: "YOUR_APPLICATION_NAME",
  apiEndpoint: "<MW_TARGET>",
  headers: {
    Authorization: "<MW_API_KEY>",
    "X-Trace-Source": "traceloop",
  },
  resourceAttributes: { "key": "value" },
});

Replace:

MW_TARGET with your middleware target url

Example - https://abcde.middleware.io

MW_API_KEY with your middleware api key.

Example - nxhqwpbvcmlkjhgfdsazxcvbnmkjhgtyui

Refer to the Traceloop Docs for more advanced configurations and use cases.For detailed information on LLM Observability with Middleware and Traceloop, consult Middleware Documentation: LLM Observability Documentation.

3

Visualize in Middleware

Once your LLM application is instrumented, you can view the traces, metrics and dashboards in the Middleware LLM Observability section. To access this:

Log in to your Middleware account
Navigate to the LLM Observability Section in the sidebar

Introduction

Quick Start

Tracing

Integrations

Privacy

Contribute

LLM Observability with Middleware and OpenLLMetry