LLMonitor

LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.

Installation and Setup

Create an account on llmonitor.com, then copy your new app's tracking id.

Once you have it, set it as an environment variable by running:

export LLMONITOR_APP_ID="..."

Callbacks

See a usage example.

from langchain.callbacks import LLMonitorCallbackHandler

API Reference:

• LLMonitorCallbackHandler