AI Observability & Evaluation
-
Updated
Jun 12, 2024 - Jupyter Notebook
AI Observability & Evaluation
OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions in one unified app. 🖥️
Fiddler Auditor is a tool to evaluate language models.
A python library to send data to Arize AI!
Java client to interact with Arize API
A report generator library for the ML models deployed on the Fiddler AI Observability platform
Example projects for Arthur Model Monitoring Platform
This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud
This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI
Official Python Library to monitor your LLM Application with Doku
Official NodeJS library for monitoring LLM Applications with Doku
Add a description, image, and links to the ai-observability topic page so that developers can more easily learn about it.
To associate your repository with the ai-observability topic, visit your repo's landing page and select "manage topics."