Arize AX

Arize AX is a platform for observing, evaluating and improving LLM applications and agents. This server connects your assistant to the Arize AX REST API, so you can inspect and manage your AI app's data from the conversation. What you can do: - Traces and spans: search production traces to debug agent behavior, tool calls and failures. - Datasets: create datasets, add and update examples, and search them. - Experiments: create experiments, log runs, and compare results across prompt or model changes. - Evaluators: build LLM-as-judge evaluators from templates, version them, and run them as tasks on spans or experiments. - Prompts: manage prompts in Prompt Hub, create versions, and set labels like production or staging. - Annotations: define annotation configs, label spans, experiment runs and dataset examples, and manage review queues. - Monitors, projects and spaces: list monitors and browse your workspace. - AI integrations: manage LLM provider credentials for OpenAI, Anthropic, Bedrock, Vertex AI and others. Sign in with your Arize account. An Arize API key also works as a Bearer token.