Respan

Say your support agent starts giving odd answers and you need to know which step went wrong. Respan lets you trace the agent's execution path, then score the outputs with an LLM-as-judge or human review.

Respan is an LLM engineering platform that combines observability, evaluations, prompt optimization and an AI gateway in one interface.

It was formerly called Keywords AI.

You can keep versions of your prompts and compare them, and the gateway gives you access to over 500 models through a single API endpoint.

That is handy if you want to swap models without rewriting integrations.

Respan is made for teams building and monitoring AI agents, and it lists SOC 2 and HIPAA compliance, plus support for trillions of tokens.