Laminar

You send Laminar traces from your AI application and get back a record of every step, which you can then evaluate.

Laminar is an open-source tracing and evaluation platform for LLM apps and agents, meant for developers who need to see what their code and models are actually doing.

Usage is measured in spans, so the plan you pick depends on how much traffic you trace.

The free plan covers 50K spans a month, 15 days of data retention, one team member and 500 Index agent steps, with community support.

Hobby costs $25 a month and raises that to 100k spans, 30 days of retention, two team members and 2500 agent steps, plus priority email support.

Pro is $50 a month with 200k spans, 90 days of retention, three team members and 5000 agent steps, plus a private Slack channel.

Extra spans cost $5 per 100k, extra agent steps $10 per 1k, and added Pro seats $25 each.

The free tier is fine for testing, but retention is short.