22 tools
Failproof AI is an open-source tool for AI engineers, agent developers, and ML teams to build versioned eval datasets from production agent traces. It picks failures, edge cases, and a random slice from production traces, scrubs PII, labels them, and freezes versioned eval datasets you can replay.
Freemium · $0.60+
Traccia provides runtime governance and observability guardrails for production AI agents, helping AI engineers, DevOps, and platform teams prevent costly agent incidents. It offers a unified agent registry across LangChain, CrewAI, and OpenAI Agents SDK, tracing and tripwire capture, cost and usage analytics, policy enforcement on actions with side effects, and an integrated human review queue.
Freemium · $299+/mo