Show HN: Apgar – Catch agent regressions without an LLM judge

Hey HN, We build financial AI agents, and Apgar is the tool we wrote to see whether a harness change made an agent better or worse in production. Our offline evals can't cover every kind of question or session real users bring, and the LLM judge we run in Langfuse is too expensive to use on more than a small slice of traffic, so some failures get through. Apgar is a small release health checker that sits on top of our Langfuse data. It picks up the release from the production traces, and for the

Hacker News

Type
Not stated
Industry
Not stated
Deployment
Not stated
Stack
Not stated
Show HN: Apgar – Catch agent regressions without an LLM judge · AgentsShipped