CrabTrap: An LLM-as-a-judge HTTP proxy to secure agents in production

Brex has open-sourced CrabTrap, a security tool that uses large language models as a judge to monitor and control AI agents in production environments. The HTTP proxy sits between your application and external services, using an LLM to evaluate whether each request from an AI agent is safe before it goes through. Think of it as a bouncer at the door of your AI system—it watches what your agent is trying to do and blocks anything suspicious. This addresses a real problem: as companies deploy autonomous AI agents to handle tasks like API calls or data access, they need guardrails to prevent agents from making mistakes or being exploited. CrabTrap lets you define policies and have an LLM enforce them in real-time, making it easier to run AI agents safely without constant manual oversight.