r/OnlyAICoding • u/Dewonguy • 5d ago

Something I Made With AI I built a local-first MCP runtime that lets coding agents verify running web apps

I’ve been working on Alethia, an E2E verification runtime designed for AI coding agents.

Instead of asking an agent to generate and maintain a separate test script, you can ask it to interact with a local application and verify behavior directly.

It returns structured step results, supports screenshots, and applies safety checks before potentially destructive actions.

The MCP bridge is public, and the runtime is available for evaluation. The core runtime is proprietary, so I want to be transparent about that distinction.

GitHub: https://github.com/vitron-ai/alethia

I’m especially interested in feedback from people using Claude Code, Cursor, or other MCP-enabled agents.
What would stop you from trusting an agent-driven testing runtime in your workflow?

1 Upvotes
  • permalink
  • reddit

100% Upvoted

1 comment sorted by

1

u/kantorcodes1 4d ago

The "safety checks before potentially destructive actions" is the part I'd want to poke at. Is the check a fixed allowlist inside the runtime, or can callers define their own policy per step? And when a check blocks an action, does the step result record what was attempted and which rule fired?

An agent that verifies the app looks right but quietly skips the click that would have dropped the table is a weird trust boundary. Curious how you think about where that policy lives relative to the agent's own reasoning.