# AI Testing & Quality Assurance — AI Coding Tools Directory

> Tools designed to autonomously generate, execute, and fix tests.

Source: https://ai.dosa.dev/category/qa-testing · Updated Nov 12, 2026 · 12 tools · Published by dosa.dev

## Comparison table

| # | Tool | Company | Pricing | Summary |
|---|---|---|---|---|
| 1 | [GitAuto](https://ai.dosa.dev/tools/gitauto) | GitAuto | Unknown | Development teams with legacy codebases or high test coverage requirements who need to automate repetitive unit testing and maintenance tasks. |
| 2 | [AgentDiff](https://ai.dosa.dev/tools/agentdiff) | Kerrshift | Freemium | Engineers building multi-turn, tool-calling agents who need to verify specific execution paths and maintain provenance in production environments. |
| 3 | [Agent QA](https://ai.dosa.dev/tools/agent-qa) | Vostride | Open Source | Engineering teams that want to own their testing stack, maintain test and memory files within their own repository, and leverage AI agents for automated QA workflows. |
| 4 | [e2e](https://ai.dosa.dev/tools/e2e) | TesterArmy | Open Source | Teams looking to combine the flexibility of agent-driven testing with the precision of scripted, locator-based E2E tests, particularly for projects that frequently evolve or require high-speed CI feedback. |
| 5 | [iFixAi](https://ai.dosa.dev/tools/ifixai) | iFixAi Inc. | Freemium | Engineering teams shipping AI agents that handle sensitive tasks like financial transactions, database edits, or internal tool usage. |
| 6 | [ARTEMIS](https://ai.dosa.dev/tools/artemis) | Google | Open Source | Mobile developers and QA engineers who need an autonomous AI agent to execute end-to-end testing, bug reproduction, or exploratory stability checks on Android devices. |
| 7 | [Promptfoo](https://ai.dosa.dev/tools/promptfoo) | OpenAI | Freemium | Developers and enterprises seeking to systematically test and secure AI applications against vulnerabilities during the development lifecycle. |
| 8 | [Reticle](https://ai.dosa.dev/tools/reticle) | Reticle Labs | Freemium | AI-assisted development loops where an agent builds and verifies its own code in an app you own, or regression suites requiring deterministic, low-cost execution. |
| 9 | [Momentic](https://ai.dosa.dev/tools/momentic) | Momentic (YC W24) | Freemium | Product and engineering teams shipping web or mobile apps who want autonomous exploratory QA and low-maintenance natural-language end-to-end tests instead of brittle Playwright or Selenium scripts. |
| 10 | [Gauge](https://ai.dosa.dev/tools/gauge) | Gauge | Freemium | Teams shipping CLIs, SDKs, MCP servers, Skills or docs who want evidence of how coding agents actually use them and a repeatable loop to fix friction. |
| 11 | [sandbox-mcp](https://ai.dosa.dev/tools/sandbox-mcp) | Scott Hanselman | Open Source | Windows desktop app developers who want Copilot, Claude, Cursor or other MCP-capable agents to test builds and installers on a clean Windows machine. |
| 12 | [AWS Emulator](https://ai.dosa.dev/tools/aws-emulator) | Amazon Web Services | Free | Developers and coding agents that need to build and test AWS applications in a fast local loop or in CI without touching a real AWS account. |

## Tools in this category

### 1. GitAuto

GitAuto is a highly specialized, effective tool for teams looking to enforce test culture and maintain high coverage metrics without manual intervention, though its current limitation to GitHub repositories is a significant constraint for some workflows.

- Review: https://ai.dosa.dev/tools/gitauto (Markdown: https://ai.dosa.dev/tools/gitauto.md)
- Alternatives: https://ai.dosa.dev/tools/gitauto/alternatives

### 2. AgentDiff

A robust, privacy-first infrastructure tool that effectively bridges the gap between agent execution and CI/CD reliability by focusing on deterministic state changes rather than simple output text.

- Review: https://ai.dosa.dev/tools/agentdiff (Markdown: https://ai.dosa.dev/tools/agentdiff.md)
- Alternatives: https://ai.dosa.dev/tools/agentdiff/alternatives

### 3. Agent QA

A robust, agent-native testing tool that excels by keeping all testing logic, knowledge, and evidence as version-controlled code, making it an excellent choice for teams integrating QA directly into their developer workflows.

- Review: https://ai.dosa.dev/tools/agent-qa (Markdown: https://ai.dosa.dev/tools/agent-qa.md)
- Alternatives: https://ai.dosa.dev/tools/agent-qa/alternatives

### 4. e2e

A powerful, developer-first framework that solves the common 'precision vs. flexibility' trade-off in AI testing by allowing granular, per-step control over agentic behavior and caching.

- Review: https://ai.dosa.dev/tools/e2e (Markdown: https://ai.dosa.dev/tools/e2e.md)
- Alternatives: https://ai.dosa.dev/tools/e2e/alternatives

### 5. iFixAi

The open-source engine is a highly effective, transparent diagnostic tool for ensuring agent safety and compliance. However, the hosted service remains in a nascent stage with opaque pricing, making the free version the recommended starting point.

- Review: https://ai.dosa.dev/tools/ifixai (Markdown: https://ai.dosa.dev/tools/ifixai.md)
- Alternatives: https://ai.dosa.dev/tools/ifixai/alternatives

### 6. ARTEMIS

ARTEMIS is a highly capable open-source tool for agentic Android testing that significantly reduces manual scripting by allowing AI models to perceive and interact with mobile UIs directly, making it an excellent addition for teams already utilizing MCP-capable AI coding assistants.

- Review: https://ai.dosa.dev/tools/artemis (Markdown: https://ai.dosa.dev/tools/artemis.md)
- Alternatives: https://ai.dosa.dev/tools/artemis/alternatives

### 7. Promptfoo

A robust, industry-standard tool for LLM evaluation and security testing that is highly effective for teams integrating AI risk management directly into their development workflows.

- Review: https://ai.dosa.dev/tools/promptfoo (Markdown: https://ai.dosa.dev/tools/promptfoo.md)
- Alternatives: https://ai.dosa.dev/tools/promptfoo/alternatives

### 8. Reticle

An essential tool for developers using AI agents; it bridges the gap between agent edits and verifiable outcomes by reading the application's internal state rather than relying on surface-level visual checks.

- Review: https://ai.dosa.dev/tools/reticle (Markdown: https://ai.dosa.dev/tools/reticle.md)
- Alternatives: https://ai.dosa.dev/tools/reticle/alternatives

### 9. Momentic

A strong, benchmark-backed option for agentic QA that targets recall over precision, best suited to teams comfortable with a hosted, usage-priced service.

- Review: https://ai.dosa.dev/tools/momentic (Markdown: https://ai.dosa.dev/tools/momentic.md)
- Alternatives: https://ai.dosa.dev/tools/momentic/alternatives

### 10. Gauge

A distinctive, fast-shipping eval loop for agent-facing products; still early with a small community, and the richer analysis lives in the paid hosted tier.

- Review: https://ai.dosa.dev/tools/gauge (Markdown: https://ai.dosa.dev/tools/gauge.md)
- Alternatives: https://ai.dosa.dev/tools/gauge/alternatives

### 11. sandbox-mcp

A practical, well-documented bridge between coding agents and Windows Sandbox for clean-machine app testing; Windows-only and very new.

- Review: https://ai.dosa.dev/tools/sandbox-mcp (Markdown: https://ai.dosa.dev/tools/sandbox-mcp.md)
- Alternatives: https://ai.dosa.dev/tools/sandbox-mcp/alternatives

### 12. AWS Emulator

An official, free local AWS emulator with first-class coding-agent support; a strong default for agent-driven AWS development and testing.

- Review: https://ai.dosa.dev/tools/aws-emulator (Markdown: https://ai.dosa.dev/tools/aws-emulator.md)
- Alternatives: https://ai.dosa.dev/tools/aws-emulator/alternatives
