AI Testing & Quality Assurance
Tools designed to autonomously generate, execute, and fix tests.
12 tools · 12 with full reviews · 5 free or open source · Updated
GitAuto Unknown
GitAuto GitAuto is an automated testing platform for GitHub that systematically identifies untested code and generates unit tests to improve coverage. It automates the full testing lifecycle, including PR creation, CI failure resolution, and auto-merging to maintain high quality standards. AgentDiff Freemium
AgentStatus AgentDiff is an infrastructure tool that provides deterministic regression testing and provenance for AI agents by monitoring execution traces. It integrates with GitHub to verify state changes against baselines, helping developers catch agent regressions before code is merged. Agent QA Open Source
Vostride Agent QA is a source-available, self-improving testing harness that runs plain-English YAML tests across web, Android, and iOS environments. It maintains persistent knowledge via a memory layer called memidex and creates reviewable evidence files directly within your repository. e2e Open Source
TesterArmy e2e is an open-source TypeScript testing framework that integrates agentic AI steps with traditional, deterministic test locators and assertions. It allows developers to mix natural language goals with precise scriptable checks for web, iOS, and Android applications, using a caching mechanism to minimize model costs. iFixAi Freemium
iFixAi iFixAi is an independent auditing service that tests AI agents for operational alignment, governance, and security. It simulates real-world requests and adversarial inputs to evaluate whether an agent adheres to its defined roles, tools, and business policies. ARTEMIS Open Source
Google ARTEMIS is an autonomous AI agent and testing framework that converts natural-language instructions into reliable Android automation. It integrates with AI coding assistants via the Model Context Protocol to execute workflows, perform diagnostics, and verify outcomes on real devices and emulators. Promptfoo Freemium
Promptfoo (part of OpenAI) Promptfoo is an open-source CLI and library designed for evaluating and red-teaming LLM applications. It enables developers to systematically test prompts, models, and RAG workflows to uncover vulnerabilities like injections and jailbreaks. Reticle Freemium
Reticle Labs Reticle is an AI verification layer that embeds a dev-only SDK into your web application, allowing coding agents to prove their changes work by observing program state, network activity, and console output. It provides deterministic, model-free verification, catching bugs like UI-vs-store desyncs and silent failures that traditional screenshot or DOM-based testing might miss. Momentic Freemium
Momentic (YC W24) Momentic is an AI QA platform whose agent harness, Mo, autonomously plans, explores and bug-bashes user flows in web, iOS and Android apps. It forks large product areas into parallel sub-agents with their own hosted browsers or devices and also supports natural-language end-to-end tests driven from a CLI and coding-agent skills. Gauge Freemium
Gauge Open-source CLI that measures and improves agent experience: it runs real coding agents against your Skills, CLIs, SDKs, MCP servers or docs in sandboxed sessions, captures where they get stuck, and lets your own coding agent test fixes before you publish. sandbox-mcp Open Source
Scott Hanselman sandbox-mcp gives an AI agent a fresh, disposable Windows 11 machine for testing apps. Its `sbx` CLI and optional MCP adapter boot Windows Sandbox, deploy a build, drive the UI, collect screenshots and logs, and then delete the guest, so agents can verify that software runs on a clean PC rather than only on the developer's machine. AWS Emulator Free
Amazon Web Services AWS Emulator is a local emulator of the AWS APIs that you run on your machine, a development server or in CI. The AWS CLI, AWS SDKs and coding agents talk to it over a local HTTPS endpoint with the same API shapes and errors as AWS, so they can create resources, check results and iterate without an AWS account or a deployment. FAQ
What are the best QA & Testing tools?
The most complete QA & Testing listings on ai.dosa.dev include GitAuto, AgentDiff, Agent QA. Every tool has a detail page with pricing, key features, and a verdict - see the full list of 12 tools below.
Are QA & Testing tools free?
5 of the 12 QA & Testing tools listed here are free or open source. Others offer freemium or paid plans - check each tool's detail page for current pricing.
How is this list curated?
ai.dosa.dev is manually curated from community submissions and editorial review. Entries are enriched with pricing, features, and reviewer notes, and the directory is updated continuously.