Holmes vs Rainforest QA
Both draft tests from plain English and repair them with AI. Rainforest is strong where people help: crowd testers, human exploratory testing, a test writing service, and a wide browser matrix on virtual machines. Holmes adds AI agents that explore on their own, automated mobile and API testing, and checks on every pull request.
Rainforest's exploratory testing is run by human testers, and its AI Test Planner maps paths to propose a test plan. Holmes agents explore your product and test paths nobody wrote down.
Rainforest's docs say native iOS and Android apps are tested by people, not with automation, and API testing isn't on its pages. Holmes runs native Android and iOS apps on emulators and simulators and checks every request behind a journey.
Holmes checks and comments on GitHub and Bitbucket pull requests, GitLab included, and tests preview deployments before you merge. Rainforest runs from CI and on schedules; pull request checks aren't described on its pages.
Holmes publishes its Free, Starter and Team prices, with €250 in free credits to start. Rainforest's pricing page leads to a sales conversation.
Based on each product's public pages on 17 November 2026. A red cross means Rainforest QA's pages don't describe it, not that it can't be done.
| Capability | Holmes | Rainforest QA |
|---|---|---|
| Testing | ||
| How tests are written | Yes: Plain-language goals. No test code to write | Yes: Plain-English prompts draft steps you edit in a no-code visual editor[1][2] |
| Finds bugs nobody scripted | Yes: Agents explore and test paths nobody wrote down | Partly: Exploratory testing by human testers; AI agents map paths to propose a test plan[3][4] |
| Keeps tests working when the UI changes | Yes: Flows repair themselves when a label or layout changes | Yes: AI regenerates failing steps and updates the test; branching lets you approve changes[5][6] |
| Other browsers | Yes: Chromium, Firefox and WebKit, the engine behind Safari | Yes: Chrome, Safari, Edge, Firefox, Brave and IE 11 on Windows and macOS virtual machines[7] |
| Native Android apps | Yes: Native Android apps on an Android emulator | Partly: By human testers on simulators; automation covers the web[8][9] |
| Native iOS apps | Yes: Native iOS apps on iPhone and iPad simulators | Partly: By human testers on simulators; automation covers the web[8][9] |
| APIs | Yes: Every request behind a journey, checked in context | Not described: Not on its pages. API testing |
| Accessibility | Yes: WCAG audits in a real browser, with keyboard navigation | Not described: Not on its pages. WCAG audits |
| Visual testing | Partly: Compares the Figma design with what shipped. No pixel-diff baselines | Partly: Steps match on screenshots, so visual changes fail a test; no baseline comparison described[10] |
| Workflow | ||
| Pull requests and previews | Yes: Check and comment on GitHub and Bitbucket pull requests. GitLab supported | Not described: Not on its pages. Pull request checks or preview deployments |
| Schedules | Yes: On every deploy, on a schedule, or by webhook | Yes: On demand, on a schedule, or from the CLI, CircleCI and GitHub Actions[11][1] |
| Context it reads before testing | Yes: Reads the code change, ticket, spec (Notion, Confluence), design (Figma) and analytics (PostHog) | Not described: Not on its pages. Specs, designs or analytics |
| Coding agents (MCP) | Yes: Start runs and read findings from Claude and Cursor via MCP | Yes: MCP server for Claude Code, Cursor and Windsurf[12] |
| Evidence with each bug | Yes: Recording, screenshots, console and network logs, steps to reproduce | Yes: AI failure explanations, repro steps, video, HTTP and browser logs[10] |
| Where findings go | Yes: Findings on the pull request, the ticket, Slack, Microsoft Teams and email | Yes: Email, Slack and Microsoft Teams; Jira tickets created on failure[10][13] |
| Pricing and security | ||
| Entry price | Yes: Free plan. Paid plans from €199 ($219) a month | Note: Not listed; the pricing page leads to a sales call[14] |
| Getting started | Yes: €250 in free credits, no credit card | Yes: Free trial[1] |
| Managed service | Not covered: Not covered. Self-serve, with guided onboarding on Team and up | Yes: Test Writing Service, a crowd Tester Community and exploratory testers[15][8] |
| Where it runs | Yes: EU company (Ghent, Belgium), GDPR compliant | Note: Google Cloud; test virtual machines at Hetzner and LeaseWeb[16] |
Holmes sells QA software, so we compete with Rainforest QA. We've tried to be fair: every statement about Rainforest QA comes from its own public pages, linked below with the date we checked them. Products change. If something here is out of date, email support@useholmes.com and we'll fix it.
Use our visual editor to tweak AI-drafted steps, add assertions, or insert logic with no specialized skills needed.Checked 17 November 2026.
Use plain-English prompts to generate automated test scripts in seconds.Checked 17 November 2026.
When you start using exploratory, Rainforest recruits 4 dedicated testers and with each successive run, they're able to gain familiarity with your application and improve their ability to identify issues.Checked 17 November 2026.
We deploy 7 agents that attempt to navigate as many accessible paths as they can discover.Checked 17 November 2026.
If regenerated test steps successfully self-heal, then Rainforest automatically updates your test to the new, passing state, saving you time on test maintenance.Checked 17 November 2026.
By default, all tests will be self-healed automatically.Checked 17 November 2026.
Rainforest desktop web platforms are virtual machines (VMs) on which web regression tests can be run.Checked 17 November 2026.
Rainforest only supports testing of native iOS and Android phone and tablet applications using humans, not with automation.Checked 17 November 2026.
Moreover, mobile device support includes simulators for Apple and Android devices.Checked 17 November 2026.
Get AI-generated explanations of test failures, repro steps, video recordings, HTTP logs, browser logs, and more debugging insights.Checked 17 November 2026.
Run automated tests on-demand or on a schedule, or hook right into your CI tool.Checked 17 November 2026.
Rainforest's MCP server lets you generate and run tests directly from AI-powered coding tools like Claude Code, Cursor, or WindsurfChecked 17 November 2026.
Rainforest supports using Jira to automatically create a ticket when a test fails.Checked 17 November 2026.
See how Rainforest fits your teamChecked 17 November 2026.
Rainforest’s Test Writing Service (TWS) offloads the tasks of writing and maintaining tests and puts them in the hands of our QA experts. You are allowed up to 20 tests at a time.Checked 17 November 2026.
Our main application, API, and databases are powered by Google Cloud Platform (GCP).Checked 17 November 2026.
Rainforest combines no-code automation with human testing: crowd testers, exploratory testers and a test writing service. Its automation runs web tests on Windows and macOS virtual machines. Holmes is self-serve and automated end to end: AI agents test web apps, mobile apps and APIs from plain-language goals, explore on their own, and report on every pull request.[8][15][7]
Both. AI drafts and self-heals tests, and its Tester Community of trained human testers runs plain-text tests on demand. Exploratory testing uses 4 dedicated testers. Holmes uses AI agents only, with no crowd or managed team.[5][8][3]
Rainforest's docs say native iOS and Android apps are tested by human testers on simulators, not with automation. Holmes tests native Android and iOS apps automatically, on emulators and simulators.[8][9]
Rainforest offers a free trial, but its site shows no prices; the pricing page leads to a sales conversation. Holmes has a Free plan, Starter at €199 a month for up to 3 products, and Team from €499 a month, all with unlimited users and priced on how much Holmes tests.[1][14]
If you want human testers in the loop, a team to write tests for you, Safari, Edge, Brave or Internet Explorer 11 on virtual machines, or tests that reach beyond the browser window, Rainforest covers those on its own pages. If you want AI agents that explore on their own, automated mobile and API testing, and results on every pull request, try Holmes.[8][15][7][10]
Evaluating Rainforest QA? See what Holmes finds first.
Free, no scripts, no SDK, and no test account needed to start.