Holmes vs Functionize
Both write tests from plain language and repair them when the UI changes. Functionize already runs on four browsers, and checks SMS and email. Holmes adds agents that explore past the script, native mobile testing, and context from specs, designs and analytics.
Functionize Studio tests what you describe; in its own words, you decide what matters. Holmes tests your goals too, and its agents also explore paths nobody wrote down.
Functionize's pages describe web flows. Holmes tests native Android and iOS apps on emulators and simulators, with the same plain-language goals it uses for the web.
Functionize lists MCP, CI/CD, Jira and Slack among its integrations. Holmes also reads the spec in Notion or Confluence, the design in Figma and your top pages in PostHog before it decides what to test.
Holmes runs WCAG audits with keyboard navigation and walks your product as the personas you build for. Accessibility testing isn't described on Functionize's pages.
Based on each product's public pages on 17 November 2026. A red cross means Functionize's pages don't describe it, not that it can't be done.
| Capability | Holmes | Functionize |
|---|---|---|
| Testing | ||
| How tests are written | Yes: Plain-language goals. No test code to write | Yes: Describe it in a chat; Studio writes, runs and maintains the tests[1] |
| Finds bugs nobody scripted | Yes: Agents explore and test paths nobody wrote down | Not described: Not on its pages. Exploring beyond the tests you describe |
| Keeps tests working when the UI changes | Yes: Flows repair themselves when a label or layout changes | Yes: Self-healing on every run; elements found by how they look and what they mean[2] |
| Other browsers | Yes: Chromium, Firefox and WebKit, the engine behind Safari | Yes: Chrome, Firefox, Safari and Edge, single or in parallel[2] |
| Native Android apps | Yes: Native Android apps on an Android emulator | Not described: Not on its pages. Native Android apps |
| Native iOS apps | Yes: Native iOS apps on iPhone and iPad simulators | Not described: Not on its pages. Native iOS apps |
| APIs | Yes: Every request behind a journey, checked in context | Yes: APIs, databases, files, email and SMS in the same flow[2] |
| Visual testing | Partly: Compares the Figma design with what shipped. No pixel-diff baselines | Yes: Baseline, step comparison or page check[2] |
| Accessibility | Yes: WCAG audits in a real browser, with keyboard navigation | Not described: Not on its pages. Accessibility (WCAG) testing |
| Workflow | ||
| Pull requests and previews | Yes: Check and comment on GitHub and Bitbucket pull requests. GitLab supported | Partly: Its developers page says every pull request is tested against the live app; git hosts and previews aren't named[3] |
| Schedules | Yes: On every deploy, on a schedule, or by webhook | Yes: Orchestrations on demand or on a schedule, parallel or sequential[2] |
| Coding agents (MCP) | Yes: Start runs and read findings from Claude and Cursor via MCP | Yes: MCP server for Claude Code, Cursor, Copilot and others[4] |
| Evidence with each bug | Yes: Recording, screenshots, console and network logs, steps to reproduce | Partly: Run records, a screenshot on every step and a diagnosis of each failure; video and console logs aren't described[2] |
| Where findings go | Yes: Findings on the pull request, the ticket, Slack, Microsoft Teams and email | Partly: Integrates with Jira, Slack, CI/CD and MCP; how findings reach Jira or Slack isn't described[5] |
| Pricing and security | ||
| What you pay for | Yes: Priced on how much Holmes tests, never on seats | Note: Credits, billed monthly or annually; Growth and Scale can buy more[6][7] |
| Entry price | Yes: Free plan. Paid plans from €199 ($219) a month | Note: Free plan; Growth $20 a month, Scale $100 a month, Enterprise on request. Extra credits $10 per 200,000 on Growth and Scale[7] |
| Getting started | Yes: €250 in free credits, no credit card | Yes: Free plan with 800,000 credits a month, no credit card[7] |
| Where it runs | Not covered: Not covered. Cloud only | Yes: Its cloud, or privately inside your own environment[5] |
| Data location | Yes: EU company (Ghent, Belgium), GDPR compliant | Note: Data kept in the region you operate in[5] |
Holmes sells QA software, so we compete with Functionize. We've tried to be fair: every statement about Functionize comes from its own public pages, linked below with the date we checked them. Products change. If something here is out of date, email support@useholmes.com and we'll fix it.
Describe what your app should do. Studio writes the tests, runs them, and keeps them current as the app changes.Checked 17 November 2026.
Chrome, Firefox, Safari, and Edge, single or in parallel.Checked 17 November 2026.
Every PR is tested against your live app the moment it's ready.Checked 17 November 2026.
Build, run and diagnose tests against your real app from Claude Code, Cursor or CopilotChecked 17 November 2026.
Run on our cloud, or deploy privately inside your own environment.Checked 17 November 2026.
Credits are billed on your plan's payment cycle monthly or annually, in advance.Checked 17 November 2026.
The Free plan includes all agent capabilities, 800,000 credits each month, and five parallel runs. You do not need a credit card.Checked 17 November 2026.
Both describe tests in plain language and keep them working as the UI changes. Functionize Studio tests the web flows you describe, across four browsers, and adds SMS, email and database checks. Holmes also explores paths nobody wrote down, tests native Android and iOS apps, and reads specs, designs and analytics before it tests.[1][2]
Holmes tests native Android and iOS apps on emulators and simulators. Functionize's current pages describe web flows, and native mobile apps aren't described there.[2]
Functionize charges credits. The Free plan includes 800,000 credits a month and five parallel runs, Growth is $20 a month, Scale is $100 a month, and Enterprise is priced on request. Holmes has a Free plan, Starter at €199 a month for up to 3 products, and Team from €499 a month, all with unlimited users.[7]
Yes. Functionize has an MCP server for Claude Code, Cursor, Copilot and others. Holmes connects to Claude and Cursor via MCP to start runs and read findings, and it checks every pull request and preview deployment.[4]
If you need runs on Safari and Edge, SMS, email or MFA checks (on paid plans), or a private deployment inside your own environment, Functionize covers those on its own pages, at a low entry price. If you want agents that explore beyond what you describe, native mobile testing and context from specs and designs, try Holmes.[2][5][7]
Evaluating Functionize? See what Holmes finds first.
Free, no scripts, no SDK, and no test account needed to start.