# Test automation tools compared: frameworks, AI and clouds

Canonical: https://revyl.com/compare/test-automation-tools/
Published: 2026-11-12
Last updated: 2026-11-12

> Test automation tools for web and mobile in three groups, open-source frameworks, AI testing platforms and test clouds, with pricing for each (2026).

Last verified: November 12, 2026.

Test automation tools for web and mobile fall into open-source frameworks (Playwright, Selenium, Cypress, Appium and Maestro), AI testing platforms (Momentic, QA Wolf, mabl, testRigor, Autify, Testsigma, Katalon and TestMu AI KaneAI) and test clouds (BrowserStack and Sauce Labs). Pick Revyl for natural-language end-to-end tests. Revyl's Free plan includes up to 1,200 free device minutes a month on iOS, Android, web and Mac, with no card and no monthly fee; past that, web is $0.05 a minute on Pro.

**Test automation tools at a glance, as of November 2026**

| | Type and pricing | How tests are written | What it runs on |
|---|---|---|---|
| Playwright | Framework ([source](https://playwright.dev/)) | Code in TypeScript, JavaScript, Python, .NET or Java ([source](https://playwright.dev/)) | Web: Chromium, Firefox and WebKit ([source](https://playwright.dev/)) |
| Selenium | Framework, Apache-2.0 ([source](https://github.com/SeleniumHQ/selenium)) | WebDriver code; Selenium IDE records and plays back ([source](https://www.selenium.dev/documentation/)) | Web browsers; Grid runs them in parallel on your machines ([source](https://www.selenium.dev/documentation/grid/)) |
| Cypress | Framework, MIT; Cypress Cloud is paid ([source](https://docs.cypress.io/app/faq)) | Code; Cypress Studio and cy.prompt turn recordings or plain language into commands ([source](https://docs.cypress.io/app/ai/overview)) | Anything that runs in a browser ([source](https://github.com/cypress-io/cypress)) |
| Appium | Framework, Apache 2.0 ([source](https://github.com/appium/appium/blob/master/LICENSE)) | Code in a WebDriver client: JS, Java, Python and others ([source](https://appium.io/docs/en/latest/intro/)) | iOS and Android apps through drivers such as XCUITest, UiAutomator2 and Espresso ([source](https://appium.io/docs/en/latest/ecosystem/drivers/)) |
| Maestro | Framework; Maestro Cloud $250 per device per month ([source](https://maestro.dev/pricing)) | Declarative YAML flows ([source](https://docs.maestro.dev/get-started/what-is-maestro.md)) | iOS simulators, Android emulators and devices ([source](https://docs.maestro.dev/get-started/supported-platform.md)) |
| Momentic | AI testing platform; Free $0 with $50 of usage a month ([source](https://momentic.ai/pricing)) | Plain-English YAML in your repo ([source](https://momentic.ai/docs/local-app)) | Web on Chromium-based browsers; iOS simulators and Android emulators ([source](https://momentic.ai/docs/quickstart/web)) |
| QA Wolf | AI platform and service; $1 per web run, $2 per mobile or desktop run ([source](https://www.qawolf.com/pricing)) | Playwright code written for you, stored in GitHub ([source](https://www.qawolf.com/education/playwright-automation-tool)) | Chrome, Firefox, WebKit; real iPhones and iPads; Android emulators or devices ([source](https://www.qawolf.com/pricing)) |
| mabl | AI testing platform; quote-based, 14-day trial ([source](https://www.mabl.com/pricing)) | Conversational planning and agentic authoring ([source](https://docs.mabl.com/docs/mabl-cli/author-mabl-tests-from-your-ai-coding-agent.md)) | Web and mobile UI, API, accessibility and performance ([source](https://www.mabl.com/pricing)) |
| testRigor | AI testing platform; pricing through sales ([source](https://testrigor.com/docs/language/)) | Plain-English steps ([source](https://testrigor.com/features)) | Web, mobile web, native mobile, desktop, API and mainframe ([source](https://testrigor.com/docs/language/)) |
| Autify | AI testing platform; Core $99/month billed annually ([source](https://autify.com/pricing)) | Plain English, a recorder or Playwright files, edited as low-code or code ([source](https://helpcenter.autify.com/docs/creating-a-scenario)) | Web on Playwright; NoCode Mobile on real devices and emulators ([source](https://nocode.autify.com/mobile)) |
| Testsigma | AI testing platform; quote-based ([source](https://testsigma.com/pricing)) | Natural-language tests without code ([source](https://testsigma.com/docs/v2/get-started/overview/)) | 800+ browser and OS combinations, 2,000+ real mobile devices on Pro ([source](https://testsigma.com/pricing)) |
| Katalon | IDE and platform; Professional $1,800 per seat per year ([source](https://katalon.com/pricing)) | Low-code, record and playback, AI code generation ([source](https://katalon.com/pricing)) | Chrome, Firefox, Safari, Edge; real iOS and Android devices on TestCloud ([source](https://katalon.com/testcloud)) |
| TestMu AI KaneAI | AI agent; KaneAI Starter $17/month billed annually ([source](https://www.testmuai.com/pricing/)) | AI-generated test cases; Kane CLI for local authoring ([source](https://www.testmuai.com/pricing/)) | Web, mobile and AI applications ([source](https://www.testmuai.com/)) |
| BrowserStack | Cloud; priced per product and per user ([source](https://www.browserstack.com/pricing)) | Runs Selenium, Playwright, Cypress and Puppeteer suites ([source](https://www.browserstack.com/docs/browserstack-mcp-server/overview)) | 30,000+ real iOS and Android devices plus desktop browsers ([source](https://www.browserstack.com/real-device-cloud)) |
| Sauce Labs | Cloud; monthly plans per product ([source](https://saucelabs.com/pricing)) | Runs your framework suites; Sauce AI turns natural language into steps and code ([source](https://saucelabs.com/products/sauce-ai-for-authoring)) | Desktop browsers, real mobile devices, emulators and simulators ([source](https://saucelabs.com/pricing)) |
| Revyl | Runtime platform; Free plan $0: up to 1,200 free device minutes a month on iOS, Android, web and Mac, 2 devices at once, no card; web $0.05 a minute on Pro ([source](https://revyl.com/pricing/)) | Natural-language steps; AI finds elements instead of selectors ([source](https://docs.revyl.com/tests)) | Web in Chrome; cloud iOS simulators, Android emulators and macOS computers ([source](https://docs.revyl.com/sessions)) |

Test automation tools run checks against your app without a person clicking through it. They come in three kinds: open-source frameworks you code and host, AI testing platforms that write and maintain tests, and clouds that run suites on hosted browsers and devices. This page compares the tools in each group for web and mobile, as of November 2026. Octomind, an AI web testing tool, shut its product down at the end of May 2026 ([letter](https://octomind.dev/blog/a-letter-to-our-users-customers-and-readers/)); see Octomind alternatives.

## How do test automation tools differ?

The first difference is what a test is. In a framework it is code (Playwright, Selenium, Cypress, Appium) or a YAML flow (Maestro). On AI platforms it is plain-language steps (testRigor, Testsigma, Momentic, Revyl), Playwright code an AI or a team writes for you (QA Wolf, Autify Nexus), or a test authored by an agent inside a broader platform (mabl, Katalon, KaneAI).

The second is where it runs. Frameworks run wherever you host them, such as a laptop, a CI runner or your own Selenium Grid. Clouds such as BrowserStack and Sauce Labs host the browsers and devices for you. For hosted AI platforms, check each vendor's deployment model.

The third is what you get back. Playwright's [Trace Viewer](https://playwright.dev/docs/trace-viewer) shows DOM snapshots, network requests and console logs for each step. Momentic and QA Wolf keep video, traces and network data per run. Revyl reports include video, a step timeline, the Web console and request failures for web runs, and device logs for mobile runs.

## Which open-source test automation frameworks are worth a look?

### Playwright

[Playwright](https://playwright.dev/) is an open-source project maintained by Microsoft. [Codegen](https://playwright.dev/docs/codegen) records actions into code, and [test agents](https://playwright.dev/docs/test-agents) plan, generate and heal tests.

### Selenium

[Selenium](https://www.selenium.dev/documentation/) is a browser automation project built on the W3C WebDriver standard, with bindings in several languages.

### Cypress

The [Cypress App](https://docs.cypress.io/app/faq) is free, and [Cypress Cloud](https://www.cypress.io/pricing) adds recorded runs, parallelization, Test Replay and a Cloud MCP server ([AI overview](https://docs.cypress.io/app/ai/overview)).

### Appium

[Appium](https://appium.io/docs/en/latest/intro/) automates mobile apps and runs on your own server or on a device cloud.

### Maestro

[Maestro](https://docs.maestro.dev/get-started/what-is-maestro.md) is a mobile UI testing framework. As of November 2026, Maestro Cloud costs $250 per device per month ([pricing](https://maestro.dev/pricing)). Our [Maestro vs Appium](/compare/maestro-vs-appium/) page compares the two.

## Which AI testing platforms automate end-to-end tests?

### Momentic

Pricing, as of November 2026: Free is $0 with $50 of usage each month, Scale is $500/month, and Enterprise is custom ([pricing](https://momentic.ai/pricing)).

### QA Wolf

QA Wolf calls itself a [hybrid platform and service](https://github.com/qawolf).

Pricing, as of November 2026: $1 per web test run and $2 per mobile or desktop run, with up to 5 minutes of run time per test and longer tests billed in 5-minute blocks. New teams get free runs ([pricing](https://www.qawolf.com/pricing)).

### mabl

mabl describes itself as an [agentic testing harness](https://www.mabl.com/platform). It retired its local MCP server on August 25, 2026 and documents a [cloud MCP server](https://docs.mabl.com/docs/mabl-mcp/set-up-the-cloud-mcp-server.html).

As of November 2026, pricing is quote-based, with a 14-day free trial. Local runs are free, and cloud runs use credits, starting at 500 credits a month with unlimited cloud concurrency ([pricing](https://www.mabl.com/pricing)).

### testRigor

As of November 2026, pricing is through sales. testRigor has a [free Public plan](https://testrigor.com/sign-up/), and free public plans run one test at a time ([docs](https://testrigor.com/docs/language/), [parallel runs](https://testrigor.com/how-to-articles/how-to-execute-test-cases-in-parallel-in-testrigor/)).

### Autify

Pricing, as of November 2026: a Free Trial with 2,000 one-time credits and one web concurrency, Core at $99/month billed annually with five web concurrency, and Team at $450/month billed annually with 20 ([pricing](https://autify.com/pricing)). Our Revyl vs Autify page goes deeper.

### Testsigma

Testsigma is an [agentic test automation platform](https://testsigma.com/).

As of November 2026, pricing is a personalized quote based on expected usage. Pro includes unlimited automated testing minutes, and the free trial includes the agentic AI features ([pricing](https://testsigma.com/pricing)).

### Katalon

Pricing, as of November 2026: Professional is $1,800 per seat per year, billed annually, and cloud execution needs TestCloud add-ons ([pricing](https://katalon.com/pricing)). Our Revyl vs Katalon page goes deeper.

### TestMu AI KaneAI

TestMu AI is the new name of LambdaTest, [rebranded on January 12, 2026](https://www.testmuai.com/lambdatest-is-now-testmuai/) with the same team, infrastructure and accounts. TestMu AI also sells Live Testing for interactive browser sessions and HyperExecute for parallel runs ([pricing](https://www.testmuai.com/pricing/)).

Pricing, as of November 2026: KaneAI Starter is $17/month billed annually for one agent with 2,000 credits a month, and other products are priced separately ([pricing](https://www.testmuai.com/pricing/)).

### Revyl

Revyl runs web tests as [natural-language steps](https://docs.revyl.com/tests) in a [Chrome session streamed to your browser](https://docs.revyl.com/sessions), and AI finds elements instead of selectors. You create tests in the dashboard or with `revyl test create --platform web` and run them with `revyl test run` or the GitHub Action. You can also take over a live session: members click, scroll, type and press keys, and each input is recorded as a step. Each test run's [report](https://docs.revyl.com/tests/reports) has video, a step timeline, the Web console and request failures, and a JS heap chart. With [proof of changes](https://docs.revyl.com/agents/proof), the pull request gets a verdict, screenshots and an Open preview link. Agents start Web sessions through the [MCP server](https://docs.revyl.com/reference/mcp-tools) or with `revyl device start --platform web`.

It suits teams whose coding agents write code and whose reviewers want to see the web build running, with a verdict on each pull request. The same natural-language tests run on cloud iOS simulators and Android emulators, and workflows run Web, iOS and Android tests together. For existing suites, Revyl also documents an [Appium driver](https://docs.revyl.com/infrastructure/appium) and a [Maestro runner](https://docs.revyl.com/infrastructure/maestro), each with its own documented set of supported commands.

Pricing, as of November 2026: Revyl's Free plan is $0: up to 1,200 free device minutes a month on iOS, Android, web and Mac, 2 devices at once, no card. Pro is pay as you go at $0.075 per device minute on iOS and Android, with 10 devices at once, free minutes every month and a $20 starting credit, with no monthly fee. Enterprise is custom, with volume pricing and unlimited devices at once. Team members are unlimited ([pricing](https://revyl.com/pricing/)). [Web is available on every plan](https://docs.revyl.com/builds/web): web browser sessions are $0.05 a minute on Pro. QA Wolf lists $1 per web test run of up to 5 minutes ([QA Wolf pricing](https://www.qawolf.com/pricing)).

## Which test clouds run your existing suites?

### BrowserStack

BrowserStack hosts real devices and desktop browsers for your existing suites, and it is priced [per product and per user](https://www.browserstack.com/pricing). Our [Revyl vs BrowserStack](/compare/revyl-vs-browserstack/) page goes deeper.

### Sauce Labs

Sauce Labs runs manual and automated tests on hosted browsers and devices, and plans are sold monthly per product ([pricing](https://saucelabs.com/pricing)).

## Beyond test automation: what else Revyl runs

- Web: web apps run in a Chrome session streamed to your browser with desktop and mobile viewports, and members can drive the session by hand while each input is recorded as a step ([sessions](https://docs.revyl.com/sessions)). A Web build is a bundle Revyl builds from a Next.js or Vite recipe, or a registered HTTPS preview URL from [any framework](https://docs.revyl.com/frameworks/web).
- iOS and Android: the same account runs cloud iOS simulators and Android emulators, and [workflows](https://docs.revyl.com/tests) run Web tests alongside iOS and Android tests. One regression suite can cover your web app and its mobile apps, with a report for each run.
- macOS computers: full macOS environments in the cloud whose desktop streams to the browser. The CLI runs commands and moves files, a computer can host Web and iOS app sessions, and `runs-on: revyl-macos` runs GitHub Actions jobs ([computers](https://docs.revyl.com/computers), [GitHub Actions](https://docs.revyl.com/computers/github-actions)).
- Atlas: [Atlas](https://docs.revyl.com/atlas) maps Web, iOS and Android apps the same way, and `revyl explore run --platform web` explores a web app and records what it finds ([explore CLI](https://docs.revyl.com/atlas/explore-cli)).
- Agent access: the [MCP server](https://docs.revyl.com/agents/mcp) starts an iOS, Android or web session or a macOS computer, and the CLI starts a web session with `revyl device start --platform web` ([quickstart](https://docs.revyl.com/infrastructure/quickstart)).
- PR verdicts and run reports: every test run gets a [report](https://docs.revyl.com/tests/reports), and with proof of changes, Revyl posts a verdict, screenshots and an Open preview link on the pull request ([proof](https://docs.revyl.com/agents/proof)).

## Common questions

**What are the best automated testing tools?**

It depends on who writes the tests. Developers who want code they own can start with Playwright, Selenium or Cypress for web and Appium or Maestro for mobile. Teams that want AI to write or repair tests look at platforms such as Momentic, QA Wolf, mabl, testRigor, Autify, Testsigma, Katalon or Revyl. Teams that need hosted browsers and devices can consider a cloud such as BrowserStack or Sauce Labs.

**What is e2e testing?**

End-to-end (e2e) testing drives a whole app the way a user does, through its real interface, to check that a flow such as sign-up or checkout works from start to finish. On the web that means a browser; on mobile it means an iOS simulator, Android emulator or device. This page compares how the listed tools approach end-to-end testing and where they run.

**Which test automation tools are open source?**

Selenium and Appium are Apache-2.0, Maestro is Apache 2.0, and the Cypress App is MIT, with Cypress Cloud sold separately. Playwright is an open-source project maintained by Microsoft. Testsigma also publishes an Apache-2.0 open-source edition.

**Is Octomind still available?**

No. Octomind announced on April 23, 2026 that its product would be turned off at the end of May 2026 and the company would close by the end of June 2026.

**What else does Revyl do?**

Revyl supplies the runtime for each surface a suite touches: Chrome sessions streamed to your browser for web apps, iOS simulators and Android emulators for mobile apps, and macOS computers started in the cloud. Atlas maps web, iOS and Android apps the same way. Natural-language tests run on web, iOS and Android from the dashboard, the CLI or the GitHub Action, agents drive sessions through the MCP server and CLI, and with proof of changes, Revyl posts a verdict with screenshots on the pull request.

## Sources

- [Playwright](https://playwright.dev/)
- [Playwright test agents](https://playwright.dev/docs/test-agents)
- [Playwright trace viewer](https://playwright.dev/docs/trace-viewer)
- [Playwright codegen](https://playwright.dev/docs/codegen)
- [Selenium documentation](https://www.selenium.dev/documentation/)
- [Selenium Grid](https://www.selenium.dev/documentation/grid/)
- [Selenium on GitHub](https://github.com/SeleniumHQ/selenium)
- [Cypress FAQ](https://docs.cypress.io/app/faq)
- [Cypress AI overview](https://docs.cypress.io/app/ai/overview)
- [Cypress pricing](https://www.cypress.io/pricing)
- [Appium introduction](https://appium.io/docs/en/latest/intro/)
- [Appium drivers](https://appium.io/docs/en/latest/ecosystem/drivers/)
- [Appium license](https://github.com/appium/appium/blob/master/LICENSE)
- [What is Maestro](https://docs.maestro.dev/get-started/what-is-maestro.md)
- [Maestro supported platforms](https://docs.maestro.dev/get-started/supported-platform.md)
- [Maestro pricing](https://maestro.dev/pricing)
- [BrowserStack real device cloud](https://www.browserstack.com/real-device-cloud)
- [BrowserStack MCP server](https://www.browserstack.com/docs/browserstack-mcp-server/overview)
- [BrowserStack pricing](https://www.browserstack.com/pricing)
- [Sauce Labs pricing](https://saucelabs.com/pricing)
- [Sauce AI for test authoring](https://saucelabs.com/products/sauce-ai-for-authoring)
- [Sauce MCP](https://docs.saucelabs.com/sauce-ai/sauce-mcp/)
- [Testsigma open-source license](https://github.com/testsigmahq/testsigma/blob/main/LICENSE)
- [Octomind farewell letter](https://octomind.dev/blog/a-letter-to-our-users-customers-and-readers/)
- [Revyl Appium driver](https://docs.revyl.com/infrastructure/appium)
- [Revyl Maestro runner](https://docs.revyl.com/infrastructure/maestro)
- [Momentic about](https://momentic.ai/about)
- [Momentic web quickstart](https://momentic.ai/docs/quickstart/web)
- [Momentic local app](https://momentic.ai/docs/local-app)
- [Momentic results](https://momentic.ai/docs/running-tests/results)
- [Momentic GitHub Actions](https://momentic.ai/docs/running-tests/ci/github-actions)
- [Momentic pricing](https://momentic.ai/pricing)
- [QA Wolf on GitHub](https://github.com/qawolf)
- [QA Wolf Playwright automation](https://www.qawolf.com/education/playwright-automation-tool)
- [QA Wolf run infrastructure](https://www.qawolf.com/run-infra)
- [QA Wolf GitHub deployment testing](https://docs.qawolf.com/deployment-testing/github)
- [QA Wolf MCP](https://docs.qawolf.com/qawolf-mcp)
- [QA Wolf pricing](https://www.qawolf.com/pricing)
- [mabl platform](https://www.mabl.com/platform)
- [mabl pricing](https://www.mabl.com/pricing)
- [mabl agent authoring](https://docs.mabl.com/docs/mabl-cli/author-mabl-tests-from-your-ai-coding-agent.md)
- [mabl agent debugging](https://docs.mabl.com/docs/mabl-cli/debug-mabl-tests-from-your-ai-coding-agent.html)
- [mabl cloud MCP](https://docs.mabl.com/docs/mabl-mcp/set-up-the-cloud-mcp-server.html)
- [mabl Selenium migration](https://docs.mabl.com/docs/mabl-cli/migrating-from-selenium.html)
- [testRigor features](https://testrigor.com/features)
- [testRigor docs](https://testrigor.com/docs/language/)
- [testRigor recorder](https://support.testrigor.com/support/solutions/articles/154000231604-how-to-use-testrigor-s-test-recorder-for-record-and-playback-testing-)
- [testRigor parallel runs](https://testrigor.com/how-to-articles/how-to-execute-test-cases-in-parallel-in-testrigor/)
- [Autify Nexus](https://autify.com/products/autify-nexus)
- [Autify Nexus scenarios](https://helpcenter.autify.com/docs/creating-a-scenario)
- [Autify Nexus AI Agent](https://helpcenter.autify.com/docs/nexus-ai-agent-unlock-productivity)
- [Aximo MCP server](https://help.aximo.autify.com/cli/mcp-server)
- [Autify pricing](https://autify.com/pricing)
- [Testsigma](https://testsigma.com/)
- [Testsigma docs](https://testsigma.com/docs/v2/get-started/overview/)
- [Testsigma AI agents](https://testsigma.com/ai-agents)
- [Testsigma Arcus MCP](https://testsigma.com/docs/arcus/v2/qi-home/developer-tools/mcp/)
- [Testsigma pricing](https://testsigma.com/pricing)
- [About Katalon Studio](https://docs.katalon.com/katalon-studio/about-katalon-studio)
- [Katalon TestCloud](https://katalon.com/testcloud)
- [Katalon MCP](https://katalon.com/katalon-mcp)
- [Katalon pricing](https://katalon.com/pricing)
- [TestMu AI rebrand](https://www.testmuai.com/lambdatest-is-now-testmuai/)
- [TestMu AI pricing](https://www.testmuai.com/pricing/)
- [Autify NoCode Mobile](https://nocode.autify.com/mobile)
- [TestMu AI](https://www.testmuai.com/)
- [Revyl sessions](https://docs.revyl.com/sessions)
- [Revyl web builds](https://docs.revyl.com/builds/web)
- [Revyl web frameworks](https://docs.revyl.com/frameworks/web)
- [Revyl tests](https://docs.revyl.com/tests)
- [Revyl test reports](https://docs.revyl.com/tests/reports)
- [Revyl proof of changes](https://docs.revyl.com/agents/proof)
- [Revyl MCP tools](https://docs.revyl.com/reference/mcp-tools)
- [Revyl MCP](https://docs.revyl.com/agents/mcp)
- [Revyl infrastructure quickstart](https://docs.revyl.com/infrastructure/quickstart)
- [Revyl Atlas](https://docs.revyl.com/atlas)
- [Revyl exploration CLI](https://docs.revyl.com/atlas/explore-cli)
- [Revyl Mac computers](https://docs.revyl.com/computers)
- [Revyl Mac computers in GitHub Actions](https://docs.revyl.com/computers/github-actions)
- [Revyl pricing](https://revyl.com/pricing/)
- [github.com/cypress-io/cypress](https://github.com/cypress-io/cypress)
