u/OneIndication7989

By "automated testing", I'm talking about the ability to test a web application, in order to determine if it works as expected.

Most modern test automation platforms now include some Agentic AI abilities, platforms such as:

1. Endtest
2. Functionize
3. Autify
4. Mabl

They have really good reviews.

Our goal is to create, manage and execute these tests, without having to deal with any code.

And those tests would have to run on multiple browsers (Chrome, Edge, Firefox, SafarI).

We're evaluating those tools, and it's been good so far, but I'm curious to see what issues other people have faced with such tools.

We're interested only in enterprise tools, we're not interested in Playwright or Selenium.

In my previous job experiences, dealing with Selenium/Cypress/Playwright has always been an icky process.

Almost the same story every time. Someone starts building an internal test automation framework. It looks good at the start. Then it gets bloated. Low adoption among the team members. And then someone says "Oh, maybe we should rebuild it." and the toxic cycle restarts.

The thing is that AI seems to act as an accelerant. So, if you're doing something stupid, it makes you do that stupid thing faster.

I don't think the solution is to generate more Selenium/Cypress/Playwright code with AI.

I'm looking at these AI Test Automation tools that store the tests in a "human-readable" format, and not as code. Most of them are cloud tools, so they also have cross-browser clouds (e.g. you can run your test on Safari on MacOS machines from their cloud).

We want to do some POCs in the following weeks with some of these tools.

We're thinking of trying:

1. Endtest
2. Mabl
3. Functionize

Does anyone have any real experience with either of those tools?

Our requirements are:
- we need to create tests fast
- some AI self-healing mechanism to keep the tests synced with the web app
- the tool should have some API for integration with our CI/CD
- we should be able to run tests on real Safari in the cloud (not WebKit, but actual Safari)
- visual testing capabilities (aka screenshot comparison)
- accessibility testing option would be nice
- api testing option would be nice

In my previous job experiences, dealing with Selenium/Cypress/Playwright has always been an icky process.

Almost the same story every time. Someone starts building an internal test automation framework. It looks good at the start. Then it gets bloated. Low adoption among the team members. And then someone says "Oh, maybe we should rebuild it." and the toxic cycle restarts.

The thing is that AI seems to act as an accelerant. So, if you're doing something stupid, it makes you do that stupid thing faster.

I don't think the solution is to generate more Selenium/Cypress/Playwright code with AI.

I'm looking at these AI Test Automation tools that store the tests in a "human-readable" format, and not as code. Most of them are cloud tools, so they also have cross-browser clouds (e.g. you can run your test on Safari on MacOS machines from their cloud).

We want to do some POCs in the following weeks with some of these tools.

We're thinking of trying:

1. Endtest
2. Mabl
3. Functionize

Does anyone have any real experience with either of those tools?

Our requirements are:
- we need to create tests fast
- some AI self-healing mechanism to keep the tests synced with the web app
- the tool should have some API for integration with our CI/CD
- we should be able to run tests on real Safari in the cloud (not WebKit, but actual Safari)
- visual testing capabilities (aka screenshot comparison)
- accessibility testing option would be nice
- api testing option would be nice

I

I'm getting frustrated of having to test it manually after each small change. I've had instances where I introduced strange problems (visual and functional).

I’ve been looking around and these seem to be some of the more interesting tools in this space:

• Endtest
• mabl
• Testim
• Katalon
• Testsigma
• Autify

Endtest looks pretty interesting because it seems more focused on full end-to-end flows, not just simple browser clicks. mabl and Testim also look solid, but maybe more enterprise-ish.

Curious what people here are actually using, especially for no-code projects that are already live and have real users.

Saw this Medium article and thought it made a fair point.

Picking Playwright or Selenium is one thing. Maintaining the whole setup is the part that usually hurts: selectors, waits, CI, reports, browser infra, test data, and all the random edge cases.

Not saying either tool is bad. I just think the framework debate misses a lot of the actual pain.

Are teams here still mostly choosing between frameworks, or are AI-assisted testing tools starting to actually become part of the conversation too?

Not talking about the ideal blog-post version, I mean the real setup you use day to day.

I need something that can handle all of this:

- end-to-end tests
- cross-browser testing, including actual Safari
- switching between browser tabs
- visual testing
- CI/CD integration
- test reports and historical results
- accessibility checks
- visual regression
- email/SMS/API/database checks inside flows

I keep seeing two very different worlds.

Some teams have a pretty clean process: tests run in CI, reports are easy to find, failures are understandable, and they can test realistic user flows across browsers.

Other teams have a pile of tests that are always “almost done”, only run properly on one person’s machine, mostly test one browser, can’t handle things like switching tabs/windows reliably, and nobody fully trusts the reports.

Curious what people are actually using when things are working well.