Rainforest QA changelog app.rainforestqa.com

New

Improvement

You can now see – in plain English – everything the automation service does to execute each test step. Often in combination with other logs, this can help you diagnose test failures.

Automation logs are visible by default for failed steps. You can also toggle logs with the "Automation Logs" checkbox just above test steps in test results.

Other recent improvements:

• No longer display cost in credits when selecting a browser for running automation.
• Added a new "Switch to Live Preview" button to the test editor when editing a test using screen grabs of past results.
• Also in the test editor, the "Save" button now appears as "Saved" until there are changes made to the test.
• Snippets no longer auto-collapse when a test is being previewed – this will make autoscroll more smooth.
• In the Visual Editor, you'll now see if your test is on the Main branch.

New

Improvement

Instead of waiting for a virtual machine to preview a lengthy test to get you to the step you want to update – which can take minutes – you can now make quick changes to a test using images from a past run. Navigate to Past Results in the test editor or select Edit Test when viewing a failed result.

You can learn more in the help center. 

New

Improvement

The left-side navigation menu has been updated with a cleaner, streamlined look and an improved hierarchy that makes it easier to get to important pages in the app.

Other recent improvements:

When deleting a test, system now presents a confirmation dialog to prevent accidental deletions.

New

Improvement

Test result summaries now include a detailed breakdown of test run times, including recommendations for improving run speeds.

New

Improvement

We've updated the Tests page so you can now see more tests and information on screen at once without scrolling.

New

Improvement

We've made a series of backend and frontend improvements to speed up the load times of the Tests page by almost 10x.

Now even a page listing 100 tests will load in less than two seconds.

New

As of today, we've released branching to all users. (Previously only available to new signups.)

Branching mirrors the way CI/CD systems work and makes working on your test suite with the rest of your team easier. You can now update your tests without interrupting ongoing releases and review all the changes before merging them back to the main branch.

You can use branching in the Rainforest interface, the GitHub Action, CircleCI Orb, and CLI.

Learn more in the branching help docs.

New

Improvement

We've updated the interface of the Visual Editor to help you work faster.

Now you can see more information on the page at a time and use fewer scrolls to get where you're going.

New

Improvement

Our new image-matching algorithm should significantly improve the stability of your tests and reduce maintenance costs.

By default, all new screenshots will use Intelligent mode, which is much closer to human judgment than our previous evaluation method.

All your existing screenshots will continue to use our previous method (now called "Legacy"), but you can modify them to use Intelligent mode.

To learn more, check out the help doc.

Other recent improvements:

• When a screen shot is updated from test results, we’ll automatically resolve any corresponding failures and mark them as Needs refactor.
• Smarter auto-scrolling when previewing a test or viewing a result.

New

Improvement

The Rainforest CLI has been updated to allow you to create, merge, and delete branches. You can now also upload Rainforest Markup Language (RFML) tests to a branch and start a run from a branch.

Finally, we've updated the Rainforest Github Action and CircleCI Orb to allow you to specify a branch for your run.