Rainforest QA changelog
Rainforest QA changelog
app.rainforestqa.com

Freeze-frame VMs

 

New

 

Improvement

  

It’s difficult to grab screenshots of elements when they’re moving, temporary, or require a hovering cursor (like a drop-down menu).

We’ve made it easier with the introduction of VM freeze-frames. Press the Esc key or click the new Freeze Screen button to create a frozen image of the VM in which you can capture screenshots. To unfreeze the image, simply press Esc again or click the Unfreeze Screen button.

This feature freezes the image on screen, but not the VM itself. The VM will keep running in the background, so when you unfreeze, you’ll see the latest state of the machine.

Freeze Screen.gif

Add comments to test steps

 

New

 

Improvement

  

Comments are plain-text snippets you can add to your test steps to provide context, clarification, or explanation. They don’t change the way tests work — they simply provide information to make tests easier to read and understand.

You can add comments to your test steps just like you’d add a test action:

comments.png

Other recent updates:

In the Tests page:

  • It’s easier to create and manage saved filters.
  • Searches entered in the Search test steps now search Visual Editor tests, not just Plain Text tests.
  • You can now use Shift + click to bulk-select items.

In the Run Groups page:

  • There are two new columns of information to help you see important information at a glance: Maximum Failure Retries and Environment.
  • It’s easier to edit settings for individual run groups.

Usability improvements

 

New

 

Improvement

  

Our product teams have spent a lot of the past month focused on improving the usability of the platform so you can manage your testing more easily and quickly.

2022-02-16_17-26-46 (1).gif

Usability improvements include:

  • Pre-fill the element name field if the captured screenshot contains text.
  • Redesigned the Tests page to make it easier to navigate and customize your list of tests.
  • Sped up the load times of the Tests and Results pages.
  • Added more bulk-edit options including setting tests to draft, removing tests from a feature, and more.
  • Added breadcrumbs so it’s easier to see where you are in your Run Groups and Features.
  • Updated failure categorization tags to include avatar of the test reviewer.
  • Consolidated toggles for Tests, Features, and Run Groups into a single view.
  • Updated tables in the Tests, Features, Run Groups, and TWS pages to show your total number of records.

Other recent improvements

Simplified the Tests page

 

Improvement

  

We've simplified the appearance and controls of the Tests screen to make it easier for you to navigate and customize your list of tests.

simple-test-list.gif

Other recent updates:

  • Added support for Android App Bundles (.aab files)

Automatically retry failed automated tests

 

New

 

Improvement

  

A flaky automated test is one that intermittently fails for no obvious reason: there haven't been any changes to the test or to the tested application.

These inconsistent failures — which often result from unpredictable testing conditions, like a web page loading more slowly than usual — can be disruptive to the QA process and lower trust in your tests.

That's why we’re excited to introduce automatic test retries, the best way to save your team the time and frustration of dealing with flaky tests.

With test retries configured, Rainforest will automatically retry failed tests up to X times (defined by you) or until a test passes, whichever happens first.

You can configure test retries in global settings or when creating a test run or run group.

2022-01-12_11-06-03.png

Other recent improvements:

  • Added a warning when a test variable currently being tested is about to be previewed in the Visual Editor, potentially causing an inadvertent test failure.
  • Updated test failure categorization tags to include the assigned reviewer.

Update action screenshots within test results

 

New

 

Improvement

  

For any failed test step, you can now update the action screenshot directly within test results, making the process of updating tests much faster.

2021-12-21_10-10-09 (1).gif

Other recent updates:

  • Moved the chat support icon to the left-side navigation bar to prevent interference with test creation.
  • New platform: Apple iPad Air iOS 15
  • Added notification to avoid preventable test failures when attempting to run multi-browser automated tests.

See click animations in preview and video test results

 

New

 

Improvement

  

We now show click animations in both preview and results reproduction videos so you can see precisely where and when clicks happen.

ShowClick.gif

Released v.1.0 of the Rainforest QA GitHub Action

 

New

 

Improvement

  

We've released the Rainforest QA GitHub Action, which allows developers to kick off Rainforest tests from GitHub workflows.

image.png

Other recent updates:

  • We've added timestamp information for emails sent within the platform.
  • Users can now download JSON browser logs for completed tests.
  • Performance improvement: Sped up population of data in the /tests pages, especially for accounts with many tests.
  • Performance improvement: Decreased latency for calling an API endpoint that was slowing down launch of test runs kicked off from the Rainforest UI.
  • New browser: Safari 15 on macOS 12 Monterey
  • New browser: Safari Tech Preview on macOS 12 Monterey
  • New browser: Microsoft Edge on Windows 11

Navigate to and edit embedded tests without refreshing the VM

 

New

 

Improvement

  

When creating or editing a test that contains an embedded test, you can now navigate to that embedded test and edit it without refreshing the virtual machine. Then simply return to your original test using navigation buttons.

NavigateToEmbeddedTest.gif

Other recent updates:

  • Delivery of test emails to the Rainforest inbox service is now faster and more reliable.

Extract test steps to create an embedded test

 

New

 

Improvement

  

You can now select a number of steps from any test and turn them into a new embedded test that you can re-use.

extract steps.gif

Other recent updates:

  • Rainforest no longer validates SSL certificates, making it easier to test environments that have self-signed, expired, or otherwise invalid certificates.