Overview
Test Sets in Thunders allow you to group multiple Test Cases together and run them as a set. This guide walks you through how to create, modify, delete, and execute a Test Set in your project.
Creating a Test Set
Option 1: From the Test Sets page
Navigate to your project
Click on the Test Sets tab
Click the "New Test Set" button → a new Test Set is created automatically
Rename it from the default name "Untitled test set"
Option 2: From the Test Cases Properties Panel
Open the Test Case that will be added to the Test Set
Click on the Test Sets button in the Test Cases Properties Panel
Type the name of the test set in the search bar
Click on Add to a new Test Set
Adding or Removing Test Cases from a Test Set
It is possible to add or remove a Test Case directly from the properties panel by choosing the test sets to add it to or remove it from and clicking "Apply"
You can also add or remove test cases directly from the Test Set detail page: click Add Test Cases in the header, check or uncheck the cases you want, and changes save immediately.
To add several Test Cases at once, select them in the Test Cases list, then select Add to Test Set in the bar that appears. Check the Test Sets to add the selection to, uncheck the ones to remove it from, then select Apply. A dash next to a Test Set means that it holds only some of the selected Test Cases. To create a Test Set for the selection, type its name and select Add to a new test set.
The Test Set Detail Page
Clicking any row in the Test Sets list (not the action buttons) opens the Test Set detail page, a dedicated view for managing everything about a Test Set.
Test Cases tab: shows all test cases linked to this set. Click any row to open it in the editor. Use the Add Test Cases button in the header to add or remove cases from the set.
Set Runs tab: shows all runs scoped to this test set. Click a run to open its report.
Schedules tab: shows the recurring rules attached to this test set, with the frequency, the environment each runs as, the next and last run, and the status. A red dot beside the tab name means a schedule has been paused automatically.
Properties Panel: toggle it with the panel icon in the header. Displays total cases, total runs, last run status, and run health based on the last 5 runs. Quick actions include Copy ID, Copy link, Duplicate, and Delete.
Editing a Test Set
To rename a Test Set, open its detail page by clicking the row. Click the title in the header. It becomes editable inline. Type the new name and press Enter or click away to save.
To add or remove test cases from the set, open its detail page and use the Add Test Cases button in the header.
Deleting a Test Set
To delete a Test Set:
Find the Test Set you wish to remove
Click the trash can icon to delete
Confirm the deletion in the popup
Executing a Test Set
You can execute Test Sets individually or in bulk. You can also execute from the Test Set detail page using the Execute test set button in the header (disabled when the set has no test cases).
Option 1: Run a Single Test Set
Click the Run icon next to the Test Set you want to execute
Choose your execution settings (e.g., environment, run type)
Click Execute to start the run
Option 2: Run Multiple Test Sets
Use the checkboxes to multi-select the Test Sets you want to run
Click the "Execute" button that appears above the list
Configure shared execution settings
Click Execute
After starting, you can monitor all execution progress and results in the Test Runs tab.
Re-execute the failed tests
A Test Set run works as a test campaign. When some Test Cases of a run fail, select Re-execute failed tests in the row of the run, in the Test Runs tab of the project or in the Set Runs tab of the Test Set. Only the Test Cases that did not pass run again, and their results join the same run. The status and the pass rate of the run update when they finish.
See Test Set Detail Page.
Alphabetical execution (parallelism = 1)
When parallelism is set to 1, Test Sets and test cases execute in alphabetical order by name, giving you predictable, repeatable run sequences.
If you rely on a specific execution order (for example, a setup test that must run first), name your test cases accordingly and they will always run in that order.
Run a Test Set on a Schedule
A Test Set can run itself on a recurring rule, so nobody has to open the project and select Execute. Open the Test Set and select the Schedules tab, then New Schedule.
A Schedule points at the Test Set rather than at a fixed list of Test Cases, so each run covers whatever the set contains at the moment it fires. One Test Set can carry several Schedules, each with its own Environment, Persona and execution settings.
Tips for Managing Test Sets
Use consistent naming (e.g.
Login Flow,Regression Suite)Periodically review included Test Cases for relevance
Group the Test Cases you want to run with the same settings.
For further help, reach out to [email protected].