A Test Run is Not runnable when the selected Environment has no value for something the test needs: a Variable, a credential, or the URL of an App. Thunders checks these values before the run starts. When one is missing, the run does not start, and Thunders shows you which values to add. You fix your configuration, not your product.
What Thunders checks before a run
Before a run starts, Thunders reads the steps of the Test Case and looks for these values in the selected Environment:
App URLs: every App that a step uses must have a URL in the Environment. A step that names an App that does not exist in the Project is also flagged, as an Unknown app. A step that uses the URL of an App that has no URL, such as an App that runs from a build, is flagged as an App without URL.
Variables and credentials: a Variable is flagged when the Project defines it, at the Project level or in another Environment, but it is missing or empty in the selected Environment. A Variable that is writable, or that an earlier step of the test sets, is not flagged.
Test Asset files are not checked.
A Variable that the Project does not define anywhere is not flagged before the run. The run starts, and the step that uses the Variable fails. That step shows no bug report. Hover the Variable in the step to add its value.
Missing values in the step editor
In the step editor, a value that the selected Environment lacks shows in red. Hover it to see a card with its type and the reason, for example Missing in Production, and the action that fixes it:
Add value for a Variable or a credential. For a credential, Create variable opens with Store as secure credential already on.
Add URL for an App URL. The URL is saved to the selected Environment. Only an admin sees Add URL. For a SAP App, an admin sees Open app settings instead, because the URL is set in the App settings.
Edit step for an Unknown app or an App without URL. Change the step so that it uses an App of the Project that has a URL.
After you add the value, the card shows Value added. When you select another Environment, the marks update for that Environment.
Add the missing values before a run
When you start a run and values are missing, the Add missing values dialog opens. It opens when you run a Test Case from the editor, and when you run several Test Cases: a Test Set, a selection in the Test Cases list, a re-execution, or Run now on a Schedule.
Enter a value in each field. The fields follow the order of the steps, and they are grouped by Environment.
For a step that needs a change, click Edit step N, or Open test when you are not in the editor.
Click Save and execute. Thunders saves the values and starts the run.
When you run several Test Cases, you can also click Execute N tests. Thunders then runs only the Test Cases that have all their values, and leaves out the others.
Only an admin can add the URL of an App. For a SAP App, add the URL in the App settings: an admin sees Open app settings in the dialog.
Runs that start without you
A Schedule, a CI pipeline or an API call does not show the dialog. When a value is missing, the run ends as Not runnable before its first step. It uses no browser and no credits, and it is not retried.
The owner of the Test Case gets a notification in the Inbox, for example "Login test couldn't run: 2 values missing". A run inside a Test Set is reported in the notification of the Test Set instead.
Read a Not runnable run
In the Test Runs list and in the Test Run Report, the run carries the red Not runnable status. In the report, the steps that use a missing value carry a mark. Hover the value to see what was missing. The card adds "At the time of this run.", because you may have added the value since.
A Not runnable run counts as a failure in the status of a Test Set, in Analytics, and in CI reports.
During a paused run, a step that you edit can also use a missing value. The run then shows "Add the missing values to resume" until you add it.
FAQ
How do I run the tests that have all their values, without fixing the others first?
In the Add missing values dialog, click Execute N tests. Thunders runs the Test Cases that are ready and leaves out the ones that still lack a value.
How do I add an App URL when I am not an admin?
Ask an admin of your organization. The dialog tells you which App and which Environment need the URL. You can still add the values of Variables and credentials yourself.
How do I fix a step that uses an Unknown app?
The step names an App that the Project does not have. Click Edit step on the hover card, or Edit step N in the dialog, and select an App of the Project.
Does a Not runnable run use credits?
No. The run ends before its first step, so no browser starts and no credits are used.
Related articles on this topic that you might find helpful