Test Case Results

A test case result is a record of the execution outcome of a test case. Test cases are often executed multiple times during the development cycle, and each test case result should be documented to assist in evaluating the state of the test case. The goal of test cases is to reach a passing state.

In Rally you can:

• Create a test case result
• Edit a test case result
• View all test case results for a single test case

Test case results consists of the following topics:

• Creating a test case result
• Editing a test case result
• Deleting a test case result
• Viewing the test case results summary page
• Viewing test case result details
• Test case result fields

Creating a test case result

You can create a test case result in Rally from many locations. This flexibility allows you to progress through work activities and create a test case result whenever you need it from logical positions within the Rally application.

Create a test case result from any of the following locations:

Test Cases summary page and Iteration Test Case Status page:

1. Click the add new test case result icon to the right of the test case you want to add a result to.
2. An editor window displays.

Test case results detail page:

1. Click the Actions button and select New Result....
2. An editor window displays.

Editing a test case result

You may edit a test case result with the edit icon from any of the following locations:

• Expanded results on Test Cases summary page
• Expanded results on Iteration Test Case Status page
• Test case results summary page from test case detail page

To perform an edit:

1. Click the edit icon of the test case result you want to edit. The editor displays.
2. Complete your edits.
3. Choose Save & Close, Save & New, or Save.

You may also edit a test case result with the button from a test case result detail page:

1. Click the Actions button and select Edit.... The editor displays.
2. Complete your edits.
3. Choose Save & Close, Save & New, or Save.

Concurrency conflicts may occur if multiple users edit the same defect. The first user to make their changes and click the Save & Close, Save & New, or Save buttons will have their changes committed. When subsequent users make their changes to the same defect then attempts to save, they are presented with an option to Review my changes or Overwrite with my version.

If you select Review my changes, you are returned to the defect editor so the changes can be copied and not lost. If you select Overwrite with my version, your changes are saved and the other users changes are overwritten. Overwrite with my version where attachments are added and edited will save both users' changes as well as apply deletions.

Deleting a test case result

You may delete a test case result with the trashcan icon from any of the following locations:

• Expanded results on Test Cases summary page
• Expanded results on Iteration Test Case Status page
• Test case results summary page from test case detail page

To perform a deletion:

1. Click the trashcan icon next to the test case result you want to delete.
2. A confirmation message appears warning you that there is NO undo for deletion of test case results. Click OK to confirm the delete action.
3. The test case result is removed from the subscription.

You may also delete a test case result with the button from a test case result detail page:

1. Click the Actions button and select Delete....
2. A confirmation message appears warning you that there is NO undo for deletion of test case results. Click OK to confirm the delete action.
3. The test case result is removed from the subscription.

Viewing the test case results summary page

You can view a list of all test case results captured against a given test case, using the test case results summary page. To view this summary page:

1. Access a test case detail page (by clicking the name of a test case) and select the Results link in the sidebar on the left side of the page. All results for the test case are displayed in a summary view.

Additional actions from the test case results summary page:

• Use the button to select menu options that assist you in managing your list of test case results.
• Use the show and hide icons to control the links display.
• Filter the test case result display by Verdict or Tester.
• Sort the display by any of the fields listed on the page.

Viewing test case result details

Rally provides multiple ways to view the details of a test case result. To see all fields in a test case result item, use one of the follwing methods:

Additional actions from the test case result detail page:

• The sidebar located on the left of the page displays any associated work items related to the current test case. Click any link to navigate to the related work item summary page.
• Click the URL icon to open a new test case result detail page with the complete URL to use as a reference link in emails to team members, or attachments to other work items, etc.
• Use the button to select menu options that assist you in managing your test case result.
• Use the show and hide icons to control the links display.

Test case result fields

The following fields are presented to help you describe or add detail to a test case result: