Status Charts

Print this topicEmail this topicSave as PDF

Status reports and charts consist of the following:

Defect Arrival and Kill Rate chart

The Defect Arrival/Kill Rate chart presents the high level status of active defects per project along with daily open/kill rates to enable you to see trends in the quality assurance process. This chart reflects only those defects contained in the displayed project.

defect arrival kill

The following details are presented in this chart:

  • All Active Defects. Active defects are those defects with any state other than closed.
  • The Defect Arrival Rate, represented by all defects that are opened per day.
  • The Defect Kill Rate, represented by all defects that have been closed per day.
  • The Dates axis displays all workdays contained within the past thirty days.

Hover your mouse over any chart bar or line position to display the exact number of defects in each state per workday. The workdays that are displayed in the dates axis are determined by your subscription administrator when setting up your workspace.

Any custom state values that have been configured for your Workspace will display in the Defect Arrival/Kill Rate chart.

To access the Defect Arrival/Kill Rate chart, use either of the following:

  • From My Home tab, select the icon icon.
  • Click or hover over the main Quality Tab tab, followed by the Defects tab. Note the colored mini Defect Arrival and Kill Rate chart.

    The header displays the Start date, the number of days remaining in the Iteration (if the selected Iteration is the current Iteration) or State (if the selected Iteration is a past or future Iteration), and End date of the Iteration. Click anywhere on the mini Defect Arrival and Kill Rate chart to display the full sized chart. From the full sized chart you can:
    • Click the Priority or State link in the upper-right corner to display the respective charts.
    • Select the print icon to print your chart.

Defects by Priority chart

The Defects by Priority chart displays active (not Closed) defects categorized by priority over time. Use this chart to identify defect priority trends such as a spike in the number of P1 defects or a general decrease in the number of overall defects. The data is displayed as a stacked column where each priority value is represented by a different color. The x-axis indicates the time period for the data above. By default, it displays all workdays contained within the past thirty days. However, you can change the date range and granularity (weeks, months, quarters) by placing the report on the dashboard.

defect priority

You can access the chart from multiple locations:

  1. Reports tab (last 30 days only). When accessed from the reports tab, functionality to email, print, and download in .jpg or .pdf formats is available under the Page Tools drop-down.
  2. Defects page (last 30 days only). To access the chart from the defects page, select the Quality tab and the Defects page. Then click on the mini-chart at the top of the page. The arrival and kill chart display. In the upper-right corner is a link Priority to show the Defects by Priority chart.
  3. Dashboard (fully configurable). To place the chart on the dashboard, you would:
    1. Go to a dashboard page.
    2. Under Page Tools, select Add Panel…
    3. Select the Defects by Priority panel.

      A settings panel to configure the chart displays.

      • The Date Range parameter allows you to control how far back you want the report to go. It also allows you to specify the granularity of the intervals for the x-axis of the chart (days, weeks, months, quarters).
      • The States parameter allows you to specify which state series to include in the chart.

    You can specify to only include defects of a certain priority or severity using the Priorities and Severities parameters.

    Note: If you do not click on any values in these sections it will include ALL defects, including ones where the priority or severity is set to no entry. However, clicking on all of the checkboxes shown, will exclude those with no entry.

    To conserve space, there are no legends on the dashboard versions. Hover over a section of a bar to discern what color goes with what priority. Hover over any bar section to display the exact number of defects in each priority for that time period.

    You can drag the chart to your desktop or other location to save the PNG of the chart.

    Like most of the charts, your project scope will effect which defects are included.

    Technical details:

    • Data for this report is only available back to January 2010.
    • The x-axis label represents the moment-in-time values for the last day of the interval. If your report is in months, then the points above the label 6/2011 are the moment-in-time values as of midnight 6/30/2011.
    • When priority or severity filters are applied, the moment-in-time values (as opposed to the current values) are used to determine what data is included. For example, if you chose to only include high priority defects and a defect started out as a high priority but later changed to a lower priority, it would be included in the earlier columns on the chart but excluded from the later ones. This is a change as of 2011-07-16, which used to consider the current values when deciding what to include. Also note that the version of the chart accessible from the defects page (access option 2 above) uses this older convention. It is our intention to eventually upgrade the defects page to link to the new version. In the meantime, there may be slight differences between it and the version accessible from the reports tab and dashboard panels.

Defects by State chart

The Defects by State chart displays active (not Closed) defects categorized by state over time. Use this chart to identify defect state trends such as a spike in the number of un-triaged defects or a general decrease in the number of open defects. The data is displayed as a stacked column where each state value is represented by a different color. The x-axis indicates the time period for the data above. By default, it displays all workdays contained within the past thirty days. However, you can change the date range and granularity (weeks, months, quarters) by placing the report on the dashboard.

defect state

You can access the Defect State chart from multiple locations:

  1. Reports tab (last 30 days only). When accessed from the reports tab, functionality to email, print, and download in .jpg or .pdf formats is available under the Page Tools drop-down.
  2. Defects page (last 30 days only). To access the chart from the defects page, select the Quality tab and the Defects page. Then click on the mini-chart at the top of the page. The arrival and kill chart displays. In the upper-right corner is a link State to show the Defects by State chart.
  3. Dashboard (fully configurable). To place the chart on the dashboard:
    1. Go to a dashboard page.
    2. Under Page Tools, select Add Panel…
    3. Select the Defects by State panel.

      You will see a settings panel to configure the chart.

      • The Date Range parameter allows you to control how far back you want the report to look. It also allows you to specify the granularity of the intervals for the x-axis of the chart (Days, Weeks, Months, Quarters).
      • The States parameter allows you to specify which state series to include in the chart.

    You can specify to only include defects of a certain Priority or Severity using the Priorities and Severities parameters.

    Note: If you do not click on any values in these sections it will include ALL defects, including ones where the priority or severity is set to no entry. However, clicking on all of the checkboxes shown, will exclude those with no entry.

    To conserve space, there are no legends on the dashboard versions. Hover over a section of a bar to discern what color goes with what state. Hover over any bar section to display the exact number of defects in each state for that time period.

    You can drag the chart to your desktop or other location to save the PNG of the chart.

    Like most of the charts, your project scope will effect which defects are considered.

    Technical details:

    • Data for this report is only available back to January 2010.
    • The x-axis label represents the moment-in-time values for the last day of the interval. If your report is in months, then the points above the label 6/2011 are the moment-in-time values as of midnight 6/30/2011.
    • When priority or severity filters are applied, the moment-in-time values (as opposed to the current values) are used to determine what data is included. For example, if you chose to only include high priority defects and a defect started out as a high priority but later changed to a lower priority, it would be included in the earlier columns on the chart but excluded from the later ones. This is a change as of 2011-07-16, which used to consider the current values when deciding what to include. Also note that the version of the chart accessible from the defects page (access option 2 above) uses this older convention. It is our intention to eventually upgrade the defects page to link to the new version. In the meantime, there may be slight differences between it and the version accessible from the reports tab and dashboard panels.

Defect Trend chart

The Defect Trend chart displays the cumulative defects activated (opened) versus cumulative terminated (closed) over time.

The chart visually shows the rate at which defects are being activated (red series), the rate at which defects are being terminated (green series) and the trend for the total number of active defects (black series). The net change in total active defects for the displayed time frame is shown at the top of the default chart.

defect trend

You can access the chart from multiple locations:

  • Reports tab (last 30 days only). When accessed from the reports tab, functionality to email, print, and download in .jpg or .pdf formats is available under the Page Tools drop-down.
  • Dashboard (fully configurable). To place the chart on your dashboard:
    1. Click the My Home tab, then select the Dashboard page.
    2. From the Page Tools drop-down on the upper-right, select Add Panel.
    3. Select the Defect Trend panel, then click Add.
    4. On the Settings, specify the title, project, and date range. Specify state, priority, and severity parameters as necessary.
      • The Terminal States parameter allows you to specify which States to include in the Cumulative Terminated series. All unselected states are included in the Cumulative Activated series as well as the Total Active series.
      • You can specify to display only defects of a certain Priority or Severity. Note: If you do not select any values in these sections, the chart includes ALL defects, including defects where the priority or severity is not specified. However, selecting all the checkboxes will exclude those with no value or priority or severity.
    5. Click Save.
    settings

    You can drag the chart to your desktop or other location to save the report.
    Hover over any point on the chart to see the numeric value.

Technical details:

  • Data for this report is only available back to January, 2010.
  • The x-axis label represents the moment-in-time values for the last day of the interval. So if your report is in Months, then the points above the label 6/2011 are the moment-in-time values as of midnight 6/30/2011.
  • The first point on the chart for the two Cumulative series is calculated as a delta from the prior interval. So, if your report is in Months and the first tick on the x-axis is labeled 7/2010, then the first point of the Cumulative Activated series represents the number of defects activated between June 30, 2010 and July 31, 2010. Likewise, the first point of the Cumulative Terminated series represents the number of defects that were terminated between June 30, 2010 and July 31, 2010.
  • The Cumulative Terminated and Total Active series are calculated directly from the data. However, the Cumulative Activated series is calculated by adding the Total Active to the Cumulative Terminated. This is done to make sure that the information is consistent across the series. If it were calculated directly and a Severity or Priority filter were applied, then any changes to the Severity or Priority that occurred between the activation and termination events, would result in an inconsistency. It might be counted in the Activated series but not in the Terminated series. Let's say you only want the report to run for High Priority defects. This approach assures that it is removed from the Cumulative Activated series the moment that the Priority field is changed from High to Low.

Build Health chart

The Build Health chart characterizes your software builds over the last 30 days. Access this chart from the Reports tab.

The chart helps you detect trends and consider questions like:

  • How often does the build fail?
  • When does build quality decline? Is it at end of a release cycle?
  • Is the length of the build getting painfully long?
  • Should we move some tests to run each night?
build health

For each day, you can see the number of builds with a successful, failed, incomplete or unknown status, and the average build duration in seconds. Hover over any colored portion of the iteration bar to see the total number of builds for the corresponding status.

Builds are identified by looking both up and down your project hierarchy, regardless of your project scope setting. This supports the organization of a project or product line with sub-teams that share the same build definitions and SCM repositories. Watch Understanding the Project Hierarchy to learn how to organize projects and teams in Rally.

Note: A status of unknown may indicate a problem with an external program called during the build process. Check to see if the program hangs (reporting back nothing), or if it reports back something that your build script is not designed to handle.

Top Files by Changes chart

The Top Files by Changes chart helps you identify the files in your repository that experience the most churn over the last 30 days. Access this chart from the Reports tab.

The chart helps you consider questions like:

  • Which files are candidates for decomposition?
  • Should there be additional testing around specific files?
  • Where should we start when making changes in our code base?
top files

The chart shows top ten files with changes (from highest to lowest number of changes) and a cumulative percentage line. There is no time component; all files in the repository with changes are represented.

Files in the entire SCM repository are included for your workspace, regardless of your project scope setting. This supports the organization of a project or product line with sub-teams that share the same build definitions and SCM repositories. Watch Understanding the Project Hierarchy to learn how to organize projects and teams in Rally.

Note: The second to last point on right side of the cumulative percentage line is often the most interesting. If it is a high percentage of churn, it could be valuable to refactor or decompose those files. If it is a low percentage, improving those files may not be the most effective way to impact maintainability.

Top Files by Defects chart

The Top Files by Defects chart helps you determine which files in your repository have the most associated defects. Access this chart from the Reports tab.

The chart helps you consider questions like:

  • Which files are the most problematic?
  • Are any files candidates for refactoring?
  • Should there be automated tests around specific files?
top defects

The chart shows top ten files with defects (from the highest to lowest number of defects) and a cumulative percentage line. There is no time component; all files in the repository with defects are represented.

This chart shows only files associated with defects within your project scope.

Note: The second to last point on right side of the cumulative percentage line is often the most interesting. If it is a high percentage of defects, it could be valuable to refactor or decompose those files. If it is a low percentage, improving those files may not be the most effective way to impact overall quality.

Program Overview chart

When you need to see information about all the Projects for a Release that have been combined into a single program, the Program Overview chart is the place to start. This chart helps you track release readiness across multiple projects and their work items. The colored pie charts give you an quick assessment gauge and help keep your development on track.

You can view the Program Overview chart as a panel from My Home/ Dashboard tab.

program overview

From the Program Overview chart, you can view the following:

  • A drop-down list of all programs in the active workspace. Choose any program and see the related projects.
  • A list of all projects contained in the current program. Every project name is a hyperlink and lets you navigate to the detail of the individual project.
    • Hover your mouse over the project name to see project details in a tool tip from the context of the chart.
  • The release name is also a hyperlink and lets you navigate to the Release Detail page.
    • Hover your mouse over the release name to see release details in a tool tip while still in the chart.
  • There are also a group of mini pie charts that show a roll up of the status for each work item type in the project. For example:
  • A mini Release Burndown chart for each project. Click the chart to see the related full size Release Burndown chart. You can also hover your mouse over any point of the burndown line and receive the exact amount of work remaining for that day.

    Notes:

  • You need to have one or more Programs defined to use the Program Overview chart.
  • A Work Product must be assigned Planning Units before it is represented in the pie chart.

Workspace Status chart

The Workspace Status chart centralizes vital statistics to help you quickly assess the progress and state of all projects for the current iteration contained within the workspace. This chart is particularly helpful for those organizations that operate multiple scrums/projects concurrently in a single iteration.

You can view the Workspace Status chart as a Rally Widget from My Home/ My Widgets tab.

If a project is contained within the workspace, but not assigned a current iteration, it will appear in the chart with the message "No Current Iteration."

A story or work item must be assigned planning units before it is represented in the pie chart.

The Workspace Status chart displays the following:

  • A list of all projects contained within the current iteration.
    • Each project name is in hyperlink form providing navigation to the project detail. Hover your mouse over the project name to see Project Details in a tool tip while in context of the chart.
  • The current iteration name is hyperlinked, allowing navigation to the Iteration Detail page.
    • Hover your mouse over the iteration name to see Iteration Details in a tool tip while in context of the chart.
  • A mini-pie chart showing a roll-up of all user story status planning points/units per state for the project in the current iteration.
    • Hover your mouse over any part of the mini-pie chart to see the number of points/units that are Defined, In-Progress, Completed, Accepted, and so on.
    • Click the pie chart to navigate to the Iteration Task Status view for detailed task information for the iteration.
  • A second mini-pie chart in the column of Defect Status showing a roll-up of all defects and the number in each state related to stories/scheduled work items within the iteration.
    • Hover your mouse over any part of the mini-pie chart to see the number of defects per state. Click the pie chart to navigate to the Iteration Defect Status view for detailed defect information for the iteration.
  • A third mini-pie chart entitled Test Case Status showing a roll-up of all Test Case Verdicts per result (pass/fail, and so on) related to stories/scheduled work items within the current iteration.
    • Hover your mouse over any part of the mini-pie chart to see the number of Test Case Verdicts per result. Click the pie chart to navigate to the Iteration Test Case Status view for detailed test case information for the iteration.
  • A mini-Iteration Burndown chart for each project. Click the chart to see the related full-size Iteration Burndown chart.

Printing Summary and Detail reports

Two types of reports, the Summary and the Detail, are offered to assist you in tracking and reviewing your work items.

Print a listing of all instances of each work item defined by printing the Work Item Summary Report. Use this report to get the "big picture" of your individual work items. The Work Item Summary report can only be printed from the Work Item Summary view.

To print a Summary report from the Work Item Summary view, select the Actions button located in the upper-right of the work item window and click Print.. The Print Report Setup wizard displays.

This report is useful if you need to have the Work Product reviewed by stakeholders or customers, or simply take the work item offline for your own review.

You can print the Work Item Detail report from several locations to give easy printing capability no matter where you are in Rally.

To print a Work Item Detail report from the Work Item Summary view:

  1. Locate the work item to print.
  2. Select the Print icon to the right of the work item.

To print a Work Item Detail report from the Work Item Detail view:

  1. Locate the work item to print.
  2. Click the work item to invoke the Work Product Detail screen.
  3. Select the Actions button located in the upper-right of the work item window and click Print...

Print report setup

After any action that invokes a report to print, the Print Report Setup wizard displays. This wizard is slightly different depending whether you have selected to print a Summary report or an individual Detail report.

Note: Reports listed on the Reports tab do not use this Print Setup dialog.

  1. Complete the following sections:
    • Report Type: Select whether to print a Summary or Detail report.
      • Show Nested Items: Select whether to display associated work items in the report, such as child user stories, test cases, and defects.
    • Title Page: Select whether to display the title page, the title of the report, and who the report is printed by.
    • Header and Footer: Select whether to display the print date or other custom text in the header and footer of the report.
    • Paging (for Report View): Select whether to print each artifact on a separate page (Details report only).
  2. Click Print.
  3. To send the report to the printer, select the Print icon in the upper right-hand corner.
© 2012 Rally Software Development Corp | Legal