Skip to content

Latest commit

 

History

History
270 lines (160 loc) · 13.9 KB

overview.md

File metadata and controls

270 lines (160 loc) · 13.9 KB
title titleSuffix description ms.custom ms.assetid ms.prod ms.technology ms.manager ms.author author ms.topic monikerRange ms.date
Understand dashboards, charts, reports & widgets
Azure DevOps
Review of OOB charts, widgets, dashboards, & reports available to monitor status and trends in Azure DevOps & Team Foundation Server (TFS)
dashboards
7BAD53A1-080E-40E8-8866-24EC00395D39
devops
devops-analytics
jillfra
kaelli
KathrynEE
overview
>= tfs-2013
04/05/2019

About dashboards, charts, reports, and widgets

[!INCLUDE temp]

Customizable, highly-configurable dashboards provide you and your teams with the flexibility to share information, monitor progress and trends, and improve your workflow processes.

Key concepts

::: moniker range="azure-devops"

  • Dashboards are customizable interactive signboards that provide real-time information. Dashboards are associated with a team and display configurable charts and widgets to show information.
  • Charts are query-based status or trend charts derived from a work item query or test results.
  • Widgets display configurable information and charts on dashboards. The widget catalog provides brief descriptions of those widgets available to you. In addition, you can add widgets provided through the Azure DevOps Marketplace.
  • In context charts and reports are system-generated charts that support specific services. Examples are team velocity, sprint burndown, and the Cumulative Flow Diagram (CFD), and the Test Failures Report.
  • Power BI reports allow users to create rich, customized Power BI reports or other reports using OData queries of the Analytics service and the returned JSON data.

::: moniker-end

::: moniker range="azure-devops-2019"

  • Dashboards are customizable interactive signboards that provide real-time information. Dashboards are associated with a team and display configurable charts and widgets to show information.
  • Charts are query-based status or trend charts derived from a work item query or test results.
  • In context charts and reports are system-generated charts that support specific services. Examples are team velocity, sprint burndown, and the Cumulative Flow Diagram (CFD), and the Test Failures Report.
  • Widgets display configurable information and charts on dashboards. The widget catalog provides brief descriptions of those widgets available to you. In addition, you can add widgets provided through the Azure DevOps Marketplace.
  • Reports
    • Power BI reports: For project collections that support the Inherited process, allow users to create rich, customized Power BI reports or other reports using OData queries of the Analytics service and the returned JSON data.
    • SQL Server reports: For project collections that support the On-premises XML process model, allow users access to out-of-the-box SQL Server reports as well as support to create customized SQL Reports or Excel reports. This requires that the project is configured to support SQL Server reporting.

::: moniker-end

::: moniker range=">=tfs-2015 <= tfs-2018"

  • Dashboards are customizable interactive signboards that provide real-time information. Dashboards are associated with a team and display configurable charts and widgets to show information.
  • Charts are query-based status or trend charts derived from a work item query or test results.
  • Widgets display configurable information and charts on dashboards. The widget catalog provides brief descriptions of those widgets available to you. In addition, you can add widgets provided through the Azure DevOps Marketplace.
  • In context charts** are system-generated charts that support specific services. Examples are team velocity, sprint burndown, and the Cumulative Flow Diagram (CFD).
  • Reports correspond to out-of-the-box SQL Server reports as well as support to create customized SQL Reports or Excel reports. This requires that the project is configured to support SQL Server reporting.

::: moniker-end

::: moniker range="tfs-2013"

  • Dashboards are customizable interactive signboards that provide real-time information. Dashboards are associated with a team and display configurable charts that you pin to the dashboard.
  • Charts are query-based status or trend charts derived from a work item query or test results.
  • In context charts are system-generated charts that support specific services. Examples are team velocity, sprint burndown, and the Cumulative Flow Diagram (CFD).
  • Reports correspond to out-of-the-box SQL Server reports as well as support to create customized SQL Reports or Excel reports. This requires that the project is configured to support SQL Server reporting.

::: moniker-end

::: moniker range=">= tfs-2015"

Configurable dashboards

With dashboards, you can configure an array of charts and widgets.

Each team can add and configure multiple dashboards to share information, view status, progress, and trends, and access quick links and other functions. Easily add and rearrange widgets on the dashboard to show recent changes made to view build status, bug trends, and more.

Example dashboard

Sequence for adding and customizing a dashboard

Click a box below to open the corresponding article.

Add dashboardAdd widget

::: moniker-end

Charts: Work tracking status and trends

With flat-list queries, you can create various charts to monitor status, progress, and trends. To get started, you can open a shared query and create a chart based on your tracking interests. Chart types include status—pie, bar, column, stacked bar, and pivot—and trend—stacked area, line, and area—charts.

Sample Agile tool light-weight charts

::: moniker range=">= azure-devops-2019"

[!div class="mx-imgBorder"]
Active bug charts added to dashboards

::: moniker-end

::: moniker range="<= tfs-2018"

Active bugs

::: moniker-end

Sequence for adding query-based charts to a dashboard

Click a box below to open the corresponding article.

Edit queryCreate chartAdd chart to dashboard

Prior to monitoring work progress and trends, you'll need to have planned your project and made progress on work you're tracking.

Charts: Manual testing progress, results, and trends

The steps to creating charts that track manual testing progress and results are similar to those for tracking work. The starting point, however, begins with the test plan rather than a query. For example, you can find out how many test cases are ready to run, or how many tests are passing and failing in each test suite.

Sample light-weight test charts

Active bugs

And, just like work item query-based charts, you can add these charts to a dashboard.

Sequence for adding test progress and result charts to a dashboard

Edit queryCreate chartAdd chart to dashboard

::: moniker range=">= tfs-2015"

Widgets

You add widgets to a dashboard to display a chart, information, or set of links. Most widgets are configurable. For a description of each supported widget for your platform and version, see the Widget catalog.

Sprint chart widgets

Sprint capacity widget Sprint burndown widget

Sample Cumulative Flow Diagram widget

Cumulative flow diagram widget

::: moniker-end

::: moniker range=">= tfs-2015"

Monitor code activity, build progress and deployment status

With the code tile widgets, you can monitor the activity occurring within a repo or branch folder. Build history displays a histogram of all builds run for a specific build pipeline. Bar color indicates: green-completed, red-failed, and yellow-completed without tests.

Code, build, and release chart widgets

Code tile widget   Pull request widget
Build history widget    Deployment status widget

::: moniker-end

::: moniker range="azure-devops"

Analytics widgets

Analytics widgets provide rich data based on the Analytics service. The Analytics Service is available to all organizations using Azure DevOps Services.

Sample Lead time widget

Lead time widget

To learn more, see the following articles:

::: moniker range="azure-devops-2019"

The Analytics Service and Analytics widgets

The Analytics Service is in preview for Azure DevOps Server 2019.

Sample Lead time widget

Lead time widget

To learn more, see the following articles:

::: moniker-end

::: moniker range=">= tfs-2015"

Marketplace widgets

In addition to the widgets available to your from the widget catalog, you may find additional widgets of interest from the Marketplace.

Or, you can create your own widget using the REST API.

::: moniker-end

In-context charts: Work tracking

There are a number of system-generated charts that you can access from the web portal, but can't add to a dashboard. However, you may find a comparable widget listed in the widget catalog that tracks the same or similar data which you can add to the dashboard. These include:

Sprint charts

Each sprint provides access to two charts. The first tracks capacity for the team, team activities—such as Development, Test, Design—and individual team members. The second tracks the sprint burndown in terms of remaining work.

Capacity bars Burndown
Capacity bars Burndown chart

::: moniker range=">= azure-devops-2019"

In-context charts and reports: Pipeline Failures and Test Failures

Two in-context reports provided are the Pipeline Failures and Test Failures reports. These reports derive from the Analytics Service. Open a build or release summary to view the top failing tests report. This report provides a granular view of the top failing tests in the pipeline, along with the failure details. For details, see Analyze test results.

Test analytics detail view

Summary charts are also provided for builds that indicate code coverage and test failures or success.

::: moniker-end

::: moniker range=">= tfs-2015"

Try this next

[!div class="nextstepaction"] Add a widget to a dashboard or Review available widgets

::: moniker-end

Add custom work tracking fields

::: moniker range="azure-devops"

You can add data to support reporting requirements by adding a custom field.
::: moniker-end

::: moniker range="azure-devops-2019"

You can add data to support reporting requirements by adding a custom field Inheritance process or On-premises XML process. ::: moniker-end

::: moniker range="<= tfs-2018"

You can add data to support reporting requirements by adding a custom field.
::: moniker-end

::: moniker range=">= tfs-2015"

Extensibility

Using the REST API service, you can create a custom widget.

::: moniker-end