Skip to content

Latest commit

 

History

History
59 lines (37 loc) · 3.62 KB

manage-test-failure-type.md

File metadata and controls

59 lines (37 loc) · 3.62 KB
title description ms.assetid ms.service ms.custom ms.topic ms.author author monikerRange ms.date
Manage test failure type
Learn about managing failure type in Azure Test Plans. You can add, remove or edit the default test failure types.
azure-devops-test-plans
UpdateFrequency3
conceptual
jeom
raviLiftr
azure-devops
08/25/2023

Manage test failure type

[!INCLUDE version-eq-azure-devops]

Azure Test Plans provides the functionality to customize the failure types of any test case beyond the default values. A failure type is an artifact that helps to mark test case failures into defined categories such as regression issue or known issue. While this categorization of failure types is helpful, users might want to add their own custom failure type beyond the default values, which creates a more customized experience for specific user needs in the Azure DevOps project. This article walks through the steps of defining a custom failure type using the new REST API provided.

Prerequisites

[!INCLUDE prerequisites]

How to view the default failure types

Failure type categorization is part of the post-test run experience in Azure Test Plans. This feature is only applicable to test cases marked as Failed. To mark a test failure using the default failure type, follow the below steps:

  1. Navigate to Azure Test Plans from your Azure DevOps project. Open a Test suite containing test cases or create a new test case inside a suite.

    :::image type="content" source="media/manage-test-failure-type/azure-test-plan-navigation.png" alt-text="Screenshot of navigating to the Azure Test plans from the navigation menu.":::

  2. Navigate to Execute tab of the given test suite.

    :::image type="content" source="media/manage-test-failure-type/execute-tab-with-active-test-cases.png" alt-text="Screenshot of execute tab view with active test cases.":::

  3. Mark a test case as Failed, which creates a new test run for against the test case.

    :::image type="content" source="media/manage-test-failure-type/execute-tab-in-test-suite.png" alt-text="Screenshot of execute tab view inside a test suite.":::

  4. Select Runs from the Test Plans menu. Select the respective test run from the list shown.

    :::image type="content" source="media/manage-test-failure-type/list-of-all-test-runs.png" alt-text="Screenshot of list of all test runs.":::

  5. Run Summary tab is shown by default. Select on Test results tab.

    :::image type="content" source="media/manage-test-failure-type/run-summary-tab-test-run.png" alt-text="Screenshot of run summary tab test run.":::

  6. Select on Update Analysis and a dialog box appears. Users can choose the failure type for the test case from the dropdown menu. Refer to the screenshot for the failure type values shown by default.

    :::image type="content" source="media/manage-test-failure-type/view-default-failure-types.png" alt-text="Screenshot of view default failure types.":::

Add custom values for Failure Type

A new set of REST APIs is provided for seamless management of failure types in Azure Test Plans. Users can add new failure types, delete existing ones and view the list of failure types for a given project. Follow the instructions provided in the following links to explore the various APIs.