Azure Data SDK Content Validation Automation

Prerequisites

• .NET SDK 8.0
• Visual Studio

Quickstart

There are 6 projects in this solution.

• ContentValidation: Libraries container all verify rules.

• ContentValidation.Test: Contains all test cases for content validation automation.

• DataSource: Provide test data for test cases (all pages need to be verified on Microsoft Learn website).

• IssuerHelper: Summarize the issue status of the current pipeline run and record it in the latest-pipeline-result branch.

• ReportHelper: Compare the total issue data of current pipeline with the summary data of the last pipeline, save it as excel or json file, and provide text in markdown format (used when creating/update github issues).

• ValidationRule.Test: Contains all test cases for validation rules. (This test is a static data test, which is designed to ensure that there are no logical bugs when the rules are modified.)

This quickstart will show you how to use this tool to fetch all test data and run test cases locally.

1. Clone this repo and open it with Visual Studio.
2. Update the DataSource/appsettings.json file and replace its content with the service and package you need to test. Currently, only one package can be run at a time, and there are strict requirements for the input of ServiceName and PackageName. Please update according to the official SDK name. For example:

{
  "ServiceName": "App Configuration",
  "PackageName": "azure-appconfiguration"
}

3. Run DataSource with Visual Studio. After that, you will see an appsettings.json file generated under ContentValidation.Test folder
4. Switch to ContentValidation.Test project and execute test cases.

The above steps can help you quickly run content validation tests for a single package locally.

However, the goal of this tool is to automatically (regularly) run tests after deployment, automatically create issues on GitHub for failed tests, and finally generate a test report in markdown form. For the content of this part, please refer to the xxx.md file.

Index

Project or Library	Path	Description
ContentValidation	md	Libraries container all verify rules.
ContentValidation.Test	md	Contains all test cases for content validation automation.
DataSource	md	Provide test data for test cases.
IssuerHelper	md	Handling issue related.
ReportHelper	md	Generate total/diff issues.
ValidationRule.Test	md	Contains all test cases for validation rules.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.