Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1002776	dotnet/sdk	🟣 Build	Log	#48085
1002266	dotnet/sdk	🟣 Build	Log	#48065
1001930	dotnet/sdk	🟣 Build	Log	#48085
1001859	dotnet/sdk	🟣 Build	Log	#48085
2676449	dotnet-sdk	🟣 Build	Log
2676416	dotnet-sdk	🟣 Build	Log
2676095	dotnet-sdk	🟣 Build	Log
998204	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47898
997791	dotnet/sdk	Build	Log	#47996
997214	dotnet/sdk	Build	Log	#47985
997107	dotnet/sdk	Build	Log	#47976
996811	dotnet/sdk	Build	Log	#47898
996420	dotnet/sdk	Build	Log	#47948
995901	dotnet/sdk	Build	Log	#47945
994206	dotnet/sdk	🟣 Build	Log	#47904
993714	dotnet/sdk	Build	Log	#47875
993205	dotnet/sdk	Build	Log	#40359
991269	dotnet/sdk	Build	Log	#47792
990900	dotnet/sdk	Build	Log	#47821
988591	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47764
987597	dotnet/sdk	🟣 Run TestBuild Tests	Log	#47767
986992	dotnet/sdk	Run Tests	Log	#47678
985987	dotnet/sdk	Build	Log	#46898
985240	dotnet/sdk	Build	Log	#47338
985279	dotnet/sdk	🟣 Build	Log	#45633
2666494	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#48608
984279	dotnet/sdk	Run Tests	Log	#47652
984193	dotnet/sdk	Build	Log	#47500
984061	dotnet/sdk	Run Tests in Helix	Log	#47645
983579	dotnet/sdk	Run FullFramework Tests	Log	#46218
983190	dotnet/sdk	Build	Log	#47659
982215	dotnet/sdk	Build	Log	#47338
981444	dotnet/sdk	Run Tests	Log	#47580
980701	dotnet/sdk	Clone dotnet/dotnet	Log	#47480
979987	dotnet/sdk	Run TestBuild Tests	Log	#47574
979641	dotnet/sdk	Build	Log	#47509
979739	dotnet/sdk	Build	Log	#47076
2662667	dotnet-sdk	OneLocBuild	Log
978977	dotnet/sdk	Build	Log	#47544
978956	dotnet/sdk	🟣 Run TestBuild Tests	Log	#46425
978893	dotnet/sdk	Build	Log	#47544
978707	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47507
978519	dotnet/sdk	Build	Log	#47167
978359	dotnet/sdk	Build	Log	#47512
977637	dotnet/sdk	🟣 Run FullFramework Tests	Log	#47510
977283	dotnet/sdk	Build	Log	#47480
977117	dotnet/sdk	Build	Log	#47499
976656	dotnet/sdk	Build	Log	#47480
975295	dotnet/sdk	Build	Log	#47167
973178	dotnet/sdk	Build	Log	#47377
972967	dotnet/sdk	Build	Log	#47388
972750	dotnet/sdk	🟣 Build	Log	#47377
972577	dotnet/sdk	Build	Log	#47321
972569	dotnet/sdk	Build	Log	#47371
972575	dotnet/sdk	Build	Log
971923	dotnet/sdk	Build	Log	#47359
970981	dotnet/sdk	Run Tests in Helix	Log	#47322
970164	dotnet/sdk	Build	Log	#47226
969671	dotnet/sdk	Build	Log	#47290
969163	dotnet/sdk	Build	Log	#47167
969044	dotnet/sdk	Build	Log	#47266

Build	Definition	Test	Pull Request
1002015	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.12.WorkItemExecution	#48034
1001451	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.6.WorkItemExecution	#48005
999715	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.9.WorkItemExecution	#48034
1000376	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.7.WorkItemExecution	#47994
999839	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution	#47833
999352	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution	#48025
999399	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.MvcBuildIntegrationTest21NetFx.Microsoft.NET.Sdk.Razor.Tests.MvcBuildIntegrationTest21NetFx.Building_Project	#48028
999316	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.12.WorkItemExecution	#47997
999041	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#48005
999073	dotnet/sdk	Microsoft.NET.Publish.Tests.GivenThatWeWantToPublishASingleFileApp.Microsoft.NET.Publish.Tests.GivenThatWeWantToPublishASingleFileApp.It_runs_single_file_apps	#47992
999021	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.9.WorkItemExecution	#47997
998949	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.StaticWebAssetsCrossTargetingTests.Microsoft.NET.Sdk.Razor.Tests.StaticWebAssetsCrossTargetingTests.Build_CrosstargetingTests_CanIncludeBrowserAssets	#48016
998477	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.BlazorMultitargetIntegrationTest.Microsoft.NET.Sdk.BlazorWebAssembly.Tests.BlazorMultitargetIntegrationTest.MultiTargetApp_LoadsTheCorrectSdkBasedOnTfm	#47992
995444	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution	#47898
995299	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution	#47898
993731	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.8.WorkItemExecution	#47833
990991	dotnet/sdk	Microsoft.DotNet.ScenarioTests.SdkTemplateTests.SdkTemplateTests.VerifyWebAppTemplate	#47833
981526	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	#47616

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	29	79

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.