The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2647915	dotnet-arcade-validation	🛡 Guardian: CredScan (Binary)	Log
959361	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112796
959342	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#112728
959337	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112799
959357	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112801
959312	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112766
959349	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112800
959322	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112736
959308	dotnet/runtime	Send tests to Helix (Unix)	Log
959317	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112736
959274	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112797
959287	dotnet/runtime	Send tests to Helix (Unix)	Log
959218	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#111505
2647712	dotnet-runtime	Send job to Helix (Windows)	Log
959237	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112795
959226	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112793
959166	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112753
958130	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112504
959152	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112791
2647694	dotnet-performance	Send job to Helix (Unix)	Log
959134	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112789
959092	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112004
959137	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112790
959122	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112730
959065	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#111543
959056	dotnet/runtime	Send tests to Helix (Unix)	Log
959100	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112788
2647656	dotnet-sdk	🟣 Build	Log
959082	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112787
959015	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112168
958989	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112369
959028	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112786
958097	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112139
2647618	dotnet-extensions	Validate Hosted Pool Information (1ES PT)	Log
958954	dotnet/runtime	Send to Helix	Log
958950	dotnet/runtime	Send tests to Helix (Unix)	Log
958951	dotnet/runtime	Send tests to Helix (Unix)	Log
958944	dotnet/runtime	Send tests to Helix (Unix)	Log
958953	dotnet/runtime	Send to Helix	Log
2647548	dotnet-runtime	Send job to Helix (Windows)	Log
958916	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112730
958890	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#110472
2647388	dotnet-runtime	Send job to Helix (Unix)	Log
2647537	dotnet-arcade-services	Run E2E tests	Log
958878	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112780
958865	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112782
958868	dotnet/runtime	Send to Helix	Log	dotnet/runtime#110818
2647516	dotnet-performance	Send job to Helix (Unix)	Log
958817	dotnet/runtime	Send to Helix	Log
958827	dotnet/runtime	Send to Helix	Log
2647260	dotnet-dotnet	Build (azurelinuxX64CrossContainer)	Log
2647262	dotnet-dotnet	Build	Log
958795	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112411
958814	dotnet/runtime	Send to Helix	Log
2647451	dotnet-dotnet	Build (centOSStreamContainer)	Log
958219	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112369
958377	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112754
958705	dotnet/runtime	Send tests to Helix (Unix)	Log
958671	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#111505
958644	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112728
958613	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112777
958605	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112624
958602	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112513
958555	dotnet/runtime	Send tests to Helix (Unix)	Log
958562	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112745
2647279	dotnet-wix	Build WiX Toolset	Log
2647267	dotnet-runtime	Send job to Helix (Unix)	Log
958494	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112004
2647219	dotnet-runtime	Send job to Helix (Windows)	Log
2647009	dotnet-dotnet	🛡 Guardian: AntiMalware Scanner (Binary)	Log
958398	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112766
958364	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112764
958412	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112767
958314	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112535
958442	dotnet/aspnetcore	Build shared fx	Log	dotnet/aspnetcore#60393
2647151	dotnet-wix	Build WiX Toolset	Log
2647099	dotnet-runtime	Run performance job script	Log
958251	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112213
958242	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112758
958311	dotnet/roslyn	Test	Log	dotnet/roslyn#77301
958192	dotnet/runtime	Send tests to Helix (Unix)	Log
958116	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112728
958209	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112372
2647061	dotnet-efcore	Build	Log
958200	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112352
958171	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112737
958135	dotnet/runtime	Send to Helix	Log	dotnet/runtime#111791
958073	dotnet/runtime	Send tests to Helix (Unix)	Log
958022	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112705
958047	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112721
958068	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112505
958118	dotnet/sdk	Run FullFramework Tests	Log	dotnet/sdk#46989
958032	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112753
958054	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112754
958035	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112753
957939	dotnet/sdk	🟣 Run FullFramework Tests	Log	dotnet/sdk#46983
2646946	dotnet-dotnet	Build (azurelinuxX64CrossContainer)	Log
958014	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112741
2646928	dotnet-dotnet	Build (azurelinuxX64MuslCrossContainer)	Log
2646927	dotnet-dotnet	Build	Log
Displaying 100 of 1902 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
66	253	1902

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)