Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
2676538 dotnet-roslyn Run Unit Tests Log
2676213 dotnet-roslyn Run Unit Tests Log
2675920 dotnet-roslyn Run Unit Tests Log
999740 dotnet/roslyn Run Unit Tests Log
2675778 dotnet-roslyn Run Unit Tests Log
999473 dotnet/roslyn Run Unit Tests Log
999169 dotnet/roslyn Run Integration Tests Log
2674366 dotnet-roslyn Run Unit Tests Log
997928 dotnet/roslyn Run Unit Tests Log
2674323 dotnet-roslyn Run Unit Tests Log
997860 dotnet/roslyn Run Unit Tests Log
996724 dotnet/roslyn Run Integration Tests Log
995980 dotnet/roslyn Run Integration Tests Log
995449 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77859
2672210 dotnet-interactive Test / Blame Log
994130 dotnet/roslyn Run Integration Tests Log
2672129 dotnet-roslyn Run Unit Tests Log
994074 dotnet/roslyn Run Unit Tests Log
993131 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77812
2671651 dotnet-roslyn Run Unit Tests Log
993030 dotnet/roslyn Run Unit Tests Log
2671589 dotnet-roslyn Run Unit Tests Log
992901 dotnet/roslyn Run Unit Tests Log
2671553 dotnet-roslyn Run Unit Tests Log
992842 dotnet/roslyn Run Unit Tests Log
2671524 dotnet-roslyn Run Unit Tests Log
2671480 dotnet-fsharp CmdLine@2 Log
992651 dotnet/roslyn Run Integration Tests Log
992277 dotnet/roslyn Run Integration Tests Log
992052 dotnet/roslyn Run Integration Tests Log
2671001 dotnet-roslyn Run Unit Tests Log
991851 dotnet/roslyn Run Unit Tests Log
991742 dotnet/roslyn Run Integration Tests Log
991392 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77775
989921 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77767
2669279 dotnet-roslyn Run Unit Tests Log
2669142 dotnet-roslyn Run Unit Tests Log
989402 dotnet/roslyn Run Unit Tests Log
989300 dotnet/roslyn Run Integration Tests Log
989082 dotnet/roslyn Run Unit Tests Log
989088 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77720
2668974 dotnet-roslyn Run Unit Tests Log
988884 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77696
2668856 dotnet-roslyn Run Unit Tests Log
988794 dotnet/roslyn Run Unit Tests Log
988283 dotnet/roslyn Run Unit Tests Log
987671 dotnet/roslyn Run Unit Tests Log
2668222 dotnet-roslyn Run Unit Tests Log
987574 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77631
987505 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77648
2668137 dotnet-roslyn Run Unit Tests Log
987482 dotnet/roslyn Run Unit Tests Log
987483 dotnet/roslyn Run Integration Tests Log
987088 dotnet/roslyn Run Integration Tests Log
986787 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77691
2667667 dotnet-roslyn Run Unit Tests Log
986751 dotnet/roslyn Run Unit Tests Log
986694 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77686
2667476 dotnet-roslyn Run Unit Tests Log
986461 dotnet/roslyn Run Unit Tests Log
986462 dotnet/roslyn Run Integration Tests Log
2667267 dotnet-roslyn Run Unit Tests Log
985981 dotnet/roslyn Run Unit Tests Log
985433 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77654
985248 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77654
985110 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77654
2666663 dotnet-roslyn Run Unit Tests Log
984964 dotnet/roslyn Run Unit Tests Log
983999 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77646
983899 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77646
2665771 dotnet-roslyn Run Unit Tests Log
983550 dotnet/roslyn Run Unit Tests Log
983551 dotnet/roslyn Run Integration Tests Log
2665643 dotnet-roslyn Run Unit Tests Log
2665640 dotnet-roslyn Run Unit Tests Log
983287 dotnet/roslyn Run Unit Tests Log
983290 dotnet/roslyn Run Unit Tests Log
2664848 dotnet-roslyn Run Unit Tests Log
982162 dotnet/roslyn Run Unit Tests Log
981759 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77619
981463 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77568
981467 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77568
981450 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77624
981270 dotnet/roslyn Run Integration Tests Log
981245 dotnet/roslyn Run Integration Tests Log
2663627 dotnet-roslyn Run Unit Tests Log
980960 dotnet/roslyn Run Unit Tests Log
979872 dotnet/roslyn Run Integration Tests Log
979797 dotnet/roslyn Run Integration Tests Log
979673 dotnet/roslyn Run Unit Tests Log
979599 dotnet/roslyn Run Unit Tests Log
979481 dotnet/roslyn Run Unit Tests Log
2662664 dotnet-roslyn Run Unit Tests Log
2662662 dotnet-roslyn Run Unit Tests Log
979473 dotnet/roslyn Run Unit Tests Log
2662637 dotnet-roslyn Run Unit Tests Log
979442 dotnet/roslyn Run Unit Tests Log
979438 dotnet/roslyn Run Unit Tests Log
979391 dotnet/roslyn Run Integration Tests Log
2662065 dotnet-roslyn Run Unit Tests Log
Displaying 100 of 164 results
Build Definition Test Pull Request
1000897 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#48069
1000431 dotnet/aspire Aspire.Hosting.Kafka.Tests.WorkItemExecution
1000326 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47712
1000297 dotnet/roslyn workitem_196.WorkItemExecution
2676188 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1000160 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#48015
1000076 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
999715 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#48034
999222 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#48020
998918 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#48012
998916 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#48004
998929 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998760 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998690 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998253 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#47996
998026 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#61145
997886 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
997823 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47873
996532 dotnet/aspnetcore Templates.Mvc.Test.RazorPagesTemplateTest.RazorPagesTemplate_IndividualAuth_LocalDb(useProgramMain: False, noHttps: True) dotnet/aspnetcore#60811
996909 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
996376 dotnet/aspnetcore Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"]) dotnet/aspnetcore#61193
996614 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
996348 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47691
996237 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47956
996125 dotnet/aspnetcore Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"]) dotnet/aspnetcore#61191
2673234 dotnet-roslyn workitem_102.WorkItemExecution
995643 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47941
995504 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#47869
995511 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
994847 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47873
994703 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47773
994831 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47916
994236 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
994178 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#47847
994041 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47897
994049 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47900
993357 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47819
993281 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47833
993232 dotnet/roslyn workitem_198.WorkItemExecution
992837 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47792
992300 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47850
2671181 dotnet-roslyn workitem_88.WorkItemExecution
991559 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#40359
991176 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47736
2670576 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
990613 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#43929
990244 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#47795
989793 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#47809
989746 dotnet/sdk dotnet.Tests.dll.12.WorkItemExecution dotnet/sdk#47807
2669226 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2669166 dotnet-roslyn workitem_88.WorkItemExecution
989227 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47789
988449 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47776
988228 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
988245 dotnet/roslyn workitem_4.WorkItemExecution dotnet/roslyn#77715
988147 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#47773
987116 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#61034
988007 dotnet/roslyn workitem_4.WorkItemExecution dotnet/roslyn#77715
987988 dotnet/roslyn workitem_4.WorkItemExecution dotnet/roslyn#77194
987792 dotnet/roslyn workitem_19.WorkItemExecution dotnet/roslyn#77704
987435 dotnet/roslyn workitem_225.WorkItemExecution
986801 dotnet/roslyn workitem_8.WorkItemExecution dotnet/roslyn#77194
986571 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47742
986532 dotnet/aspnetcore Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"]) dotnet/aspnetcore#61026
985902 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47734
985491 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47716
985293 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47433
984405 dotnet/aspnetcore InMemory.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60930
984079 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47684
983796 dotnet/aspnetcore Microsoft.AspNetCore.Http.Results.Tests--net10.0.WorkItemExecution
983580 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47661
981526 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#47616
981459 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47631
981239 dotnet/aspnetcore Microsoft.AspNetCore.Routing.Tests--net10.0.WorkItemExecution
980937 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
980722 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47586
980698 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47606
980433 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
980050 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47587
980141 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47552
979988 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47575
979909 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47572
979790 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
978175 dotnet/aspnetcore Microsoft.AspNetCore.Identity.EntityFrameworkCore.Test--net10.0.WorkItemExecution dotnet/aspnetcore#60905
979699 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#47565
2662777 dotnet-roslyn workitem_272.WorkItemExecution
979701 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#45419
2662730 dotnet-roslyn workitem_272.WorkItemExecution
979396 dotnet/roslyn workitem_1.WorkItemExecution
979340 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47528
979343 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47537
979036 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#47551
979037 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47552
978733 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47528
977843 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47519
978584 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47532
978471 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47538
978359 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47512
978381 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47528
977841 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47514
Displaying 100 of 159 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
12 65 323

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants