FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed

[MarkLyck]

trying to run snowpack dev causes this fatal error:

<--- Last few GCs --->

[60614:0x1045db000]    64593 ms: Scavenge 2042.8 (2050.4) -> 2042.2 (2050.4) MB, 9.4 / 0.0 ms  (average mu = 0.242, current mu = 0.206) allocation failure 
[60614:0x1045db000]    64606 ms: Scavenge 2043.0 (2050.4) -> 2042.4 (2050.4) MB, 4.5 / 0.0 ms  (average mu = 0.242, current mu = 0.206) allocation failure 
[60614:0x1045db000]    64616 ms: Scavenge 2043.2 (2050.4) -> 2042.6 (2050.9) MB, 3.7 / 0.0 ms  (average mu = 0.242, current mu = 0.206) allocation failure 


<--- JS stacktrace --->

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x101230f15 node::Abort() (.cold.1) [/usr/local/bin/node]
 2: 0x10009e0a9 node::Abort() [/usr/local/bin/node]
 3: 0x10009e20f node::OnFatalError(char const*, char const*) [/usr/local/bin/node]
 4: 0x1001da277 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 5: 0x1001da217 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 6: 0x10036af45 v8::internal::Heap::FatalProcessOutOfMemory(char const*) [/usr/local/bin/node]
 7: 0x10036c7ba v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [/usr/local/bin/node]
 8: 0x100368787 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [/usr/local/bin/node]
 9: 0x100366187 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/usr/local/bin/node]
10: 0x10037342a v8::internal::Heap::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/usr/local/bin/node]
11: 0x1003734b1 v8::internal::Heap::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/usr/local/bin/node]
12: 0x10033ff57 v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationType, v8::internal::AllocationOrigin) [/usr/local/bin/node]
13: 0x1006a68a8 v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*) [/usr/local/bin/node]
14: 0x1009eb959 Builtins_CEntry_Return1_DontSaveFPRegs_ArgvOnStack_NoBuiltinExit [/usr/local/bin/node]
error Command failed with signal "SIGABRT".

There's not really much to go on, besides a TON of warnings.

Above this error, I see warnings about The 'this' keyword is equivalent to 'undefined' at the top level of an ES module, and has been rewritten for what looks like thousands of modules from these packages:

• react-mapbox-gl
• ra-core
• ra-ui-materialui
• @react-admin
• ra-input-rich-text
• ra-i18n-polyglot

e.g.

[snowpack] /Users/mark/ypm/xxxx/cloud-one2/node_modules/ra-core/esm/reducer/admin/resource/list/selectedIds.js:1:30 The 'this' keyword is equivalent to 'undefined' at the top level of an ES module, and has been rewritten

It also takes about 30 seconds before it actually throws the error, which is a long stretch from the 50ms claim on the website 🙃

I have no problems doing the same build with webpack & next.js

[FredKSchott]

Thanks for sharing this feedback, I don't see the same memory issue but I do see an error about a sub-dependency of one of those packages, tracked down and fixed here: #1181

I'm curious: how many files do you have in your source directory. Also, how many other packages are used besides those larger ones that you linked? It's hard to say whether the memory limit is being hit by the installer, or by the import scanner that runs on your source files. Either way, I'd love us to get this working for you!

[MarkLyck]

Hi @FredKSchott thanks for the reply :)

It's a very small project, maybe about 20-30 files in the src folder?

Here's a full list of dependencies:

"dependencies": {
    "@xxxx/xxx-analytics": "^2.0.3",
    "@xxxx/xxx-app": "^2.0.8-mark1",
    "@fortawesome/fontawesome-svg-core": "^1.2.31",
    "@fortawesome/pro-duotone-svg-icons": "^5.15.0",
    "@fortawesome/pro-regular-svg-icons": "^5.15.0",
    "@fortawesome/pro-solid-svg-icons": "^5.15.0",
    "@fortawesome/react-fontawesome": "^0.1.11",
    "@material-ui/core": "^4.11.0",
    "@sentry/browser": "^5.24.2",
    "date-fns": "^2.16.1",
    "es5-ext": "^0.10.53",
    "flat": "^5.0.2",
    "lodash.clonedeep": "^4.5.0",
    "lodash.memoize": "^4.1.2",
    "mapbox-gl": "^1.12.0",
    "querystring": "^0.2.0",
    "ra-i18n-polyglot": "^3.8.5",
    "ra-language-english": "^3.8.5",
    "ra-language-french": "^3.8.5",
    "react": "^16.13.1",
    "react-admin": "^3.8.5",
    "react-date-range": "^1.0.3",
    "react-dom": "^16.13.1",
    "react-final-form-listeners": "^1.0.2",
    "react-mapbox-gl": "^4.8.6",
    "react-tooltip": "^4.2.10",
    "styled-components": "^5.2.0"
  },
  "devDependencies": {
    "@snowpack/app-scripts-react": "^1.11.0",
    "@testing-library/jest-dom": "^5.11.4",
    "@testing-library/react": "^11.0.4",
    "@types/react": "^16.9.49",
    "@types/react-dom": "^16.9.8",
    "@types/snowpack-env": "^2.3.0",
    "jest": "^26.4.2",
    "prettier": "^2.1.2",
    "snowpack": "^2.12.1",
    "typescript": "^4.0.3"
  }

I submitted a bug report with react-admin about the this warnings, but sadly they told me they don't care to fix it because they only use webpack 🤷‍♂️

[mikaelbalin]

The same problem for me. We have around 1000 files in a project

[dbousamra]

Same for me.

[GagnDeep]

same here :(
have you found any workaround ?

[FredKSchott]

Duplicate: #1548

We're looking for someone who can reproduce to help perform a memory snapshot in that thread, if anyone can help it would be appreciated