Description
The GlutenAutoAdjustStageResourceProfile rule is designed to adjust off-heap and heap memory for different stages. We should disable GlutenAutoAdjustStageResourceProfile rule when off-heap memory is not enabled. (We disable off-heap memory when spark.gluten.memory.dynamic.offHeap.sizing.enabled is enabled.)
Gluten version
main branch
Description
The
GlutenAutoAdjustStageResourceProfilerule is designed to adjust off-heap and heap memory for different stages. We should disable GlutenAutoAdjustStageResourceProfile rule when off-heap memory is not enabled. (We disable off-heap memory whenspark.gluten.memory.dynamic.offHeap.sizing.enabledis enabled.)Gluten version
main branch