Skip to content

Fix benchmark docs and behavior: LightGBM does not support GPU-accelerated inference #131

Description

@coderabbitai

Summary

The benchmark suite added in #101 incorrectly treats LightGBM as supporting GPU-accelerated inference. As noted by @jameslamb in this review comment, LightGBM's OpenCL/GPU support is limited to training only — there is no GPU-accelerated inference in LightGBM.

Problem

  • README.md in the benchmark suite documents a "GPU" mode for LightGBM inference that does not exist.
  • The benchmark code may be running LightGBM inference on CPU even when --device=gpu is specified, making the comparison misleading.

Suggested Fix

  • Update the README.md to clarify that LightGBM inference always runs on CPU, regardless of the --device flag.
  • Update the benchmark runner (run.py) to reflect that when comparing nvforest GPU inference against LightGBM, the LightGBM side is CPU-only inference.
  • Ensure the output CSV and summary statistics accurately label LightGBM results as CPU inference.

References

Reported by @csadorf.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions