I installed the minRLHF library using pipenv
pipenv run python -m pip install "minrlhf @ git+https://github.com/thomfoster/minRLHF.git"
And got this execution error:
Traceback (most recent call last):packages/minRLHF/ppo_trainer.py", line 7, in <module>
from minRLHF.buffer import Buffer
File "{...}/lib/python3.10/site-packages/minRLHF/buffer.py", line 6, in <module>
from torch_discounted_cumsum import discounted_cumsum_right
ModuleNotFoundError: No module named 'torch_discounted_cumsum'
The solution was to simply install the missing torch-discounted-cumsum module
pipenv install torch-discounted-cumsumÏ
I'm not sure if that's a pipenv installation issue, or somewhere in the library itself.
I installed the minRLHF library using pipenv
pipenv run python -m pip install "minrlhf @ git+https://github.com/thomfoster/minRLHF.git"And got this execution error:
The solution was to simply install the missing
torch-discounted-cumsummoduleI'm not sure if that's a pipenv installation issue, or somewhere in the library itself.