From f80cb0ad309681f77cd0d727903cbe43290ae7ab Mon Sep 17 00:00:00 2001 From: Zen Date: Tue, 16 Apr 2024 11:14:02 -0700 Subject: [PATCH] Update README.md --- examples/loreft/README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/examples/loreft/README.md b/examples/loreft/README.md index efc8cdc..6bb2853 100644 --- a/examples/loreft/README.md +++ b/examples/loreft/README.md @@ -4,6 +4,8 @@ Based on the script [`train.py`](https://github.com/stanfordnlp/pyreft/blob/main This directory contains all the files needed to reproduce our paper results. We use random seeds `seed_set = {42,43,44,45,46}` throughout. For non-GLUE tasks, we use the first three seeds from the list. +**Note that ReFT only supports a single GPU for now - make sure you set `CUDA_VISIBLE_DEVICES=0` or something equivalent! We are working on supporting multi-GPU right now.** + ## Datasets To load all of our used datasets run: