[BUG: TRL support]

### Python Version

```shell
3.7
```


### Pip Freeze

```shell
python
```


### Reproduction Steps

I want fine-tune by TRL lib. How to do that?

### Expected Behavior

Compatiblity with TRL

### Additional Context

_No response_

### Suggested Solutions

_No response_