Any documentation on using SRU++ ?

[thangld201]

Hello, I've read and really appreciated your team's wonderful works on SRU++. I want to implement this architecture in other tasks, but i'm having problem finding the documentation on SRU++, as how I can use SRU++ the same way as SRU (calling directly from sru library after installing by pip install sru). I have looked into the dev-3.0.0 branch, which seems like the latest updated branch, but I still have no clues how to call and integrate sru++ modules into my custom defined pytorch modules. Could you help me ?

[taolei87]

Hi @thangld201, you may find the docstrings of the SRU++ module useful. See for example:

• https://github.com/asappresearch/sru/blob/3.0.0-dev/sru/modules.py#L1098-L1150
• https://github.com/asappresearch/sru/blob/3.0.0-dev/sru/modules.py#L972

In addition, the experiment directory contains a few examples of training SRU++ on language model tasks. See for example:

• https://github.com/asappresearch/sru/blob/3.0.0-dev/experiments/srupp_experiments/train_wt103.py#L29-L41
• https://github.com/asappresearch/sru/blob/3.0.0-dev/experiments/srupp_experiments/train_wt103.py#L109

Unfortunately i'm no longer working at ASAPP, so I couldn't merge the dev branch into master.
However, you can install the dev branch by pip install sru==3.0.0.dev6 and use it the same way as SRU.

Hope this helps!