Finetuning toto model

[bafatah]

Can you please provide an example of how to finetune toto model?

[alexolpe]

Yes, this would be very helpful!

[Ivan-Fan]

The same! Really appreciate it if we can have a finetune example~

[wsy000-com]

The same

[biiiipy]

Please release finetuning example :)

[iganggang]

Please release finetuning example :)

[Salahidine2002]

Hi @bafatah @alexolpe @Ivan-Fan @wsy000-com @biiiipy @iganggang

Fine-tuning support is now available in v0.2.0! 🎉

What's included:

• FinetuneDataModule: PyTorch Lightning DataModule for training on custom HuggingFace datasets
• TotoForFinetuning: Lightning module with default configuration matching Toto's pretraining recipe
• Ready-to-use training script with YAML configuration
• Interactive tutorial notebook: finetuning_tutorial.ipynb

Quick start:

pip install toto-ts==0.2.0

Check out the README fine-tuning section and the tutorial notebook for step-by-step guidance.

Closing this issue as resolved.