Activity
Add instruction finetuned model
Add instruction finetuned model
Added chainlit app + lil refactor classification_finetuning
Added chainlit app + lil refactor classification_finetuning
Added optional saving in better training loop
Added optional saving in better training loop
Fix training loop import in instruction_finetuning
Fix training loop import in instruction_finetuning
Finetuning refactor + plot refactor
Finetuning refactor + plot refactor
Adjusted SelfAttention imports
Adjusted SelfAttention imports
Refactor of SelfAttention classes
Refactor of SelfAttention classes
Moved SimpleTokenizer to a specific file
Moved SimpleTokenizer to a specific file
Setup handling of ollama and loaded models
Setup handling of ollama and loaded models
Saved response of model to test set
Saved response of model to test set
FIne-tuning of gpt2-small done
FIne-tuning of gpt2-small done
Finished Model Classification Fine-Tuning
Finished Model Classification Fine-Tuning
Finished Dataset Preparation for Classification Fine-Tuning
Finished Dataset Preparation for Classification Fine-Tuning
Better training loop + saving model
Better training loop + saving model
Add loss plot and 'smart' text generation
Add loss plot and 'smart' text generation
Loss function and train-val split implemented
Loss function and train-val split implemented
Implemented basic generation of text
Implemented basic generation of text
Implemented MultiHeadAttention class w/ batched matrix multiplication
Implemented MultiHeadAttention class w/ batched matrix multiplication
Implemented SelfAttentionV1 and SelfAttentionV2
Implemented SelfAttentionV1 and SelfAttentionV2