Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Twitter Bots Example Overfits "Out-of-the-Box" #4012

Open
Quinn-Meyer-Sustainment opened this issue May 29, 2024 · 1 comment
Open

Twitter Bots Example Overfits "Out-of-the-Box" #4012

Quinn-Meyer-Sustainment opened this issue May 29, 2024 · 1 comment
Labels
llm Large Language Model related

Comments

@Quinn-Meyer-Sustainment

I am running the Google Colab example of Ludwig-AI Multimodal Classification from the Twitter Bots Kaggle dataset. You can get the Python API Colab link directly from Ludwig AI's documentation here.

I do not edit anything in the Colab notebook at all, I simply 'Run All Code Cells' and my model over fits on the training data.

You can find my training results here:
training_results.txt

And evaluation images here:
training_loss
confusion_matrix

Colab is running Python 3.10.12
and the pip freeze can be found here:
pip_freeze.txt

Do I need to tune parameters under the hood, or should it simply be working out of the box?

@Quinn-Meyer-Sustainment
Copy link
Author

Quinn-Meyer-Sustainment commented May 29, 2024

Forgot to mention that the example clearly shows the model training on Kaggle data converging quite nicely... See the evaluation images here.

[Edited for semantics]

@alexsherstinsky alexsherstinsky added the llm Large Language Model related label Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
llm Large Language Model related
Projects
None yet
Development

No branches or pull requests

2 participants