Skip to content

Images label prediction given clean and noisy labels. Use label correction techniques to deal with noisy labels.

Notifications You must be signed in to change notification settings

Enzoherewj/Weakly-supervised-learning----label-noise-and-correction

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Project: Weakly supervised learning-- label noise and correction

Term: Spring 2023

  • Team 2

  • Team members

  • Project summary: In this project, we built two predictive models for image classification with 50k images as the training dataset. Among them, 10k have clean labels while the rest of them have noisy labels. In addition to a baseline logistic model, we built a Convolution Neural Network model, treating all 50k labels as clean labels. Considering the lack of testing data, we split the data into 80% of the training set and 20% of the validation test. The model I achieves a validation accuracy of 21% with a running time of 103 seconds in 5 epochs. We further built another convolution neural network model based on model I, incorporating the weakly supervised learning method into it in order to solve the problem of the presence of noisy labels. We first trained a "label-correction" model using 10k images with clean labels given, and use this model to correct the labels for 40k images initially with noisy labels. Finally, we trained the final predictive model II using the corrected dataset. Compared to the model I, model II was implemented with a more sophisticated convolution neural network architecture in order to improve performance and accuracy. At the same time, several layers were added in order to avoid the risk of overfitting and ensure the balance between the running time cost and the complexity of the model. We split the data into 90% of the training set and 10% of the validation set. Ultimately, model II achieved a validation accuracy of 68% with a running time of about 1197 seconds. Overall, we believe that model II significantly outperforms the baseline model and the simpler convolution neural network model without the weakly supervised learning feature in terms of predictive accuracy.

Contribution statement: Liang Hu worked on building model I for the project. Xinming Pan worked on building model II for the project. Yi Xuan Qi and Sicheng Zhou worked on the presentation slides. Weijie Xia and Ranran Tao worked on building and cleaning up the final report.

Following suggestions by RICH FITZJOHN (@richfitz). This folder is orgarnized as follows.

proj/
├── lib/
├── data/
├── doc/
├── figs/
└── output/

Please see each subfolder for a README file.

About

Images label prediction given clean and noisy labels. Use label correction techniques to deal with noisy labels.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 90.9%
  • PureBasic 9.1%