Skip to content

Pre-defined task improvements #662

@JulienVig

Description

@JulienVig
  • Training when a saved model already exists reuses it by default, while it should create a new model overwrite it.
  • The training graphs should show the training and validation loss too, sometimes the accuracies stay constant while the loss still changes.
  • The test accuracy graph doesn't update and stays at 0 -> Create a Skin Condition classification task #678 removed the test line plot (because it was only plotting a single scalar value)
  • The testing an image model (e.g. lus_covid) shows what are the predictions for each image and where the model made classification mistakes (groundtruth vs prediction). However errors are sometimes not displayed (only prediction).
  • Validation set sometimes contains only one class
    Image tasks support choosing a train-validation split in which a percentage of the training set is set apart as a validation set (discojs-core/src/dataset/data_loader/image_loader.ts). In some cases however, e.g., when using imbalanced or small datasets, this can result in some classes not being included in the validation set at all.
    Unfortunately, it seems that tensorflow.js doesn't offer any function for stratified splits.
  • Cached model is used by default while it is said in the task that it would be overwritten. Moreover the toggle button to disable this isn't displayed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    discojsRelated to Disco.jsfeatureNew feature or requestweb clientRelated to the browser environment

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions