Decoder Model

[pharringtonp19]

• Implement compute_recall
  • Currently this involves a separate forward pass of the model. We should be able to combine this with evaluation_loss
  • model.generate isn't working atm
• flash-attention implementation
• Improve logging format: log_predictions
  • Can we make this interactive via gradio?
• Plot learning rate
• Early Stopping
• two 'yes' tokens