Personal Academic Webpage

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

EPFL's NLP lab website

Benchmarking Commonsense Reasoning in Real-World Tasks

Awesome Incremental Learning

Collection of papers and resources on Reasoning in Large Language Models (LLMs), including Chain-of-Thought (CoT), Instruction-Tuning, and others.

Repository for the paper "Reasoning with Language Model Prompting: A Survey".

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Interpretable prompting and models for NLP (using large language models).

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them

LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.

The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignment".

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

A modular RL library to fine-tune language models to human preferences

🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.

NAACL 2021: Are NLP Models really able to Solve Simple Math Word Problems?

public repo for ESTER dataset and modeling (EMNLP'21)

The corresponding code from our paper " COINS: Dynamically Generating COntextualized Inference Rules for Narrative Story Completion (ACL 2021)". Do not hesitate to open an issue if you run into any…

The corresponding code from our paper "Social Commonsense Reasoning with Multi-Head Knowledge Attention (EMNLP 2020)". Do not hesitate to open an issue if you run into any trouble!

Language Generation with Multi-hop Reasoning on Commonsense Knowledge Graph

GLUCOSE: GeneraLized and COntextualized Story Explanations https://arxiv.org/abs/2009.07758

XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning