This repository contains the code and scripts to reproduce the results from our paper "HARE: Human-in-the-Loop Algorithmic Recourse", accepted at TMLR 2025.
Sai Srinivas Kancheti‡1, Rahul Vigneswaran‡1, Bamdev Mishra2, Vineeth N Balasubramanian1
‡ contributed equally to this work.
1Indian Institute of Technology Hyderabad, India
2Microsoft, India
📄 Reviewed on OpenReview: https://openreview.net/forum?id=56EBglCFvx
Machine learning models are seeing increasing use as decision making systems in domains such as education, finance and healthcare. It is desirable that these models are trustworthy to the end-user, by ensuring fairness, transparency and reliability of decisions. In this work, we consider a key aspect of responsible and transparent AI models -- actionable explanations, viz. the ability of such models to provide recourse to end users adversely affected by their decisions. While algorithmic recourse has seen a variety of efforts in recent years, there have been very few efforts on exploring personalized recourse for a given user. Two users with the same feature profile may prefer vastly different recourses. The limited work in this direction hitherto rely on one-time feature preferences provided by a user. Instead, we present a human-in-the-loop formulation of algorithmic recourse that can incorporate both relative and absolute human feedback for a given test instance. We show that our formulation can extend any existing recourse generating method, enabling the generation of recourses that are satisfactory to the user. We perform experiments on 3 benchmark datasets on top of 6 popular baseline recourse methods where we observe that our framework performs significantly better on simulated user preferences.
To reproduce the results from our paper, follow these steps:
conda env create -f environment.yml
To reproduce Table 1 from the paper, execute:
bash src/scripts/table1.sh
For other tables and experiments, modify the script accordingly:
bash src/scripts/<table_name>.sh
Results are saved in logs
directory.
If you find our work useful, please cite our paper:
@article{HARE2025,
title={HARE: Human-in-the-Loop Algorithmic Recourse},
author={Sai Srinivas Kancheti and Rahul Vigneswaran and Bamdev Mishra and Vineeth N Balasubramanian},
journal={TMLR},
year={2025}
}
If you encounter any issues or bugs, please raise an issue on our GitHub repository. We welcome feedback and contributions to improve this work!