Minimal Memory for Details in Real Life Events

This repository, to the best of its ability, aims to walk the user to walk through the data and computational analysis for the paper Minimal memory for details in real life events. Please download all data and videos from this link from our lab.

General Approaches

The study was divided into two memory encoding parts called EXPI (conducted outdoors around MIT campus) and EXPII (conducted indoors inside the Museum of Fine Arts, Boston or the MFA). For details regarding methods, please go through the paper.

The code and analysis for EXPI is included in the folder ~/EXPI and that for the other experiment is in ~/EXPII.

Data

1 second videos clips from the a particular subjects own encoding phase and similar looking foil clips were used. The subject had the task to distinguish whether a clip belonged to his/her own experience or not.

VIDEOS

1 second video clips shown to subjects for EXPI and EXPII are in the folder ~/VIDEOS. The same of those videos are shown below.

EXPI Data

~/EXPI/annotationsMIT1 These files contain the labels and annotations done for each video for EXPI.

~/EXPI/IMAGES These files contain snapshots of 1-second clips shown to each subject during the memory tests. Each image has corrsponding annotations in rows of files in ~/EXPI/annotationsMIT1

~/EXPI/FC7 These files contain Alexnet-FC7 features of snapshots of 1-second clips shown to each subject during the memory tests. Each feature vector has corrsponding annotations in rows of files in ~/EXPI/annotationsMIT1

EXPII Data

~/EXPII/annotationInfoMFA These files contain the labels and annotations done for each video for EXPII.

~/EXPII/IMAGES These files contain snapshots of 1-second clips shown to each subject during the memory tests. Each image has corrsponding annotations in rows of files in ~/EXPII/annotationInfoMFA

~/EXPII/FC7 These files contain Alexnet-FC7 features of snapshots of 1-second clips shown to each subject during the memory tests. Each feature vector has corrsponding annotations in rows of files in ~/EXPII/FC7

~/EXPII/EXTRAPOLATE These files contain the eye movement information in corresponding target clips.

Figures & Analysis from Paper

EXPI

~/EXPI/EXPI.m Run this file and follow throught the code of this file to generate the main figures in the paper.

EXPII

~/EXPII/EXPII.m Run this file and follow throught the code of this file to generate the main figures in the paper.

Extra Notes

• Unzip the files in ~/EXPI/TRAINED MODELS FEATURES/MIT.zip

• Unzip the files in ~/EXPII/TRAINED_MODELS MFA_NEW/TRAINED_MODELS_UNZIP_TO_RUN_CODE.zip and paste the contents into ~/EXPII/TRAINED_MODELS_MFA_NEW/

• Figure 5 is the average of the bars in Figure S6. The individual performaces/bars for each subject can be plotted using files ~EXPII/TRAINED_MODELS_MFA_NEW/pred_XX.m