Regarding Image Pairs and Dataset Loading Implementation

[zhangshuoneu]

Thank you very much for open-sourcing this powerful and interesting project, as well as providing many algorithm visualization tools. I would like to base my subsequent research on your work. However, I encountered an issue with the dataset loading. It seems that the image pairs in the data preprocessing provided by dust3r have problems. For example, the ScanNet++ dataset is listed as v1, but currently, only v2 of the ScanNet++ dataset is available for download. I noticed that the MUSt3R_512.pth you released uses the ScanNet++ v2 dataset compared to the CVPR version. I am wondering if the image pairs used in this dataset can be made public. If so, would it also be possible to share the dataset loading code used in the paper? Once again, thank you for your contribution to the 3D reconstruction community.

[yocabon]

Regarding image_pairs: we do not plan to release the list of pairs for all datasets. I may release the pairs for ScanNet++ v2 specifically (EDIT: done).

Regarding the dataloader:
DUSt3R's dataloaders are not changed, even with the more recent versions of the datasets.
MUSt3R's dataloader is compatible with all DUSt3R datasets. I've added two examples (ScanNet++/Co3D) that are representative of the two configurations we used.

For every dataset, it involves making _load_view a separate function (this is where there's a lot of copy paste and why I didn't do all the datasets). Then the _get_views functions calls either select_tuple_from_pairs or select_tuple_from_360_scene from tuple_maker.py depending on the dataset (select_tuple_from_360_scene -> CO3D, Wild RGBD, MapFree, DL3DV ; select_tuple_from_pairs -> all others ).

[zhangshuoneu]

Thank you very much! If possible, could the image pairs from the ARKitScenes depth upsample subset also be uploaded?

[zhangshuoneu]

Sorry to disturb you. I noticed that you shared the image pairs for ScanNetV2, which align perfectly with the new version of the released dataset. I was wondering if it would be possible for you to share high-resolution image pairs for ArkitScenes as well? It would be very useful for my work. Thank you so much to you and your team for your contributions to computer vision in 3D!