How to process video streams

[chen716]

Thanks for the awesome work, very interesting.
I'm hoping to run this in real-time stream, wondering do you have any recommendations on how to set that up?

[LiZizun]

Thank you for your interest in our work! I've just updated the repository, and it now supports input videos with the .mp4 extension.

[LiZizun]

If you want to input a real-time image stream, I recommend referring to the load_images_for_eval function in dust3r.utils.image to process the input images. Make sure to save the results from each window forward operation in real time, and remember to preserve the camera token pool obtained after each window forward pass for use as input in the next iteration.