Thank you very much for your work. Except segmentation labels, how to extract BLIP captions for image segmentation region?

[carlfu127]

We use the semantic segmentation subset of OpenImage v6[15] as the main dataset for multi-task prompt tuning. In addition, following Smartbrush [32], we use segmentation labels and BLIP captions[16] as local text descriptions.

[zengyh1900]

hi @carlfu127 , we cropped the region according to the segmentation mask and use the cropped region for blip caption.