Fix ISIC dataloader, shape error in UNet & questions about paper

[halleewong]

Hi,

Thanks for sharing this code! Posting here because it seems like there's no "issues" tab in your repo.

I am very interested in comparing to your model. Would you be able to release the pre-trained weights? It would make it much easier to compare and the pre-trained weights are necessary to run the val.py examples in your readme.

I tried running the train.py example using the provided ISIC dataloader (fixed some bugs in 1cb9712 to get it working) but I encountered a shape error with the recommended unet backbone. The image embeddings output by the unet encoder are [image_size/16, image_size/16] instead of [image_size/4, image_size/4] expected here, leading to a shape mismatch here.

Which backbone did you use in the paper? I wasn't able to find these architectural details in the main paper or supplement.

Thanks!
Hallee

[j-Halloran]

yes seconded, either pre-trained weights or a better description of training data would be much appreciated

[hu2274898]

yes seconded, either pre-trained weights or a better description of training data would be much appreciated

Hi could you please tell me where should I put prompt.json in?I didnt find any introduction about prompt.json in the code

[hu2274898]

Hi,

Thanks for sharing this code! Posting here because it seems like there's no "issues" tab in your repo.

I am very interested in comparing to your model. Would you be able to release the pre-trained weights? It would make it much easier to compare and the pre-trained weights are necessary to run the val.py examples in your readme.

I tried running the train.py example using the provided ISIC dataloader (fixed some bugs in 1cb9712 to get it working) but I encountered a shape error with the recommended unet backbone. The image embeddings output by the unet encoder are [image_size/16, image_size/16] instead of [image_size/4, image_size/4] expected here, leading to a shape mismatch here.

Which backbone did you use in the paper? I wasn't able to find these architectural details in the main paper or supplement.

Thanks! Hallee

Hi could you please tell me where should I put prompt.json in?I didnt find any introduction about prompt.json in the code

[zxy20000312]

是的，附议，无论是预训练的权重还是对训练数据的更好描述都将不胜感激

您好，您能告诉我我应该把prompt.json放在哪里吗？我在代码中没有找到任何关于 prompt.json
您好，您成功复现了吗？能告诉我他的数据集和prompt.json是如何使用的吗

[Mohit-Hasan]

Hello, is there a sample notebook available for this repository? I'm a bit confused about how to use it. Could you please provide clearer explanations of the parameters or at least a detailed description of each one? It would also be helpful if you could ensure the code works universally.