-
Notifications
You must be signed in to change notification settings - Fork 142
Open
Description
Based on https://huggingface.co/blog/gemma3, Images cannot attend to future images but current transformers implementation will unmask attention within all images
- Issue: Attention mask for multi-image input in gemma3 transformers#38053
- PR: [gemma3] fix bidirectional attention mask transformers#38080
Need to update following code for optimum-intel openvino export after PR38080 merged:
eaidova
Metadata
Metadata
Assignees
Labels
No labels