Can BERT be used as language model for generating captions?

[muhammad-azmain-mahtab]

Can BERT be used as language model for generating captions instead of GPT-2?

[Haijian06]

This one should work in principle in my opinion, with the encoder architecture used by bert, but a generative gpt2 might work better