Sometimes generating in the wrong language

[PN8080]

Despite setting all the language settings to "en", the caption will occasionally throw a caption specifying either a different language, or a mix of English and another language, and then generate lyrics in that other language as well.

Example: vocal language set to "en", song description set to simply "blues", language under lyrics set to "en",
Caption created: "A classic blues-rock arrangement kicks off with an expressive, slightly overdriven electric guitar lead full of bends and vibrato. A steady rhythm section of clean bass and straightforward drums establishes a solid foundation. The male vocalist enters with a clear, slightly raspy, and emotional delivery in Ukrainian. The song progresses through a standard verse-chorus structure, punctuated by bluesy guitar fills and a melodic, technically proficient guitar solo mid-song. The track concludes with an extended outro featuring more guitar improvisation before a final, clean chord rings out and fades."

And then lyrics in Ukranian.

I've seen this happen in both the Gradio UI and in direct calls to the API.

[ChuxiJ]

This is an issue with the LM in Simple mode. This task only accounts for a small proportion; the LM’s main job is still to generate codes, so it hasn’t been designed with high granularity.
You can use larger commercial models as a reference, such as ChatGPT or Claude, to write these based on examples.