QwenLMNext Token Prediction0.32SOT…ZHTRANS-CRIBEZHTIMES-TAMPSWLTMy0.15catAudio EncoderInput Training Data                       Multi-language transcription“What work are you doing now?”<|0.00|>What<|0.23|>work<|0.43|>are<|0.45|><|SIL|><|0.51|>…                     Any-to-any translation“我记得我当时队友的反应，跟我差不多同时间登顶的队友”I remember the reaction of my teammates, who reached …                      Audio caption analysis(Background birds chirping and music playing)A guitar tune is played with birds chirping in the background.                      Audio keyword analysis(A man speaks Chinese)Chinese, male speech                       Audio question and answer(Sound of a car)Q:Are the sounds outside? A: Yes. START OFTRANSCRIPTIONSTART OF ANALYSISAudio Language TagTask TagCAPTIONKEYWORDTRANSCRIBETRANSLATEQUESTIONText Language TagOutput InstructionUNKNOWNZHENFRDEJAITESKOZHENFRDEJAITESKOWORD LEVEL TRANSCRIPTIONTRANSCRIPTION WITH ENTITYquestion…OrTimestamps TagMulti-Task Training Format
Qwen-Audio