Rethinking Generative Semantic Communication for Multi-User Systems with Multi-Modal LLM
<|reference_start|>Rethinking Generative Semantic Communication for Multi-User Systems with Multi-Modal LLM: The surge in connected devices in 6G with typical massive access scenarios, such as smart agriculture, and smart cities, poses significant challenges to unsustainable traditional communication with limited radio resources and already high system complexity. Fortunately, the booming artificial intelligence technology and the growing computational power of devices offer a promising 6G enabler: semantic communication (SemCom). However, existing deep learning-based SemCom paradigms struggle to extend to multi-user scenarios due to their rigid end-to-end training approach. Consequently, to truly empower 6G networks with this critical technology, this article rethinks generative SemCom for multi-user system with multi-modal large language model (MLLM), and propose a novel framework called "M2GSC". In this framework, the MLLM, which serves as shared knowledge base (SKB), plays three critical roles for complex tasks, spawning a series of benefits such as semantic encoding standardization and semantic decoding personalization. Meanwhile, to enhance the performance of M2GSC framework and to advance its implementation in 6G, we highlight three research directions on M2GSC framework, namely, upgrading SKB to closed loop agent, adaptive semantic encoding offloading, and streamlined semantic decoding offloading. Finally, a case study is conducted to demonstrate the preliminary validation on the effectiveness of the M2GSC framework in terms of streamlined decoding offloading.<|reference_end|>
@article{yang2024rethinking,
    title={Rethinking Generative Semantic Communication for Multi-User Systems with
  Multi-Modal LLM},
    author={Wanting Yang, Zehui Xiong, Shiwen Mao, Tony Q. S. Quek, Ping Zhang,
  Merouane Debbah, Rahim Tafazolli},
    journal={arXiv preprint arXiv:2408.08765},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.08765},
    primaryClass={cs.NI}
}