Please use this identifier to cite or link to this item:
https://bura.brunel.ac.uk/handle/2438/32054Full metadata record
| DC Field | Value | Language |
|---|---|---|
| dc.contributor.author | Peng, Yubo | - |
| dc.contributor.author | Xiang, Luping | - |
| dc.contributor.author | Yang, Kun | - |
| dc.contributor.author | Jiang, Feibo | - |
| dc.contributor.author | Wang, Kezhi | - |
| dc.contributor.author | Wu, Dapeng Oliver | - |
| dc.date.accessioned | 2025-09-26T19:57:11Z | - |
| dc.date.available | 2025-09-26T19:57:11Z | - |
| dc.date.issued | 2025-09-16 | - |
| dc.identifier | ORCiD: Yubo Peng https://orcid.org/0000-0001-9684-2971 | - |
| dc.identifier | ORCiD: Luping Xiang https://orcid.org/0000-0003-1465-6708 | - |
| dc.identifier | ORCiD: Kun Yang https://orcid.org/0000-0002-6782-6689 | - |
| dc.identifier | ORCiD: Feibo Jiang https://orcid.org/0000-0002-0235-0253 | - |
| dc.identifier | ORCiD: Kezhi Wang https://orcid.org/0000-0001-8602-0800 | - |
| dc.identifier | ORCiD: Dapeng Oliver Wu https://orcid.org/0000-0003-1755-0183 | - |
| dc.identifier.citation | Peng, Y. et al. (2026) 'SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Framework', IEEE Journal on Selected Areas in Communications, 44, pp. 673–688. doi: 10.1109/jsac.2025.3610398. | en_US |
| dc.identifier.issn | 0733-8716 | - |
| dc.identifier.uri | https://bura.brunel.ac.uk/handle/2438/32054 | - |
| dc.description.abstract | Traditional unimodal sensing faces limitations in accuracy and capability, and its decoupled implementation with communication systems increases latency in bandwidth-constrained environments. Additionally, single-task-oriented sensing systems fail to address users’ diverse demands. To overcome these challenges, we propose a semantic-driven integrated multimodal sensing and communication (SIMAC) framework. This framework leverages a joint source-channel coding architecture to achieve simultaneous sensing, decoding, and transmission of sensing results. Specifically, SIMAC first introduces a multimodal semantic fusion (MSF) network, which employs two extractors to extract semantic information from radar signals and images, respectively. MSF then applies cross-attention mechanisms to fuse these unimodal features and generate multimodal semantic representations. Secondly, we present a large language model (LLM)-based semantic encoder (LSE), where relevant communication parameters and multimodal semantics are mapped into a unified latent space and input to the LLM, enabling channel-adaptive semantic encoding. Thirdly, a task-oriented sensing semantic decoder (SSD) is proposed, in which different decoded heads are designed according to the specific needs of tasks. Simultaneously, a multi-task learning strategy is introduced to train the SIMAC framework, achieving diverse sensing services. Finally, experimental simulations demonstrate that the proposed framework achieves diverse and higher-accuracy sensing services. | en_US |
| dc.description.sponsorship | Jiangsu Major Project on Fundamental Research (Grant Number: BK20243059) | - |
| dc.description.sponsorship | Gusu Innovation Project (Grant Number: ZXL2024360) | - |
| dc.description.sponsorship | High-Tech District of Suzhou City (Grant Number: RC2025001) | - |
| dc.description.sponsorship | 10.13039/501100001809-National Natural Science Foundation of China (Grant Number: 62132004 and 62301122) | - |
| dc.description.sponsorship | Major Program Project of Xiangjiang Laboratory (Grant Number: XJ2023001 and XJ2022001) | - |
| dc.description.sponsorship | 10.13039/100017413-Qiyuan Laboratory Innovation Fund (Grant Number: 2022-JCJQ-LA-001-088) | - |
| dc.description.sponsorship | SEC | - |
| dc.format.extent | pp. 673–688 | - |
| dc.format.medium | Print-Electronic | - |
| dc.language.iso | en_US | en_US |
| dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_US |
| dc.rights | Re-use licence for this version: Creative Commons Attribution 4.0 International | - |
| dc.rights | Licence for published version: Publisher's own licence | - |
| dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | - |
| dc.subject | integrated multimodal sensing and communications | en_US |
| dc.subject | semantic communication | en_US |
| dc.subject | large language model | en_US |
| dc.subject | multi-task learning | en_US |
| dc.title | SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Framework | en_US |
| dc.type | Article | en_US |
| dc.date.dateAccepted | 2025-09-07 | - |
| dc.identifier.doi | https://doi.org/10.1109/jsac.2025.3610398 | - |
| dc.relation.isPartOf | IEEE Journal on Selected Areas in Communications | en_US |
| pubs.publication-status | Published | - |
| pubs.volume | 44 | - |
| dc.identifier.eissn | 1558-0008 | - |
| dc.rights.license | https://creativecommons.org/licenses/by/4.0/legalcode.en | - |
| dcterms.dateAccepted | 2025-09-07 | - |
| dcterms.issued | 2025-09-16 | - |
| dc.rights.holder | The Author(s) | - |
| dc.contributor.orcid | Peng, Yubo [0000-0001-9684-2971] | - |
| dc.contributor.orcid | Xiang, Luping [0000-0003-1465-6708] | - |
| dc.contributor.orcid | Yang, Kun [0000-0002-6782-6689] | - |
| dc.contributor.orcid | Jiang, Feibo [0000-0002-0235-0253] | - |
| dc.contributor.orcid | Wang, Kezhi [0000-0001-8602-0800] | - |
| dc.contributor.orcid | Wu, Dapeng Oliver [0000-0003-1755-0183] | - |
| Appears in Collections: | Department of Computer Science Research Papers | |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| FullText.pdf | “For the purpose of open access, the author(s) has applied a Creative Commons Attribution (CC BY) license to any Accepted Manuscript version arising.” | 7.56 MB | Adobe PDF | View/Open |
This item is licensed under a Creative Commons License