ES-ISC Demo: An explainable semantics-based image semantic communication system for 6G

Ye, Dongshan; Chen, Rundong; Wang, Xijun; Feng, Chenyuan; Chen, Xiang; Quek, Tony Q. S.

Semantic Communication (SeCom) has garnered widespread attention due to its effectiveness and intelligence as an emerging technique. The current image SeCom system, based on Deep Joint Source-Channel Coding (JSCC), requires joint model training at both ends, leading to coupled models that need concurrent updates. Additionally, the semantics transmitted via joint training are feature vectors, which lack interpretability. To address these issues, we design an Explainable Semantics-based Image Semantic Communication (ES-ISC) demo. This demo transforms images into explainable semantic texts and segmentation maps for transmission. By leveraging the univer-sality of these semantic carriers, we facilitate the decoupling of transmitter (TX) and receiver (RX) training without substantially impacting performance. Moreover, the interpretability of the designed semantic carriers supports multiple downstream tasks. Experimental results demonstrate that our system can transmit images with over 100-fold compression while maintaining high-quality reconstruction at the RX.


Type:
Poster / Demo
City:
Hangzhou
Date:
2024-08-07
Department:
Communication systems
Eurecom Ref:
7806
Copyright:
© 2024 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
See also:

PERMALINK : https://www.eurecom.fr/publication/7806