Wireless Transmission of Images with the Assistance of Multi-level Semantic Information
ID:22 View Protection:ATTENDEE Updated Time:2022-10-11 11:03:18 Hits:530 Oral Presentation

Start Time:2022-10-20 14:00(Asia/Shanghai)

Duration:15min

Session:RS Regular Session » RS6RS6: Novel Communication Techniques

Video No Permission

Tips: Only the registered participant can access the file. Please sign in first.

Abstract
Semantic-oriented communication has been considered a promising method to boost bandwidth efficiency by only transmitting the semantics of the data. In this paper, we propose a multi-level semantic aware communication system for wireless image transmission, named MLSC-image, which is based on deep learning (DL) techniques and trained in an end-to-end manner. In particular, the proposed model includes a multi-level semantic feature extractor, that extracts both the high-level semantic information, such as the text semantics and the segmentation semantics, and the low-level semantic information, such as local spatial details of the images. We employ a pre-trained image caption to capture the text semantics and a pre-trained image segmentation model to obtain the segmentation semantics. These high-level and low-level semantic features are then combined and encoded by a joint semantic and channel encoder into symbols to transmit over the physical channel. The numerical results validate the effectiveness and efficiency of the proposed semantic communication system, especially under the limited bandwidth condition, which indicates the advantages of the high-level semantics in the compression of images.
 
Keywords
Speaker
Zhenguo Zhang
zhejiang university

Submit Comment
Verify Code Change Another
All Comments
Important Date
  • Conference Date

    Oct 19

    2022

    to

    Oct 22

    2022

Sponsored By
Zhejiang University
Organized By
Zhejiang University