Task-oriented communication for graph data: A graph information bottleneck approach

Li, Shujing; Wang, Yanhu; Guo, Shuaishuai; Feng, Chenyuan
IEEE Transactions on Cognitive Communications and Networking (TCCN), 1 August 2024

Graph data, essential in fields like knowledge rep-resentation and social networks, often involves large networks with many nodes and edges. Transmitting these graphs can be highly inefficient due to their size and redundancy for specific tasks. This paper introduces a method to extract a smaller, task-focused subgraph that maintains key information while reducing communication overhead. Our approach utilizes graph neural networks (GNNs) and the graph information bottleneck (GIB) principle to create a compact, informative, and robust graph representation suitable for transmission. The challenge lies in the irregular structure of graph data, making GIB optimization complex. We address this by deriving a tractable variational upper bound for the objective function. Additionally, we propose the VQ-GIB mechanism, integrating vector quantization (VQ) to convert subgraph representations into a discrete codebook se-quence, compatible with existing digital communication systems. Our experiments show that this GIB-based method significantly lowers communication costs while preserving essential task-related information. The approach demonstrates robust perfor-mance across various communication channels, suitable for both continuous and discrete systems.


Type:
Journal
Date:
2024-08-01
Department:
Communication systems
Eurecom Ref:
7850
Copyright:
© 2024 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
See also:

PERMALINK : https://www.eurecom.fr/publication/7850