TY - JOUR
T1 - Bridging structural and statistical heterogeneity
T2 - a unified DFL framework via column-wise aggregation and consensus-aware topology
AU - Liu, Su
AU - Shen, Hong
AU - Law, Ka Lun Eddie
AU - LAM, Chan Tong
N1 - Publisher Copyright:
© The Author(s) 2026.
PY - 2026/8
Y1 - 2026/8
N2 - Decentralized Federated Learning (DFL) is an emerging paradigm that enables collaborative model training across distributed clients without relying on a central parameter server. However, deploying DFL in realistic edge environments faces two critical limitations: structural heterogeneity among local models due to varying computational capabilities of client nodes, and model divergence caused by statistical heterogeneity (non-IID data) within static or inefficient communication topologies. While prior works have tackled these challenges individually, a unified perspective on their synergistic optimization is still lacking. In this paper, we introduce ColADTM-DFL framework, which jointly addresses structural and statistical heterogeneity in a single system workflow. First, ColADTM-DFL enables each node to train a width-adaptive submodel while ensuring semantically aligned parameter fusion. Then, considering the model divergence exacerbated by statistical heterogeneity, our framework defines Consensus Distance to quantify inter-node model discrepancy. Leveraging this metric, we present a consensus-aware topology algorithm, which dynamically restructures the communication graph to minimize global divergence while reducing redundant communication cost. Extensive experiments across heterogeneous edge settings demonstrate that our method significantly accelerates time-to-target accuracy, as well as reduces communication cost by up to 46.3% under the same resource budget compared to baselines.
AB - Decentralized Federated Learning (DFL) is an emerging paradigm that enables collaborative model training across distributed clients without relying on a central parameter server. However, deploying DFL in realistic edge environments faces two critical limitations: structural heterogeneity among local models due to varying computational capabilities of client nodes, and model divergence caused by statistical heterogeneity (non-IID data) within static or inefficient communication topologies. While prior works have tackled these challenges individually, a unified perspective on their synergistic optimization is still lacking. In this paper, we introduce ColADTM-DFL framework, which jointly addresses structural and statistical heterogeneity in a single system workflow. First, ColADTM-DFL enables each node to train a width-adaptive submodel while ensuring semantically aligned parameter fusion. Then, considering the model divergence exacerbated by statistical heterogeneity, our framework defines Consensus Distance to quantify inter-node model discrepancy. Leveraging this metric, we present a consensus-aware topology algorithm, which dynamically restructures the communication graph to minimize global divergence while reducing redundant communication cost. Extensive experiments across heterogeneous edge settings demonstrate that our method significantly accelerates time-to-target accuracy, as well as reduces communication cost by up to 46.3% under the same resource budget compared to baselines.
KW - Consensus distance
KW - Decentralized federated learning
KW - Dynamic topology construction
KW - Heterogeneous computation resources
UR - https://www.scopus.com/pages/publications/105046585048
U2 - 10.1007/s44443-026-00911-3
DO - 10.1007/s44443-026-00911-3
M3 - Article
AN - SCOPUS:105046585048
SN - 1319-1578
VL - 38
JO - Journal of King Saud University - Computer and Information Sciences
JF - Journal of King Saud University - Computer and Information Sciences
IS - 6
M1 - 502
ER -