TY - JOUR
T1 - Multimodal Feature Fusion Based Encrypted Malicious Network Traffic Detecting Approach
T2 - Generalizable Models Design
AU - Zhang, Xiang
AU - Zhang, Tiankui
AU - Wang, Bingrong
AU - Cheng, Weiqiang
AU - Wang, Yapeng
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2026
Y1 - 2026
N2 - With the development of emerging network technologies and new network protocols, such as industrial Internet, mobile Internet of things and low-altitude intelligent connection networks, the network environments are becoming increasingly complex, posing a severe challenge to the identification of malicious network traffic. Existing deep learning-based approaches often rely on a single feature modality, making it difficult to fully describe the multidimensional behavior patterns of network traffic, thus limiting their generalization ability. To address this challenge, this paper proposes a multimodal feature fusion-based approach for detecting encrypted malicious traffic. The proposed approach treats the packet sequence of network traffic as a text sequence to extract its text modality features, and stacks the original byte stream as an image to extract its image modality features. On the one hand, the text modality uses an attention mechanism to model the relationships between packets within a flow. On the other hand, the image modality employs a segmented Vision Transformer to learn communication patterns from byte-level information such as protocol fields. Then, the inter-flow information and communication pattern information are fused to achieve a deep representation of traffic behavior patterns. In the proposed approach, we design anonymization experiments and corresponding feature extraction strategies to ensure the effectiveness and generalization of the extracted features. Experimental results on five public datasets show that the proposed approach outperforms benchmarks, especially in the task of malicious traffic identification in heterogeneous network environments, with recognition accuracy exceeding 95%.
AB - With the development of emerging network technologies and new network protocols, such as industrial Internet, mobile Internet of things and low-altitude intelligent connection networks, the network environments are becoming increasingly complex, posing a severe challenge to the identification of malicious network traffic. Existing deep learning-based approaches often rely on a single feature modality, making it difficult to fully describe the multidimensional behavior patterns of network traffic, thus limiting their generalization ability. To address this challenge, this paper proposes a multimodal feature fusion-based approach for detecting encrypted malicious traffic. The proposed approach treats the packet sequence of network traffic as a text sequence to extract its text modality features, and stacks the original byte stream as an image to extract its image modality features. On the one hand, the text modality uses an attention mechanism to model the relationships between packets within a flow. On the other hand, the image modality employs a segmented Vision Transformer to learn communication patterns from byte-level information such as protocol fields. Then, the inter-flow information and communication pattern information are fused to achieve a deep representation of traffic behavior patterns. In the proposed approach, we design anonymization experiments and corresponding feature extraction strategies to ensure the effectiveness and generalization of the extracted features. Experimental results on five public datasets show that the proposed approach outperforms benchmarks, especially in the task of malicious traffic identification in heterogeneous network environments, with recognition accuracy exceeding 95%.
KW - Deep learning
KW - Malicious network traffic detection
KW - Multimodal fusion
KW - Traffic analysis
UR - https://www.scopus.com/pages/publications/105048735167
U2 - 10.1109/JIOT.2026.3725511
DO - 10.1109/JIOT.2026.3725511
M3 - Article
AN - SCOPUS:105048735167
SN - 2327-4662
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
ER -