TY - JOUR
T1 - An attention-based balanced variational autoencoder method for credit card fraud detection
AU - Shi, Si
AU - Luo, Wuman
AU - Pau, Giovanni
N1 - Publisher Copyright:
© 2025 The Authors
PY - 2025/6
Y1 - 2025/6
N2 - Credit card fraud detection poses a significant role in both academia and industries. Conventionally, manual checking is time-consuming and not accurate. With the advent of artificial intelligence (AI), numerous machine-learning approaches have emerged. Most of them are proven effective and efficient, especially those based on attention mechanisms. However, the highly imbalanced distribution of normal and fraudulent transactions increases the hardness of further performance improvement. So far, there exist three issues in current contributions: 1) the existing oversampling methods did not fully consider the imbalanced distribution theoretically; 2) the current methods neglected the importance of features and did not mine helpful information from them; 3) the layers of current attention-based methods are too shallow to capture enough characteristics of data. To address the above issues, we propose a novel method: Balanced-Variational AutoEncoder-Attention (Bal-VAE-Attention), which can significantly boost the existing fraud detection results. In our approach, we design a novel oversampling method that considers the imbalanced data distribution. Moreover, we apply an automatic feature selection procedure. Also, we deploy a deep multi-head attention structure to depict the complex inner structure of fraudulent data. We implement abundant experiments on two open-source credit card fraud datasets. Through substantial experiments and ablation study, we prove our proposed method's effectiveness. To the best of our knowledge, it is superior to other state-of-the-art credit card fraud detection baselines.
AB - Credit card fraud detection poses a significant role in both academia and industries. Conventionally, manual checking is time-consuming and not accurate. With the advent of artificial intelligence (AI), numerous machine-learning approaches have emerged. Most of them are proven effective and efficient, especially those based on attention mechanisms. However, the highly imbalanced distribution of normal and fraudulent transactions increases the hardness of further performance improvement. So far, there exist three issues in current contributions: 1) the existing oversampling methods did not fully consider the imbalanced distribution theoretically; 2) the current methods neglected the importance of features and did not mine helpful information from them; 3) the layers of current attention-based methods are too shallow to capture enough characteristics of data. To address the above issues, we propose a novel method: Balanced-Variational AutoEncoder-Attention (Bal-VAE-Attention), which can significantly boost the existing fraud detection results. In our approach, we design a novel oversampling method that considers the imbalanced data distribution. Moreover, we apply an automatic feature selection procedure. Also, we deploy a deep multi-head attention structure to depict the complex inner structure of fraudulent data. We implement abundant experiments on two open-source credit card fraud datasets. Through substantial experiments and ablation study, we prove our proposed method's effectiveness. To the best of our knowledge, it is superior to other state-of-the-art credit card fraud detection baselines.
KW - Attention mechanism
KW - Data augmentation
KW - Fraud detection
KW - Variational autoencoder
UR - http://www.scopus.com/inward/record.url?scp=105004066446&partnerID=8YFLogxK
U2 - 10.1016/j.asoc.2025.113190
DO - 10.1016/j.asoc.2025.113190
M3 - Article
AN - SCOPUS:105004066446
SN - 1568-4946
VL - 177
JO - Applied Soft Computing Journal
JF - Applied Soft Computing Journal
M1 - 113190
ER -