Abstract
Image fusion aims to synthesize high-quality representations by integrating complementary information from multimodal sources. While recent deep learning approaches have explored spectral domain learning to overcome the localized receptive fields of spatial convolutions, they predominantly rely on the standard Fourier Transform. However, two critical bottlenecks remain: standard Fourier bases assume signal stationarity (ill-suited for non-stationary natural images) and lack adaptive frequency-adaptive feature weighting, leading to spectral leakage, ineffective high-frequency-noise decoupling, and texture smoothing. To break these limitations, we propose the Fractional-Order Dynamic Perceptive Y-Net (FDP Y-Net), a unified framework driven by Controllable Fractional Fourier Transform (FrFT) Convolutions. By generalizing the spectral domain, our model adaptively rotates the time-frequency axis to optimally represent non-stationary features and dynamically weights frequency components. Specifically, a Dynamic Perceptive Module spatially localizes salient regions, the Controllable FrFT Block captures time-varying spectral characteristics, and an Information Enhancement Module explicitly reconstructs high-frequency residuals. Orchestrated within a Y-shaped architecture with specialized skip connections, these components ensure holistic feature fusion. Extensive experiments across Infrared-Visible, Medical, and Multifocus datasets demonstrate that FDP Y-Net effectively resolves spectral limitations and frequency weighting deficiencies, achieving state-of-the-art performance in visual fidelity and quantitative metrics.
| Original language | English |
|---|---|
| Journal | IEEE Transactions on Consumer Electronics |
| DOIs | |
| Publication status | Accepted/In press - 2026 |
Keywords
- Dynamic Perception
- Fractional Fourier Transform (FrFT)
- High-frequency Enhancement
- Image Fusion
- Non-stationary Signal Processing
Fingerprint
Dive into the research topics of 'Controllable FrFT-Driven Y-Net for Cross-Modal Image Fusion Scenarios'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver