Deep Learning Models for Rotated Object Detection in Aerial Images: Survey and Performance Comparisons

Rotated object detection in aerial images presents unique challenges due to the variability in object orientation and aspect ratios. In object detection, the common practice is to use boxes to enclose the spatial locations of discovered objects. Traditionally, these bounding boxes are rectangular in shape with edges parallel to the horizontal or vertical axes. However, with the ever-increasing content complexity of images, it would be desirable to rotate these bounding boxes properly to better fit the sizes and shapes of all semantic object locations in images with random orientations. Lately, through different deep learning model developments, there are noticeable improvements on the detection of rotated objects in images. Certainly, it always faces challenges with the most stringent expectations and accuracy requirements. Hence, the primary objective of this study is to analyze and compare state-of-the-art methodologies for rotated object detection in aerial imagery, and provide a comprehensive survey of the latest research status of it. From four different working principles, we systematically review recent advancements in deep learning architectures, including R-CNN variants, YOLO variants and Transformer variants adapted for rotated bounding boxes. Then we further carry out quantitative performance comparisons among the latest state-of-the-art rotated object detection algorithms using the benchmark dataset DOTA and computing facility. Among them, the RTMDet^a outperforms all other models^b. There are numerous important applications based on aerial images, for example, urban management, precision agriculture, environment monitoring, emergency rescue, and disaster relief, etc. This study contributes to advancing the understanding of rotated object detection in aerial imagery by providing insights into effective methodologies and highlighting areas for future research. The findings guide practitioners and researchers in selecting appropriate techniques for applications requiring robust rotated object detection in challenging aerial environments.