DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Gui-Song XiaXiang BaiJian DingZhen ZhuSerge BelongieJiebo LuoMihai DatcuMarcello PelilloLiangpei Zhang
Presents DOTA, a large-scale aerial object detection benchmark featuring over 188,000 oriented bounding-box annotations across 15 categories, providing standard baseline evaluations for detecting multi-scale and arbitrarily oriented objects in Earth observation imagery.
The DOTA dataset was created to overcome the scarcity of large, realistic benchmarks for object detection in aerial imagery, where objects vary enormously in scale, orientation, and density and where prior collections were too small or idealized to support robust algorithm development. Researchers assembled 2,806 high-resolution images (roughly 4,000 by 4,000 pixels) from multiple sensors and platforms, then had domain experts label every instance of 15 common categories with oriented quadrilateral boxes rather than axis-aligned rectangles. The resulting collection contains 188,282 instances, far exceeding earlier aerial datasets in both volume and scene complexity.
To establish performance baselines, the authors adapted and ran leading detectors—including Faster R-CNN, R-FCN, YOLOv2, and SSD—on two tasks: predicting horizontal boxes and predicting oriented boxes. Images were tiled into manageable patches for training and testing, after which results were merged and filtered with non-maximum suppression. Cross-dataset experiments further tested generalization by training on DOTA and evaluating on UCAS-AOD, and vice versa.
The experiments show that even the strongest current detectors achieve only modest accuracy on DOTA, with mean average precision ranging from roughly 30 percent to 60 percent on horizontal-box detection and dropping further when oriented boxes are required. Performance is especially weak on small, densely packed objects such as vehicles and ships, while larger, isolated categories fare better. Using oriented boxes improves localization in crowded or rotated scenes but exposes limitations in existing region-proposal and regression mechanisms. Cross-dataset tests confirm that DOTA contains a broader range of patterns than earlier collections and remains substantially harder.
These results indicate that aerial object detection cannot be solved by simply fine-tuning natural-scene models; new techniques are needed to handle extreme scale variation, arbitrary orientations, and high instance density within very large images. The dataset therefore supplies both a realistic training resource and a demanding benchmark that can guide development of detectors suitable for remote-sensing applications such as tracking, mapping, and autonomous navigation.
Future work should focus on architectures that explicitly model orientation and density, on efficient processing of full-resolution imagery without heavy cropping, and on continued expansion of DOTA to reflect evolving sensor and scene conditions. The main limitations are the computational overhead of handling gigapixel-scale images and the remaining performance gap on the hardest categories, which suggests that reported baselines should be treated as starting points rather than production-ready solutions.
- Paper: Rich feature hierarchies for accurate object detection and semantic segmentation, Ross Girshick et al. (2014). Reading R-CNN provides the foundational understanding of region-based object detection using deep convolutional networks that the source builds upon for aerial imagery.
- Paper: Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, Shaoqing Ren et al. (2015). Understanding Faster R-CNN is crucial as the source uses its object detection architecture and evaluation baselines to measure performance on aerial datasets.
- Paper: ImageNet Large Scale Visual Recognition Challenge, Olga Russakovsky et al. (2014). Familiarity with the ImageNet benchmark framework is necessary to appreciate how large-scale visual recognition standards inform the collection and evaluation of the DOTA dataset.
- Paper: SSD: Single Shot MultiBox Detector, W. Liu et al. (2015). Reviewing single-stage detectors like SSD offers essential context for the detection algorithms evaluated against the diverse scales and orientations present in DOTA.
- Paper: Mask R-CNN, Kaiming He et al. (2017). Mask R-CNN extends object detection frameworks to instance segmentation, building directly upon the bounding box detection concepts established in datasets like DOTA.
- Paper: Grounded Language-Image Pre-training, Liunian Harold Li et al. (2022). Grounded Language-Inclusive Pre-training continues the work of object detection datasets by transferring learned representations to specialized domains such as aerial imagery.
- Paper: Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression, Zhaohui Zheng et al. (2019). Distance-IoU Loss directly improves upon standard bounding-box regression techniques used in baseline detectors evaluated within large-scale aerial benchmarks like DOTA.
