A Comparison of Affine Region Detectors
K. MikolajczykT. TuytelaarsCordelia SchmidAndrew ZissermanJiri MatasF. SchaffalitzkyT. KadirL. Gool
Establishes the standard benchmark dataset and quantitative evaluation protocol for assessing affine covariant region detectors across diverse imaging transformations, providing systematic performance comparisons of leading methods like MSER, Harris-Affine, and Hessian-Affine.
This paper evaluates and compares six affine covariant region detectors developed for robust local feature matching in computer vision applications such as wide-baseline stereo, object recognition, image retrieval, and robot localization. These detectors identify image regions whose shape adapts automatically to viewpoint and illumination changes so that the same physical surface patch can be described consistently across images. The work addresses the lack of standardized performance data by testing the detectors on a shared benchmark of planar scenes under controlled transformations.
The study set out to measure how well each detector finds repeatable and distinctive regions across changes in viewpoint, scale, blur, compression, and illumination, while also establishing public test images and evaluation code for future comparisons.
The authors implemented the detectors using code supplied by their creators and ran them on eight image sequences containing both structured scenes with distinct edges and textured scenes with repeated patterns. Repeatability was quantified by projecting detected elliptical regions through known homographies and measuring normalized overlap error. Distinctiveness was assessed by attaching 128-dimensional SIFT descriptors to the regions and counting correct nearest-neighbor matches.
MSER and Hessian-Affine detectors achieved the highest repeatability scores on most sequences, often exceeding 60 percent for moderate viewpoint or scale changes and remaining above 40 percent for larger deformations; Harris-Affine followed closely, while edge-based, intensity-extrema, and salient-region detectors performed well only on particular scene types. Absolute numbers of repeatable regions also varied widely, with Hessian-Affine and Harris-Affine typically returning several times more correspondences than the others. Matching scores using SIFT descriptors tracked the repeatability results for most transformations, indicating that the regions are sufficiently distinctive for automatic correspondence, although performance degraded noticeably on highly repetitive textures or under strong blur.
These results matter because practitioners can now select or combine detectors according to scene characteristics and application constraints rather than relying on anecdotal evidence. The public benchmark further enables objective progress tracking as new detectors appear.
The authors recommend running several complementary detectors in parallel to increase coverage and robustness, then filtering matches with geometric consistency checks. They also note that future detectors should be evaluated on the same data and protocol.
The evaluation is restricted to planar scenes or fixed-camera sequences related by homographies, uses default parameter settings, and measures performance only on the supplied medium-resolution images; results on non-planar 3D scenes or very different image statistics may differ. Overall confidence in the reported ordering of detectors on the tested conditions is high because the protocol is transparent, the data are public, and multiple performance metrics were examined.
- Paper: A performance evaluation of local descriptors, Krystian Mikolajczyk et al. (2005). Reading this evaluation of local descriptors first provides the necessary background on how feature representations are paired with the affine region detectors evaluated in the source paper.
- Paper: SURF: Speeded Up Robust Features, Herbert Bay et al. (2006). This paper builds directly upon the foundational affine and scale-invariant detectors benchmarked in the source by introducing faster approximate detector-descriptor designs.
- Paper: BRIEF: Binary Robust Independent Elementary Features, Michael Calonder et al. (2010). This paper extends the local feature paradigm established by the source and its contemporaries into ultra-fast binary descriptors suitable for resource-constrained platforms.
