Citation

Kelly P, O'Connor NE, Smeaton AF. IEEE Trans. Circ. Syst. Video Tech. 2008; 18(8): 1163-1167.

Copyright

(Copyright © 2008, IEEE Circuits and Systems Society)

DOI

10.1109/TCSVT.2008.928228

PMID

unavailable

Abstract

Automated pedestrian detection, counting, and tracking have received significant attention in the computer vision community of late. As such, a variety of techniques have been investigated using both traditional 2-D computer vision tech- niques and, more recently, 3-D stereo information. However, to date, a quantitative assessment of the performance of stereo-based pedestrian detection has been problematic, mainly due to the lack of standard stereo-based test data and an agreed methodology for carrying out the evaluation. This has forced researchers into making subjective comparisons between competing approaches. In this paper, we propose a framework for the quantitative evalu- ation of a short-baseline stereo-based pedestrian detection system. We provide freely available synthetic and real-world test data and recommend a set of evaluation metrics. This allows researchers to benchmark systems, not only with respect to other stereo-based approaches, but also with more traditional 2-D approaches. In order to illustrate its usefulness, we demonstrate the application of this framework to evaluate our own recently proposed technique for pedestrian detection and tracking. Index Terms--Benchmarking, disparity estimation, evaluation,