An Experimental Protocol for Benchmarking Robotic Indoor Navigation

Abstract
Robot navigation is one of the most studied problems in robotics and the key capability for robot autonomy. Navigation techniques have become more and more reliable, but evaluation mainly focused on individual navigation components (i.e., mapping, localization, and planning) using datasets or simulations. The goal of this paper is to define an experimental protocol to evaluate the whole navigation system, deployed in a real environment. To ensure repeatability and reproducibility of experiments, our benchmark protocol provides detailed definitions and controls the environment dynamics. We define standardized environments and introduce the concept of a reference robot to allow comparison between different navigation systems at different experimentation sites. We present applications of our protocol in experiments in two different research groups, showing the usefulness of the benchmark.

@incollection{sprunk14iser,
  author = {Christoph Sprunk and Joerg Roewekaemper and Gershon Parent and Luciano Spinello and Gian Diego Tipaldi and Wolfram Burgard and Mihai Jalobeanu},
  title = {An Experimental Protocol for Benchmarking Robotic Indoor Navigation},
  booktitle = {Experimental Robotics},
  volume = {109},
  pages = {487--504},
  year = 2015,
  doi = {10.1007/978-3-319-23778-7_32},
  publisher = {Springer International Publishing},
  isbn = {978-3-319-23777-0},
  editor = {Hsieh, M. Ani and Khatib, Oussama and Kumar, Vijay},
  series = {Springer Tracts in Advanced Robotics}
}
Powered by bibtexbrowser
Back to Publications