SOMPT22

A Surveillance Oriented Multi-Pedestrian Tracking Dataset

SOMPT22

Fatih Emre Simsek1,2   Cevahir Cigla1   Koray Kayabol2

1Aselsan Inc.   2Gebze Technical University

Paper  link Download Dataset  link Leaderboard  link Submit Results  link GitHub  github

Abstract

Multi-object tracking (MOT) has been dominated by the use of track by detection approaches due to the success of convolutional neural networks (CNNs) on detection in the last decade. As the datasets and bench-marking sites are published, research direction has shifted towards yielding best accuracy on generic scenarios including re-identification (reID) of objects while tracking. In this study, we narrow the scope of MOT for surveillance by providing a dedicated dataset of pedestrians and focus on in-depth analyses of well performing multi-object trackers to observe the weak and strong sides of state-of-the-art (SOTA) techniques for real-world applications. For this purpose, we introduce SOMPT22 dataset; a new set for multi person tracking with annotated short videos captured from static cameras located on poles with 6-8 meters in height positioned for city surveillance. This provides a more focused and specific benchmarking of MOT for outdoor surveillance compared to public MOT datasets. We analyze MOT trackers classified as one-shot and two-stage with respect to the way of use of detection and reID networks on this new dataset. The experimental results of our new dataset indicate that SOTA is still far from high efficiency, and single-shot trackers are good candidates to unify fast execution and accuracy with competitive performance.

Benchmark Challenge

We host an open benchmark challenge for multi-pedestrian tracking on the SOMPT22 test set. Submit your tracker’s results and get your scores computed automatically — rankings are updated live.

View Leaderboard  link How to Submit  link

Dataset

Training set videos and annotations are publicly available. The test set (images only, no GT) is used for the benchmark challenge.

Download Training Set  link

Detection & Tracking Datasets

SOMPT22 Statistics

Experiment Setup

Benchmark Results

Citation

@misc{simsek2022sompt22,
  doi       = {10.48550/ARXIV.2208.02580},
  url       = {https://arxiv.org/abs/2208.02580},
  author    = {Simsek, Fatih Emre and Cigla, Cevahir and Kayabol, Koray},
  title     = {SOMPT22: A Surveillance Oriented Multi-Pedestrian Tracking Dataset},
  publisher = {arXiv},
  year      = {2022},
  copyright = {Creative Commons Attribution Non Commercial Share Alike 4.0 International}
}

License

The annotations of SOMPT22 are licensed under a Creative Commons Attribution 4.0 License. The dataset of SOMPT22 is available for non-commercial research purposes only. All videos and images of SOMPT22 are obtained from the Internet.