A simple transformer-based baseline for crowd tracking with Sequential Feature Aggregation and Hybrid Group Training

Cui Wang, Zewei Wu, Wei Ke, Zhang Xiong

Research output: Contribution to journalArticlepeer-review

Abstract

Tracking pedestrians in crowded scenes is a challenging task. Existing transformer-based tracking methods integrate detection and tracking into a unified model, which simplifies the tracking process. However, these methods also introduce complicated attention mechanisms that increase the model complexity and cost. To address this issue, we propose SOTTrack, a simple online transformer-based method for crowd tracking. Our method enhances feature learning and training strategies without sacrificing simplicity and efficiency. Specifically, we introduce the Sequential Feature Aggregation (SFA) module and the Hybrid Group Training (HGT) approach. The SFA module fuses features from sequential images to improve the temporal consistency of visual features within short time intervals. The HGT approach assigns different queries to multiple guided tasks, such as label assignment and de-noising, which are only used during training and do not incur any inference cost. We evaluate our method on the MOT17 and MOT20 datasets and demonstrate its competitive performance.

Original languageEnglish
Article number104144
JournalJournal of Visual Communication and Image Representation
Volume100
DOIs
Publication statusPublished - Apr 2024

Keywords

  • Crowd tracking
  • Hybrid Group Training
  • Temporal enhanced representation
  • Transformer-based tracking

Fingerprint

Dive into the research topics of 'A simple transformer-based baseline for crowd tracking with Sequential Feature Aggregation and Hybrid Group Training'. Together they form a unique fingerprint.

Cite this