Hypothesis Testing Based Tracking with Spatio-Temporal Joint Interaction Modeling

Hao Sheng, Yang Zhang, Yubin Wu, Shuai Wang, Weifeng Lyu, Wei Ke, Zhang Xiong

Research output: Contribution to journalArticlepeer-review

31 Citations (Scopus)


Data association is one of the key research in tracking-by-detection framework. Due to frequent interactions among targets, there are various relationships among trajectories in crowded scenes which leads to problems in data association, such as association ambiguity, association omission, etc. To handle these problems, we propose hypothesis-testing based tracking (HTBT) framework to build potential associations between target by constructing and testing hypotheses. In addition, a spatio-temporal interaction graph (STIG) model is introduced to describe the basic interaction patterns of trajectories and test the potential hypotheses. Based on network flow optimization, we formulate offline tracking as a MAP problem. Experimental results show that our tracking framework improves the robustness of tracklet association when detection failure occurs during tracking. On the public MOT16, MOT17 and MOT20 benchmark, our method achieves competitive results compared with other state-of-the-art methods.

Original languageEnglish
Article number9072184
Pages (from-to)2971-2983
Number of pages13
JournalIEEE Transactions on Circuits and Systems for Video Technology
Issue number9
Publication statusPublished - Sept 2020


  • Multi-object tracking
  • hypothesis testing
  • interaction modeling
  • network flow
  • tracking-by-detection


Dive into the research topics of 'Hypothesis Testing Based Tracking with Spatio-Temporal Joint Interaction Modeling'. Together they form a unique fingerprint.

Cite this