Skip to main content
Journal cover image

Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision.

Publication ,  Journal Article
Li, T; Severson, KS; Wang, F; Dunn, TW
Published in: Int J Comput Vis
June 2023

Three-dimensional markerless pose estimation from multi-view video is emerging as an exciting method for quantifying the behavior of freely moving animals. Nevertheless, scientifically precise 3D animal pose estimation remains challenging, primarily due to a lack of large training and benchmark datasets and the immaturity of algorithms tailored to the demands of animal experiments and body plans. Existing techniques employ fully supervised convolutional neural networks (CNNs) trained to predict body keypoints in individual video frames, but this demands a large collection of labeled training samples to achieve desirable 3D tracking performance. Here, we introduce a semi-supervised learning strategy that incorporates unlabeled video frames via a simple temporal constraint applied during training. In freely moving mice, our new approach improves the current state-of-the-art performance of multi-view volumetric 3D pose estimation and further enhances the temporal stability and skeletal consistency of 3D tracking.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Int J Comput Vis

DOI

ISSN

0920-5691

Publication Date

June 2023

Volume

131

Issue

6

Start / End Page

1389 / 1405

Location

United States

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 4611 Machine learning
  • 4607 Graphics, augmented reality and games
  • 4603 Computer vision and multimedia computation
  • 0801 Artificial Intelligence and Image Processing
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Li, T., Severson, K. S., Wang, F., & Dunn, T. W. (2023). Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision. Int J Comput Vis, 131(6), 1389–1405. https://doi.org/10.1007/s11263-023-01756-3
Li, Tianqing, Kyle S. Severson, Fan Wang, and Timothy W. Dunn. “Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision.Int J Comput Vis 131, no. 6 (June 2023): 1389–1405. https://doi.org/10.1007/s11263-023-01756-3.
Li T, Severson KS, Wang F, Dunn TW. Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision. Int J Comput Vis. 2023 Jun;131(6):1389–405.
Li, Tianqing, et al. “Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision.Int J Comput Vis, vol. 131, no. 6, June 2023, pp. 1389–405. Pubmed, doi:10.1007/s11263-023-01756-3.
Li T, Severson KS, Wang F, Dunn TW. Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision. Int J Comput Vis. 2023 Jun;131(6):1389–1405.
Journal cover image

Published In

Int J Comput Vis

DOI

ISSN

0920-5691

Publication Date

June 2023

Volume

131

Issue

6

Start / End Page

1389 / 1405

Location

United States

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 4611 Machine learning
  • 4607 Graphics, augmented reality and games
  • 4603 Computer vision and multimedia computation
  • 0801 Artificial Intelligence and Image Processing