
Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-Supervision.
Three-dimensional markerless pose estimation from multi-view video is emerging as an exciting method for quantifying the behavior of freely moving animals. Nevertheless, scientifically precise 3D animal pose estimation remains challenging, primarily due to a lack of large training and benchmark datasets and the immaturity of algorithms tailored to the demands of animal experiments and body plans. Existing techniques employ fully supervised convolutional neural networks (CNNs) trained to predict body keypoints in individual video frames, but this demands a large collection of labeled training samples to achieve desirable 3D tracking performance. Here, we introduce a semi-supervised learning strategy that incorporates unlabeled video frames via a simple temporal constraint applied during training. In freely moving mice, our new approach improves the current state-of-the-art performance of multi-view volumetric 3D pose estimation and further enhances the temporal stability and skeletal consistency of 3D tracking.
Duke Scholars
Altmetric Attention Stats
Dimensions Citation Stats
Published In
DOI
ISSN
Publication Date
Volume
Issue
Start / End Page
Location
Related Subject Headings
- Artificial Intelligence & Image Processing
- 4611 Machine learning
- 4607 Graphics, augmented reality and games
- 4603 Computer vision and multimedia computation
- 0801 Artificial Intelligence and Image Processing
Citation

Published In
DOI
ISSN
Publication Date
Volume
Issue
Start / End Page
Location
Related Subject Headings
- Artificial Intelligence & Image Processing
- 4611 Machine learning
- 4607 Graphics, augmented reality and games
- 4603 Computer vision and multimedia computation
- 0801 Artificial Intelligence and Image Processing