CollabAR: edge-assisted collaborative image recognition for mobile augmented reality


Conference Paper

© 2020 IEEE. Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, an image recognition system that can accurately recognize the object in the camera view with low system latency is required. However, due to the pervasiveness and severity of image distortions, an effective and robust image recognition solution for mobile AR is still elusive. In this paper, we present CollabAR, an edge-assisted system that provides distortion-tolerant image recognition for mobile AR with imperceptible system latency. CollabAR incorporates both distortion-tolerant and collaborative image recognition modules in its design. The former enables distortion-adaptive image recognition to improve the robustness against image distortions, while the latter exploits the 'spatialoral' correlation among mobile AR users to improve recognition accuracy. We implement CollabAR on four different commodity devices, and evaluate its performance on two multi-view image datasets. Our evaluation demonstrates that CollabAR achieves over 96% recognition accuracy for images with severe distortions, while reducing the end-to-end system latency to as low as 17.8ms for commodity mobile devices.

Full Text

Duke Authors

Cited Authors

  • Liu, Z; Lan, G; Stojkovic, J; Zhang, Y; Joe-Wong, C; Gorlatova, M

Published Date

  • April 1, 2020

Published In

  • Proceedings 2020 19th Acm/Ieee International Conference on Information Processing in Sensor Networks, Ipsn 2020

Start / End Page

  • 301 - 312

International Standard Book Number 13 (ISBN-13)

  • 9781728154978

Digital Object Identifier (DOI)

  • 10.1109/IPSN48710.2020.00-26

Citation Source

  • Scopus