Multi-user augmented reality with communication efficient and spatially consistent virtual objects

Conference Paper

Multi-user augmented reality (AR), where multiple co-located users view a common set of virtual objects, is becoming increasingly popular. For example, Google Just a Line allows multiple users to draw virtual graffiti in the same physical space. Multi-user AR requires network communications in order to coordinate the positions of the virtual objects on each user's display, yet there is currently little understanding of how such apps communicate. In this work, we address this key gap in knowledge by showing that the communicated data directly impacts the latency and positioning of the virtual objects rendered on the users' displays. We develop solutions to these problems that we find along three facets: (1) efficient communication strategies that trade off communication latency for spatial consistency of the virtual objects; (2) a new metric that enables mobile AR devices to update their virtual objects as they move around and observe more of the scene; and (3) a tool to automatically quantify how much the virtual objects' positions inadvertently change in time and space. Our evaluation is performed on Android smartphones running open-source AR. The results show that our system, SPAR, can decrease the latency by up to 55%, while decreasing the spatial inconsistency by up to 60%, compared to baseline methods.

Full Text

Duke Authors

Cited Authors

  • Ran, X; Slocum, C; Tsai, YZ; Apicharttrisorn, K; Gorlatova, M; Chen, J

Published Date

  • November 23, 2020

Published In

  • Conext 2020 Proceedings of the 16th International Conference on Emerging Networking Experiments and Technologies

Start / End Page

  • 386 - 398

International Standard Book Number 13 (ISBN-13)

  • 9781450379489

Digital Object Identifier (DOI)

  • 10.1145/3386367.3431312

Citation Source

  • Scopus