Skip to main content

Maria Gorlatova

Nortel Networks Assistant Professor of Electrical and Computer Engineering
Electrical and Computer Engineering
Office hours Mondays 9-11 AM, or by appointment  

Selected Publications


Environment Texture Optimization for Augmented Reality

Journal Article Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · September 9, 2024 Augmented reality (AR) platforms now support persistent, markerless experiences, in which virtual content appears in the same place relative to the real world, across multiple devices and sessions. However, optimizing environments for these experiences rem ... Full text Cite

Augmented Reality-based Contextual Guidance through Surgical Tool Tracking in Neurosurgery.

Journal Article IEEE transactions on visualization and computer graphics · April 2024 External ventricular drain (EVD) is a common, yet challenging neurosurgical procedure of placing a catheter into the brain ventricular system that requires prolonged training for surgeons to improve the catheter placement accuracy. In this paper, we introd ... Full text Cite

Accuracy of routine external ventricular drain placement following a mixed reality-guided twist-drill craniostomy.

Journal Article Neurosurgical focus · January 2024 ObjectiveThe traditional freehand placement of an external ventricular drain (EVD) relies on empirical craniometric landmarks to guide the craniostomy and subsequent passage of the EVD catheter. The diameter and trajectory of the craniostomy physi ... Full text Cite

Quantifying and Exploiting VR Frame Correlations: An Application of a Statistical Model for Viewport Pose

Journal Article IEEE Transactions on Mobile Computing · January 1, 2024 In virtual reality (VR), users' head pose, that is, the location and the orientation of users' viewport, determines the view of the virtual world that is shown to the users. The importance of the viewport pose to VR experienc ... Full text Cite

Did You Do Well? Real-Time Personalized Feedback on Catheter Placement in Augmented Reality-Assisted Neurosurgical Training

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 External ventricular drain (EVD) is a common neurosurgical procedure often performed by junior trainees to relieve pressure buildup inside the brain by inserting a catheter to drain fluid. Recent work shows that the integration of Augmented Reality (AR) im ... Full text Cite

Did I Do Well? Personalized Assessment of Trainees' Performance in Augmented Reality-Assisted Neurosurgical Training

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 The integration of Augmented Reality (AR) with the external ventricular drain (EVD) procedure improves catheter placement accuracy by providing guidance to surgeons through a visualization of the brain ventricular anatomy and other contextual information. ... Full text Cite

AR Simulations in VR: The Case for Environmental Awareness

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 Augmented reality (AR) simulations in virtual reality (VR) provide fully controlled conditions, fewer hardware limitations than on AR devices, and convenient and safe access to diverse settings. However, for VR to be a fully realistic simulator for optical ... Full text Cite

BiGuide: A Bi-level Data Acquisition Guidance for Object Detection on Mobile Devices

Conference Proceedings - 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2024 · January 1, 2024 Object detection (OD) is crucial for numerous emerging visual sensing applications. As OD models trained on unrepresentative data usually yield poor performance, collecting high-quality data in the local environment is recognized to be essential for improv ... Full text Cite

3D Object Detection with VI-SLAM Point Clouds: The Impact of Object and Environment Characteristics on Model Performance

Conference Proceedings - IEEE International Conference on Robotics and Automation · January 1, 2024 3D object detection (OD) is a crucial element in scene understanding. However, most existing 3D OD models have been tailored to work with light detection and ranging (LiDAR) and RGB-D point cloud data, leaving their performance on commonly available visual ... Full text Cite

Message from the Program Chairs

Conference Proceedings of the 2023 Workshop on Emerging Multimedia Systems, EMS 2023 · September 10, 2023 Cite

Optimal Network Protocol Selection for Competing Flows via Online Learning

Journal Article IEEE Transactions on Mobile Computing · August 1, 2023 Today's Internet must support applications with increasingly dynamic and heterogeneous connectivity requirements, such as video streaming and the Internet of Things. Yet current network management practices generally rely on pre-specified network configura ... Full text Cite

UAV-Assisted Online Machine Learning Over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approach

Journal Article IEEE Transactions on Network and Service Management · June 1, 2023 We investigate training machine learning (ML) models across a set of geo-distributed, resource-constrained clusters of devices through unmanned aerial vehicles (UAV) swarms. The presence of time-varying data heterogeneity and computational resource inadequ ... Full text Cite

Demo Abstract: Edge-based Augmented Reality Guidance System for Retinal Laser Therapy via Feature Matching

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 In ophthalmology, retinal laser therapy is a treatment for retinopathy that requires the use of magnifying lens to treat damaged regions of retinal landmarks, hence creating challenges of inverted magnified images and requiring prolonged training. Augmente ... Full text Cite

Message from General and Technical Program Chairs

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 Full text Cite

Demo Abstract: BiGuide: A Bi-level Data Acquisition Guidance for Object Detection on Mobile Devices

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 Real-time object detection (OD) is a key enabling technology for a wide range of emerging mobile system applications. However, deploying an OD model pre-trained on a public dataset (source domain) in a specific local environment (target domain) is known to ... Full text Cite

Investigation of Thermal Perception and Emotional Response in Augmented Reality using Digital Biomarkers: A Pilot Study

Conference Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 · January 1, 2023 Dialectical behavior therapy (DBT) is an evidence-based psychotherapy that helps patients learn skills to regulate emotions as a central strategy to improve life functioning. However, DBT skills require a long-term and consistent commitment, typically to g ... Full text Cite

Demo Abstract: Demonstrating Resource-Efficient SLAM in Virtual Spacecraft Environments

Conference IEEE INFOCOM 2023 - Conference on Computer Communications Workshops, INFOCOM WKSHPS 2023 · January 1, 2023 The performance of simultaneous localization and mapping (SLAM) systems is impacted by the constrained computation capabilities of mobile devices. Given that the advancement of these systems relies on accurate evaluation of SLAM performance, this issue is ... Full text Cite

AdaptSLAM: Edge-Assisted Adaptive SLAM with Resource Constraints via Uncertainty Minimization

Conference Proceedings - IEEE INFOCOM · January 1, 2023 Edge computing is increasingly proposed as a solution for reducing resource consumption of mobile devices running simultaneous localization and mapping (SLAM) algorithms, with most edge-assisted SLAM systems assuming the communication resources between the ... Full text Cite

SiTAR: Situated Trajectory Analysis for In-the-Wild Pose Error Estimation

Conference Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 · January 1, 2023 Virtual content instability caused by device pose tracking error remains a prevalent issue in markerless augmented reality (AR), especially on smartphones and tablets. However, when examining environments which will host AR experiences, it is challenging t ... Full text Cite

Environment Texture Optimization for Augmented Reality

Journal Article Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · September 9, 2024 Augmented reality (AR) platforms now support persistent, markerless experiences, in which virtual content appears in the same place relative to the real world, across multiple devices and sessions. However, optimizing environments for these experiences rem ... Full text Cite

Augmented Reality-based Contextual Guidance through Surgical Tool Tracking in Neurosurgery.

Journal Article IEEE transactions on visualization and computer graphics · April 2024 External ventricular drain (EVD) is a common, yet challenging neurosurgical procedure of placing a catheter into the brain ventricular system that requires prolonged training for surgeons to improve the catheter placement accuracy. In this paper, we introd ... Full text Cite

Accuracy of routine external ventricular drain placement following a mixed reality-guided twist-drill craniostomy.

Journal Article Neurosurgical focus · January 2024 ObjectiveThe traditional freehand placement of an external ventricular drain (EVD) relies on empirical craniometric landmarks to guide the craniostomy and subsequent passage of the EVD catheter. The diameter and trajectory of the craniostomy physi ... Full text Cite

Quantifying and Exploiting VR Frame Correlations: An Application of a Statistical Model for Viewport Pose

Journal Article IEEE Transactions on Mobile Computing · January 1, 2024 In virtual reality (VR), users' head pose, that is, the location and the orientation of users' viewport, determines the view of the virtual world that is shown to the users. The importance of the viewport pose to VR experienc ... Full text Cite

Did You Do Well? Real-Time Personalized Feedback on Catheter Placement in Augmented Reality-Assisted Neurosurgical Training

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 External ventricular drain (EVD) is a common neurosurgical procedure often performed by junior trainees to relieve pressure buildup inside the brain by inserting a catheter to drain fluid. Recent work shows that the integration of Augmented Reality (AR) im ... Full text Cite

Did I Do Well? Personalized Assessment of Trainees' Performance in Augmented Reality-Assisted Neurosurgical Training

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 The integration of Augmented Reality (AR) with the external ventricular drain (EVD) procedure improves catheter placement accuracy by providing guidance to surgeons through a visualization of the brain ventricular anatomy and other contextual information. ... Full text Cite

AR Simulations in VR: The Case for Environmental Awareness

Conference Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 · January 1, 2024 Augmented reality (AR) simulations in virtual reality (VR) provide fully controlled conditions, fewer hardware limitations than on AR devices, and convenient and safe access to diverse settings. However, for VR to be a fully realistic simulator for optical ... Full text Cite

BiGuide: A Bi-level Data Acquisition Guidance for Object Detection on Mobile Devices

Conference Proceedings - 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2024 · January 1, 2024 Object detection (OD) is crucial for numerous emerging visual sensing applications. As OD models trained on unrepresentative data usually yield poor performance, collecting high-quality data in the local environment is recognized to be essential for improv ... Full text Cite

3D Object Detection with VI-SLAM Point Clouds: The Impact of Object and Environment Characteristics on Model Performance

Conference Proceedings - IEEE International Conference on Robotics and Automation · January 1, 2024 3D object detection (OD) is a crucial element in scene understanding. However, most existing 3D OD models have been tailored to work with light detection and ranging (LiDAR) and RGB-D point cloud data, leaving their performance on commonly available visual ... Full text Cite

Message from the Program Chairs

Conference Proceedings of the 2023 Workshop on Emerging Multimedia Systems, EMS 2023 · September 10, 2023 Cite

Optimal Network Protocol Selection for Competing Flows via Online Learning

Journal Article IEEE Transactions on Mobile Computing · August 1, 2023 Today's Internet must support applications with increasingly dynamic and heterogeneous connectivity requirements, such as video streaming and the Internet of Things. Yet current network management practices generally rely on pre-specified network configura ... Full text Cite

UAV-Assisted Online Machine Learning Over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approach

Journal Article IEEE Transactions on Network and Service Management · June 1, 2023 We investigate training machine learning (ML) models across a set of geo-distributed, resource-constrained clusters of devices through unmanned aerial vehicles (UAV) swarms. The presence of time-varying data heterogeneity and computational resource inadequ ... Full text Cite

Demo Abstract: Edge-based Augmented Reality Guidance System for Retinal Laser Therapy via Feature Matching

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 In ophthalmology, retinal laser therapy is a treatment for retinopathy that requires the use of magnifying lens to treat damaged regions of retinal landmarks, hence creating challenges of inverted magnified images and requiring prolonged training. Augmente ... Full text Cite

Message from General and Technical Program Chairs

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 Full text Cite

Demo Abstract: BiGuide: A Bi-level Data Acquisition Guidance for Object Detection on Mobile Devices

Conference IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks · May 9, 2023 Real-time object detection (OD) is a key enabling technology for a wide range of emerging mobile system applications. However, deploying an OD model pre-trained on a public dataset (source domain) in a specific local environment (target domain) is known to ... Full text Cite

Investigation of Thermal Perception and Emotional Response in Augmented Reality using Digital Biomarkers: A Pilot Study

Conference Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 · January 1, 2023 Dialectical behavior therapy (DBT) is an evidence-based psychotherapy that helps patients learn skills to regulate emotions as a central strategy to improve life functioning. However, DBT skills require a long-term and consistent commitment, typically to g ... Full text Cite

Demo Abstract: Demonstrating Resource-Efficient SLAM in Virtual Spacecraft Environments

Conference IEEE INFOCOM 2023 - Conference on Computer Communications Workshops, INFOCOM WKSHPS 2023 · January 1, 2023 The performance of simultaneous localization and mapping (SLAM) systems is impacted by the constrained computation capabilities of mobile devices. Given that the advancement of these systems relies on accurate evaluation of SLAM performance, this issue is ... Full text Cite

AdaptSLAM: Edge-Assisted Adaptive SLAM with Resource Constraints via Uncertainty Minimization

Conference Proceedings - IEEE INFOCOM · January 1, 2023 Edge computing is increasingly proposed as a solution for reducing resource consumption of mobile devices running simultaneous localization and mapping (SLAM) algorithms, with most edge-assisted SLAM systems assuming the communication resources between the ... Full text Cite

SiTAR: Situated Trajectory Analysis for In-the-Wild Pose Error Estimation

Conference Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 · January 1, 2023 Virtual content instability caused by device pose tracking error remains a prevalent issue in markerless augmented reality (AR), especially on smartphones and tablets. However, when examining environments which will host AR experiences, it is challenging t ... Full text Cite

DNN-based SLAM Tracking Error Online Estimation

Conference Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM · January 1, 2023 Simultaneous localization and mapping (SLAM) takes in sensor data, e.g., camera frames, and estimates the user's trajectory while creating a map of the surrounding environment. However, existing SLAM evaluation methods are not reference-free, requiring gro ... Full text Cite

FedSEA: A Semi-Asynchronous Federated Learning Framework for Extremely Heterogeneous Devices

Conference SenSys 2022 - Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems · November 6, 2022 Federated learning (FL) has attracted increasing attention as a promising technique to drive a vast number of edge devices with artificial intelligence. However, it is very challenging to guarantee the efficiency of a FL system in practice due to the heter ... Full text Cite

Demo Abstract: Through an AR Lens: Augmented Reality Magnification through Feature Detection and Matching

Conference SenSys 2022 - Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems · November 6, 2022 Sensing and Augmented Reality (AR) can benefit a wide range of applications that involve the use of magnifying lenses. Recent developments in AR magnification provide a direct overlay of the magnified scenes in AR. However, instrumentation tasks that requi ... Full text Cite

Intelli-AR Preloading: A Learning Approach to Proactive Hologram Transmissions in Mobile AR

Journal Article IEEE Internet of Things Journal · September 15, 2022 Mobile augmented reality (AR), which integrates virtual objects (i.e., holographic contents) with 3-D real environments in real time, has been rapidly gaining popularity in the last five years. The delivery mechanisms of these holographic contents to mobil ... Full text Cite

IoT-Enabled Environment Illuminance Optimization for Augmented Reality

Conference UbiComp/ISWC 2022 Adjunct - Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2022 ACM International Symposium on Wearable Computers · September 11, 2022 In order to provide high quality augmented reality (AR) experiences, environmental conditions such as light level must be conducive to a high level of virtual content stability, accurate eye tracking and good virtual content visibility. This is challenging ... Full text Cite

Digital biomarkers reflect stress reduction after Augmented Reality guided meditation: A feasibility study

Conference DigiBiom 2022 - Proceedings of the 2022 Emerging Devices for Digital Biomarkers · July 1, 2022 Meditation, a mental and physical exercise which helps to focus attention and reduce stress has gained more popularity in recent years. However, meditation requires a concerted effort and regular practice. To explore the feasibility of using Augmented Real ... Full text Cite

Deep Learning for Detecting Human Activities from Piezoelectric-Based Kinetic Energy Signals

Journal Article IEEE Internet of Things Journal · May 15, 2022 Kinetic energy harvesting technologies have been progressively used to power wearable devices and to sense the context through energy generation patterns. However, detecting human activities with signals from kinetic harvesters still needs improvement due ... Full text Cite

InDepth: Real-time Depth Inpainting for Mobile Augmented Reality

Journal Article Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · March 1, 2022 Mobile Augmented Reality (AR) demands realistic rendering of virtual content that seamlessly blends into the physical environment. For this reason, AR headsets and recent smartphones are increasingly equipped with Time-of-Flight (ToF) cameras to acquire de ... Full text Cite

AR-Assisted Surgical Guidance System for Ventriculostomy

Conference Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022 · January 1, 2022 Augmented Reality (AR) is increasingly used in medical applications for visualizing medical information. In this paper, we present an AR-assisted surgical guidance system that aims to improve the accuracy of catheter placement in ventriculostomy, a common ... Full text Cite

Environmental, User, and Social Context-Aware Augmented Reality for Supporting Personal Development and Change

Conference Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022 · January 1, 2022 Robust pervasive context-aware augmented reality (AR) has the potential to enable a range of applications that support users in reaching their personal and professional goals. In such applications, AR can be used to deliver richer, more immersive, and more ... Full text Cite

VR Viewport Pose Model for Quantifying and Exploiting Frame Correlations

Conference Proceedings - IEEE INFOCOM · January 1, 2022 The importance of the dynamics of the viewport pose, i.e., the location and the orientation of users' points of view, for virtual reality (VR) experiences calls for the development of VR viewport pose models. In this paper, informed by our experimental mea ... Full text Cite

Here to Stay: A Quantitative Comparison of Virtual Object Stability in Markerless Mobile AR

Conference Proceedings - 2nd International Workshop on Cyber-Physical-Human System Design and Implementation, CPHS 2022 · January 1, 2022 Mobile augmented reality (AR) has the potential to enable immersive, natural interactions between humans and cyber-physical systems. In particular markerless AR, by not relying on fiducial markers or predefined images, provides great convenience and flexib ... Full text Cite

Demo Abstract: Pixel Similarity-Based Content Reuse in Edge-Assisted Virtual Reality

Conference INFOCOM WKSHPS 2022 - IEEE Conference on Computer Communications Workshops · January 1, 2022 Offloading the computation-intensive virtual reality (VR) frame rendering to the edge server is a promising approach to providing immersive VR experiences in mobile VR devices with limited computational capability and battery lifetime. However, edge-assist ... Full text Cite

Demo Abstract: Catch My Eye: Gaze-Based Activity Recognition in an Augmented Reality Art Gallery

Conference Proceedings - 21st ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2022 · January 1, 2022 The personalization of augmented reality (AR) experiences based on environmental and user context is key to unlocking their full potential. The recent addition of eye tracking to AR headsets provides a convenient method for detecting user context, but comp ... Full text Cite

EyeSyn: Psychology-inspired Eye Movement Synthesis for Gaze-based Activity Recognition

Conference Proceedings - 21st ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2022 · January 1, 2022 Recent advances in eye tracking have given birth to a new genre of gaze-based context sensing applications, ranging from cognitive load estimation to emotion recognition. To achieve state-of-the-art recognition accuracy, a large-scale, labeled eye movement ... Full text Cite

Integrated Design of Augmented Reality Spaces Using Virtual Environments

Conference Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 · January 1, 2022 Demand is growing for markerless augmented reality (AR) experiences, but designers of the real-world spaces that host them still have to rely on inexact, qualitative guidelines on the visual environment to try and facilitate accurate pose tracking. Further ... Full text Cite

NeuroLens: Augmented Reality-based Contextual Guidance through Surgical Tool Tracking in Neurosurgery

Conference Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 · January 1, 2022 External ventricular drain (EVD) is a common, yet challenging neurosurgical procedure of placing a catheter into the brain ventricular system that requires prolonged training for surgeons to improve the catheter placement accuracy. In this paper, we introd ... Full text Cite

Anton 3: Twenty Microseconds of Molecular Dynamics Simulation before Lunch

Conference International Conference for High Performance Computing, Networking, Storage and Analysis, SC · November 14, 2021 Anton 3 is the newest member in a family of supercomputers specially designed for atomic-level simulation of molecules relevant to biology (e.g., DNA, proteins, and drug molecules). Anton 3 achieves order-of-magnitude improvements in time-To-solution over ... Full text Cite

Edge-assisted Collaborative Image Recognition for Mobile Augmented Reality

Journal Article ACM Transactions on Sensor Networks · October 5, 2021 Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, a ... Full text Cite

MetaSense: Boosting RF Sensing Accuracy Using Dynamic Metasurface Antenna

Journal Article IEEE Internet of Things Journal · September 15, 2021 Conventional radio-frequency (RF) sensing systems rely on either frequency diversity or spatial diversity to ensure high sensing accuracy. Such reliance introduces several practical limitations that hinder the pervasive deployment of existing solutions. To ... Full text Cite

The ΛnTON 3 ASIC: A fire-breathing monster for molecular dynamics simulations

Conference 2021 IEEE Hot Chips 33 Symposium, HCS 2021 · August 22, 2021 Full text Cite

Will it Move?: Indoor Scene Characterization for Hologram Stability in Mobile AR

Conference HotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications · February 24, 2021 Mobile Augmented Reality (AR) provides immersive experiences by aligning virtual content (holograms) with a view of the real world. When a user places a hologram it is usually expected that like a real object, it remains in the same place. However, positio ... Full text Cite

Multi-user augmented reality with communication efficient and spatially consistent virtual objects

Conference CoNEXT 2020 - Proceedings of the 16th International Conference on Emerging Networking EXperiments and Technologies · November 23, 2020 Multi-user augmented reality (AR), where multiple co-located users view a common set of virtual objects, is becoming increasingly popular. For example, Google Just a Line allows multiple users to draw virtual graffiti in the same physical space. Multi-user ... Full text Cite

GazeGraph: Graph-based few-shot cognitive context sensing from human visual behavior

Conference SenSys 2020 - Proceedings of the 2020 18th ACM Conference on Embedded Networked Sensor Systems · November 16, 2020 In this work, we present GazeGraph, a system that leverages human gazes as the sensing modality for cognitive context sensing. GazeGraph is a generalized framework that is compatible with different eye trackers and supports various gaze-based sensing appli ... Full text Cite

Characterizing task completion latencies in multi-point multi-quality fog computing systems

Journal Article Computer Networks · November 9, 2020 Fog computing, which distributes computing resources to multiple locations between the Internet of Things (IoT) devices and the cloud, is attracting considerable attention from academia and industry. Yet, despite the excitement about the potential of fog c ... Full text Cite

Plant Spike: A Low-Cost, Low-Power Beacon for Smart City Soil Health Monitoring

Journal Article IEEE Internet of Things Journal · September 1, 2020 Plant Spike is an in situ low-cost sensor system that is wireless, miniature, and low powered. It can be seamlessly implanted in subsurface locations across major cities to measure urban soil health. Plant Spike incorporates noncontact soil moisture monito ... Full text Cite

Wireless Sensing Using Dynamic Metasurface Antennas: Challenges and Opportunities

Journal Article IEEE Communications Magazine · June 1, 2020 Using wireless communication infrastructure to recognize human behaviors has achieved great success over the last decade. This article presents the opportunities and challenges posed by a novel class of antennas referred to as DMA for wireless sensing. In ... Full text Cite

CollabAR: edge-assisted collaborative image recognition for mobile augmented reality

Conference Proceedings - 2020 19th ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2020 · April 1, 2020 Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, a ... Full text Cite

Invited Paper: Edge-based Provisioning of Holographic Content for Contextual and Personalized Augmented Reality

Conference 2020 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2020 · March 1, 2020 Mobile augmented reality (AR) has been attracting considerable attention from industry and academia due to its potential to provide vibrant immersive experiences that seamlessly blend physical and virtual worlds. In this paper we focus on creating contextu ... Full text Cite

Pricing tradeoffs for data analytics in fog-cloud scenarios

Chapter · February 3, 2020 Fog computing represents a generalization of traditional cloud computing, in which application functionality resides at a local device and a remote cloud server. This chapter presents an initial survey of fogonomics, using a case study of distributed data ... Full text Cite

ShareAR: Communication-efficient multi-user mobile augmented reality

Conference HotNets 2019 - Proceedings of the 18th ACM Workshop on Hot Topics in Networks · November 13, 2019 Augmented reality is an emerging application on mobile devices. However, there is a lack of understanding of the communication requirements and challenges of multi-user AR scenarios. In this position paper, we propose several important research issues that ... Full text Cite

Adaptive AR visual output security using reinforcement learning trained policies: Demo abstract

Conference SenSys 2019 - Proceedings of the 17th Conference on Embedded Networked Sensor Systems · November 10, 2019 Augmented reality (AR) technologies have seen significant improvement in recent years with several consumer and commercial solutions being developed. New security challenges arise as AR becomes increasingly ubiquitous. Previous work has proposed techniques ... Full text Cite

Edge-assisted collaborative image recognition for augmented reality: Demo abstract

Conference SenSys 2019 - Proceedings of the 17th Conference on Embedded Networked Sensor Systems · November 10, 2019 Mobile Augmented Reality (AR), which overlays digital information with real-world scenes surrounding a user, provides an enhanced mode of interaction with the ambient world. Contextual AR applications rely on image recognition to identify objects in the vi ... Full text Cite

The internet of microfluidic things: Perspectives on system architecture and design challenges: Invited paper

Conference IEEE/ACM International Conference on Computer-Aided Design, Digest of Technical Papers, ICCAD · November 1, 2019 The integration of microfluidics and biosensor technology is transforming microbiology research by providing new capabilities for clinical diagnostics, cancer research, and pharmacology studies. This integration enables new approaches for biochemistry auto ... Full text Cite

Towards automated network management: Learning the optimal protocol selection

Conference Proceedings - International Conference on Network Protocols, ICNP · October 1, 2019 Today's Internet must support applications with increasingly dynamic and heterogeneous connectivity requirements, such as video streaming and the Internet of Things. Yet current network management practices generally rely on pre-specified flow configuratio ... Full text Cite

Personalized augmented reality via fog-based imitation learning

Conference IoT-Fog 2019 - Proceedings of the 2019 Workshop on Fog Computing and the IoT · April 15, 2019 Augmented reality (AR) technologies are rapidly gaining momentum in society and are expected to play a critical role in the future of cities and transportation. In such dynamic settings with a heterogeneous population of AR users, it is important for holog ... Full text Cite

Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning

Conference Proceedings - IEEE INFOCOM · April 1, 2019 We study a multi-agent partially observable environment in which autonomous agents aim to coordinate their actions, while also learning the parameters of the unknown environment through repeated interactions. In particular, we focus on the role of communic ... Full text Cite

Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds

Conference INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019 · April 1, 2019 The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edg ... Full text Cite

Virtualized Control over Fog: Interplay between Reliability and Latency

Journal Article IEEE Internet of Things Journal · December 1, 2018 This paper introduces an analytical framework to investigate optimal design choices for the placement of virtual controllers along the cloud-to-things continuum. The main application scenarios include low-latency cyber-physical systems in which real-time c ... Full text Cite

Adaptive fog-based output security for augmented reality

Conference VR/AR Network 2018 - Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network, Part of SIGCOMM 2018 · August 7, 2018 Augmented reality (AR) technologies are rapidly being adopted across multiple sectors, but little work has been done to ensure the security of such systems against potentially harmful or distracting visual output produced by malicious or bug-ridden applica ... Full text Cite

Demo Abstract: Decomposing Data Analytics in Fog Networks

Conference SenSys 2017 - Proceedings of the 15th ACM Conference on Embedded Networked Sensor Systems · November 6, 2017 Fog computing, the distribution of computing resources closer to the end devices along the cloud-to-things continuum, is recently emerging as an architecture for scaling of the Internet of Things (IoT) sensor networking applications. Fog computing requires ... Full text Cite

Leveraging fog and cloud computing for efficient computational offloading

Conference 2017 IEEE MIT Undergraduate Research Technology Conference, URTC 2017 · July 2, 2017 Fog computing [1], [2], also known as edge computing, is an emerging Internet of Things (IoT)-centric paradigm in which traditionally cloud-based data storage, computation, and control are brought closer to the end devices. The fog layer comprises smart ga ... Full text Cite

Energy-harvesting active networked tags (EnHANTs): Prototyping and experimentation

Journal Article ACM Transactions on Sensor Networks · November 1, 2015 This article focuses on a new type of wireless devices in the domain between RFIDs and sensor networks-Energy-Harvesting Active Networked Tags (EnHANTs). Future EnHANTs will be small, flexible, and self-powered devices that can be attached to objects that ... Full text Cite

Movers and Shakers: Kinetic Energy Harvesting for the Internet of Things

Journal Article IEEE Journal on Selected Areas in Communications · August 1, 2015 Numerous energy harvesting wireless devices that will serve as building blocks for the Internet of Things (IoT) are currently under development. However, there is still only limited understanding of the properties of various energy sources and their impact ... Full text Cite

Movers and shakers: Kinetic energy harvesting for the internet of things

Conference Performance Evaluation Review · June 20, 2014 Numerous energy harvesting wireless devices that will serve as building blocks for the Internet of Things (IoT) are currently under development. However, there is still only limited understanding of the properties of various energy sources and their impact ... Full text Cite

Movers and shakers: Kinetic energy harvesting for the internet of things

Conference SIGMETRICS 2014 - Proceedings of the 2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems · January 1, 2014 Numerous energy harvesting wireless devices that will serve as building blocks for the Internet of Things (IoT) are currently under development. However, there is still only limited understanding of the properties of various energy sources and their impact ... Full text Cite

Prototyping energy harvesting active networked tags (EnHANTs)

Conference Proceedings - IEEE INFOCOM · September 2, 2013 This paper focuses on a new type of wireless devices in the domain between RFIDs and sensor networks-Energy Harvesting Active Networked Tags (EnHANTs). Future EnHANTs will be small, flexible, and self-powered devices that can be attached to objects that ar ... Full text Cite

Project-based learning within a large-scale interdisciplinary research effort

Conference Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE · August 12, 2013 The modern computing landscape increasingly requires a range of skills to successfully integrate complex systems. Project-based learning is used to help students build professional skills. However, it is typically applied to small teams and small efforts. ... Full text Cite

Networking low-power energy harvesting devices: Measurements and algorithms

Journal Article IEEE Transactions on Mobile Computing · August 7, 2013 Recent advances in energy harvesting materials and ultra-low-power communications will soon enable the realization of networks composed of energy harvesting devices. These devices will operate using very low ambient energy, such as energy harvested from in ... Full text Cite

Demo: Organic solar cell-equipped energy harvesting active networked tag (EnHANT) prototypes

Conference SenSys 2011 - Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems · December 19, 2011 Energy Harvesting Active Networked Tags (EnHANTs) will be a new class of devices in the domain between RFIDs and sensor networks. Small, flexible, and energetically self-reliant, EnHANTs will be attached to objects that are traditionally not networked, suc ... Full text Cite

Managing base station location privacy

Conference Proceedings - IEEE Military Communications Conference MILCOM · December 1, 2011 Many of today's location services map locations of wireless base stations and use them to localize mobile devices. Severe security and privacy risks exist when unauthorized third-party location services are able to localize mobile devices. In this work we ... Full text Cite

Networking low-power energy harvesting devices: Measurements and algorithms

Conference Proceedings - IEEE INFOCOM · August 2, 2011 Recent advances in energy harvesting materials and ultra-low-power communications will soon enable the realization of networks composed of energy harvesting devices. These devices will operate using very low ambient energy, such as indoor light energy. We ... Full text Cite

Energy harvesting active networked tags (EnHANTs) for ubiquitous object networking

Journal Article IEEE Wireless Communications · December 1, 2010 This article presents the design challenges posed by a new class of ultra-low-power devices referred to as Energy-Harvesting Active Networked Tags (EnHANTs). EnHANTs are small, flexible, and self-reliant (in terms of energy) devices that can be attached to ... Full text Cite

Prototyping Energy Harvesting Active Networked Tags (EnHANTs) with MICA2 motes

Conference SECON 2010 - 2010 7th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks · August 5, 2010 With the convergence of ultra-low-power communications and energy-harvesting technologies, networking self-sustainable ubiquitous devices is becoming feasible. Hence, we have been recently developing new devices, referred to as Energy Harvesting Active Net ... Full text Cite

Challenge: Ultra-low-power energy-harvesting active networked tags (EnHANTs)

Conference Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM · November 30, 2009 This paper presents the design challenges posed by a new class of ultra-low-power devices referred to as Energy-Harvesting Active Networked Tags (EnHANTs). EnHANTs are small, flexible, and self-reliant (in terms of energy) devices that can be attached to o ... Full text Cite