ConferenceAamas 2026 Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems · May 24, 2026
In time-critical settings such as assistive driving, assistants often rely on alerts or haptic signals to prompt rapid human attention, but these cues usually leave humans to interpret situations and decide responses independently, introducing potential de ...
Full textCite
ConferenceConference on Human Factors in Computing Systems Proceedings · April 13, 2026
Effective coaching requires instruction to be tailored to each student's skill level. While prior work has shown the importance of adaptive feedback, there is little quantitative evidence showing how coaching language itself changes as a function of skill ...
Full textCite
ConferenceProceedings of Machine Learning Research · January 1, 2026
We propose a new approach for solving planning problems with a hierarchical structure, fusing reinforcement learning and MPC planning. Our formulation tightly and elegantly couples the two planning paradigms. It leverages reinforcement learning actions to ...
Cite
ConferenceIEEE Intelligent Vehicles Symposium Proceedings · January 1, 2026
Drivers need to build and maintain sufficient Situational Awareness (SA) of their driving environment in order to drive safely. Therefore, the ability to estimate a driver's SA (or its lack thereof) is critical for effective driving assistance. Traditional ...
Full textCite
ConferenceMain Conference Proceedings 17th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications Automotiveui 2025 · October 4, 2025
Learning in domains involving complex motor skills, such as performance driving, often requires feedback that is timely, personalized, and actionable. Yet many drivers rely on video and telemetry data to review their performance without guidance. We explor ...
Full textCite
ConferenceACM IEEE International Conference on Human Robot Interaction · January 1, 2025
Motor skills education often requires experienced professionals who can provide personalized instruction. Unfortu-nately, the availability of high-quality training can be limited for specialized tasks, such as high performance racing. Several recent works ...
Full textCite
Conference13th International Conference on Learning Representations Iclr 2025 · January 1, 2025
Simulation plays a key role in scaling robot learning and validating policies, but constructing simulations remains a labor-intensive process. This paper introduces ReGen, a generative simulation framework that automates simulation design via inverse desig ...
Cite
ConferenceIEEE Intelligent Vehicles Symposium Proceedings · January 1, 2025
Field sobriety tests and breathalyzers are commonly used to prevent alcohol-impaired driving, but are expensive and time-consuming to administer. We propose a set of sobriety tests which, in contrast, can feasibly be automated and deployed to modern vehicl ...
Full textCite
ConferenceIEEE Intelligent Vehicles Symposium Proceedings · January 1, 2025
Cognitive distraction (CD) is one of the major causes of traffic accidents, but there remains room to improve its detection. Most prior research on CD detection has commonly used basic statistical measures (e.g., mean, standard deviation) of driver-facing ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2025
Understanding and anticipating events and actions is critical for intraoperative assistance and decision-making during minimally invasive surgery. We propose a predictive neural network that is capable of understanding and predicting critical interaction a ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2025
The deployment of autonomous vehicles controlled by machine learning techniques requires extensive testing in diverse real-world environments, robust handling of edge cases and out-of-distribution scenarios, and comprehensive safety validation to ensure th ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2025
Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with the student simi ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2025
Non-cooperative interactions commonly occur in multi-agent scenarios such as car racing, where an ego vehicle can choose to overtake the rival, or stay behind it until a safe overtaking 'corridor' opens. While an expert human can do well at making such tim ...
Full textCite
ConferenceIEEE Conference on Intelligent Transportation Systems Proceedings ITSC · January 1, 2025
As autonomous agents become increasingly integrated into daily life, particularly in high-risk environments like driving, maintaining user trust is crucial. Driving presents unique challenges due to heightened perception of risk and driver's individual pre ...
Full textCite
ConferenceIEEE Conference on Intelligent Transportation Systems Proceedings ITSC · January 1, 2025
Despite recent advances in automated driving technology, impaired driving continues to incur a high cost to society. In this paper, we present a driving dataset designed to support the study of two common forms of driver impairment: alcohol intoxication an ...
Full textCite
ConferenceAdvances in Neural Information Processing Systems · January 1, 2025
People's goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people's attention to objects in their environment will be biased in a way that systematically ...
Cite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2024
As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as unexpected open se ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · January 1, 2024
We represent a vehicle dynamics model for autonomous driving near the limits of handling via a multilayer neural network. Online adaptation is desirable in order to address unseen environments. However, the model needs to adapt to new environments without ...
Full textCite
ConferenceConference Proceedings IEEE International Conference on Systems Man and Cybernetics · January 1, 2024
Modern Advanced Driver-Assistance Systems (ADAS) increasingly rely on interactions between vehicle and human driver. To inform these interactions, it is helpful for a vehicle system to have a good understanding of a driver's situational awareness. In this ...
Full textCite
ConferenceProceedings of Machine Learning Research · January 1, 2024
Tight coordination is required for effective human-robot teams in domains involving fast dynamics and tactical decisions, such as multi-car racing. In such settings, robot teammates must react to cues of a human teammate's tactical objective to assist in a ...
Cite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2023
Game theoretic methods have become popular for planning and prediction in situations involving rich multi-agent interactions. However, these methods often assume the existence of a single local Nash equilibria and are hence unable to handle uncertainty in ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2022
Temporal patterns (how vehicles behave in our observed past) underline our reasoning of how people drive on the road, and can explain why we make certain predictions about interactions among road agents. In this paper we propose the ConceptNet trajectory p ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · January 1, 2022
When predicting trajectories of road agents, motion predictors often approximate the future distribution by a limited number of samples. This constraint requires the predictors to generate samples that best support the task given task specifications. Howev ...
Full textCite
ConferenceIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · January 1, 2022
We introduce a lightweight simulation and modeling framework, HMIway-env, for studying human-machine teaming in the context of driving. The goal of the framework is to accelerate the development of adaptive AI systems which can respond to individual driver ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2022
Language allows humans to build mental models that interpret what is happening around them resulting in more accurate long-term predictions. We present a novel trajectory prediction model that uses linguistic intermediate representations to forecast trajec ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2022
Multi-agent interactions are important to model for forecasting other agents' behaviors and trajectories. At a certain time, to forecast a reasonable future trajectory, each agent needs to pay attention to the interactions with only a small group of most r ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2022
Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction. Existing approaches explore the discrete nature of human intent before predicting continuous trajectories, to improve accuracy and support explainability. ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · January 1, 2021
Analyzing surgical workflow is crucial for surgical assistance robots to understand surgeries. With the understanding of the complete surgical workflow, the robots are able to assist the surgeons in intra-operative events, such as by giving a warning when ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · January 1, 2021
Risk-bounded motion planning is an important yet difficult problem for safety-critical tasks. While existing mathematical programming methods offer theoretical guarantees in the context of constrained Markov decision processes, they either lack scalability ...
Full textCite
ConferenceProceedings of the IEEE International Conference on Computer Vision · January 1, 2021
We propose a computational model to estimate a person's attended awareness of their environment. We define "attended awareness"to be those parts of a potentially dynamic scene which a person has attended to in recent history and which they are still likely ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · October 24, 2020
Traffic simulators are important tools in autonomous driving development. While continuous progress has been made to provide developers more options for modeling various traffic participants, tuning these models to increase their behavioral diversity while ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · October 24, 2020
Safe autonomous driving requires robust detection of other traffic participants. However, robust does not mean perfect, and safe systems typically minimize missed detections at the expense of a higher false positive rate. This results in conservative and y ...
Full textCite
Conference2020 IEEE 23rd International Conference on Intelligent Transportation Systems ITSC 2020 · September 20, 2020
Automated Vehicles require exhaustive testing in simulation to detect as many safety-critical failures as possible before deployment on public roads. In this work, we focus on the core decision-making component of autonomous robots: their planning algorith ...
Full textCite
ConferenceProceedings of Machine Learning Research · January 1, 2020
In this work, we propose a method for integration of temporal logic formulas into a neural network. Our main contribution is a new logic optimization layer that uses differentiable optimization on the formulas' robustness function. This allows incorporatin ...
Cite
ConferenceRobotics Science and Systems · January 1, 2020
Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the vehicle’s actions ma ...
Full textCite
ConferenceProceedings of Machine Learning Research · January 1, 2020
Reasoning about human motion is a core component of modern human-robot interactive systems. In particular, one of the main uses of behavior prediction in autonomous systems is to inform robot motion planning and control. However, a majority of planning and ...
Cite
ConferenceIEEE International Conference on Intelligent Robots and Systems · November 1, 2019
Current perception systems mostly require direct line of sight to anticipate and ultimately prevent potential collisions at intersections with other road users. We present a fully integrated autonomous system capable of detecting shadows or weak illuminati ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · May 1, 2019
Predicting the motion of a driver's vehicle is crucial for advanced driving systems, enabling detection of potential risks towards shared control between the driver and automation systems. In this paper, we propose a variational neural network approach tha ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · May 1, 2019
Deep learning has revolutionized the ability to learn 'end-to-end' autonomous vehicle control directly from raw sensory data. While there have been recent extensions to handle forms of navigation instruction, these works are unable to capture the full dist ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · December 27, 2018
This paper introduces a new method for end-to-end training of deep neural networks (DNNs) and evaluates it in the context of autonomous driving. DNN training has been shown to result in high accuracy for perception to action learning given sufficient train ...
Full textCite
ConferenceIEEE Conference on Intelligent Transportation Systems Proceedings ITSC · December 7, 2018
Moving obstacles occluded by corners are a potential source for collisions in mobile robotics applications such as autonomous vehicles. In this paper, we address the problem of anticipating such collisions by proposing a vision-based detection algorithm fo ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · September 10, 2018
When performing multi-robot tasks, sensory feedback is crucial in reducing uncertainty for correct execution. Yet the utilization of sensors should be planned as an integral part of the task planning, taken into account several factors such as the toleranc ...
Full textCite
ConferenceIEEE International Conference on Intelligent Robots and Systems · December 13, 2017
Modern autonomous systems such as driverless vehicles need to safely operate in a wide range of conditions. A potential solution is to employ a hybrid systems approach, where safety is guaranteed in each individual mode within the system. This offsets comp ...
Full textCite
ConferenceIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · August 22, 2017
The advent of widely available photo collections covering broad geographic areas has spurred significant advances in large-scale urban scene modeling. While much emphasis has been placed on reconstruction and visualization, the utility of such models exten ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · July 21, 2017
Context-aware segmentation of laparoscopic and robot assisted surgical video has been shown to improve performance and perioperative workflow efficiency, and can be used for education and time-critical consultation. Modern pressures on productivity preclud ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · July 21, 2017
We consider the problem of monitoring stochastic, time-varying events occurring at discrete locations. Our problem formulation extends prior work in persistent surveillance by considering the objective of maximizing event detections in unknown, dynamic env ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · July 21, 2017
Duckietown is an open, inexpensive and flexible platform for autonomy education and research. The platform comprises small autonomous vehicles ('Duckiebots') built from off-the-shelf components, and cities ('Duckietowns') complete with roads, signage, traf ...
Full textCite
ConferenceProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition · December 9, 2016
Sensor planning and active sensing, long studied in robotics, adapt sensor parameters to maximize a utility function while constraining resource expenditures. Here we consider information gain as the utility function. While these concepts are often used to ...
Full textCite
ConferenceProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition · December 9, 2016
The introduction of consumer RGB-D scanners set off a major boost in 3D computer vision research. Yet, the precision of existing depth scanners is not accurate enough to recover fine details of a scanned object. While modern shading based depth refinement ...
Full textCite
ConferenceProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition · October 14, 2015
The popularity of low-cost RGB-D scanners is increasing on a daily basis. Nevertheless, existing scanners often cannot capture subtle details in the environment. We present a novel method to enhance the depth map by fusing the intensity and depth informati ...
Full textCite
ConferenceProceedings IEEE International Conference on Robotics and Automation · June 29, 2015
In continuously operating robotic systems, efficient representation of the previously seen camera feed is crucial. Using a highly efficient compression coreset method, we formulate a new method for hierarchical retrieval of frames from large video streams ...
Full textCite
ConferenceIPSN 2015 Proceedings of the 14th International Symposium on Information Processing in Sensor Networks Part of Cps Week · April 13, 2015
Vehicle-based vision algorithms, such as the collision alert systems [4], are able to interpret a scene in real-time and provide drivers with immediate feedback. However, such technologies are based on cameras on the car, limited to the vicinity of the car ...
Full textCite
ConferenceProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition · September 24, 2014
Objects and structures within man-made environments typically exhibit a high degree of organization in the form of orthogonal and parallel planes. Traditional approaches to scene representation exploit this phenomenon via the somewhat restrictive assumptio ...
Full textCite
ConferenceProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition · September 24, 2014
We propose an integrated probabilistic model for multi-modal fusion of aerial imagery, LiDAR data, and (optional) GPS measurements. The model allows for analysis and dense reconstruction (in terms of both geometry and appearance) of large 3D scenes. An adv ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · January 1, 2014
Regularization of matrix-valued data is important in many fields, such as medical imaging, motion analysis and scene understanding, where accurate estimation of diffusion tensors or rigid motions is crucial for higher-level computer vision tasks. In this c ...
Full textCite
ConferenceAdvances in Neural Information Processing Systems · January 1, 2014
Life-logging video streams, financial time series, and Twitter tweets are a few examples of high-dimensional signals over practically unbounded time. We consider the problem of computing optimal segmentation of such signals by a k-piecewise linear function ...
Cite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · September 25, 2013
High resolution reconstruction of 3D surfaces from images remains an active area of research since most of the methods in use are based on practical assumptions that limit their applicability. Furthermore, an additional complication in all active illuminat ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · September 25, 2013
Segmenting the image into an arbitrary number of parts is at the core of image understanding. Many formulations of the task have been suggested over the years. Among these are axiomatic functionals, which are hard to implement and analyze, while graph-base ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · December 20, 2012
The Laplace-Beltrami operator is an extension of the Laplacian from flat domains to curved manifolds. It was proven to be useful for color image processing as it models a meaningful coupling between the color channels. This coupling is naturally expressed ...
Full textCite
ConferenceEurographics Workshop on 3D Object Retrieval Eg 3dor · December 1, 2012
Motion segmentation for articulated objects is an important topic of research. Yet such a segmentation should be as free as possible from underlying assumptions so as to fit general scenes and objects. In this paper we demonstrate an algorithm for articula ...
Full textCite
Conference2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel Ieeei 2012 · December 1, 2012
The Beltrami framework has been shown to be an effective and efficient denoising filter for color images, treating them as two dimensional manifolds embedded in a hybrid spatial-spectral space. Recent work using this framework on the patchspace of an image ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · October 30, 2012
Regularization of images with matrix-valued data is important in medical imaging, motion analysis and scene understanding. We propose a novel method for fast regularization of matrix group-valued images. Using the augmented Lagrangian framework we separate ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · January 16, 2012
The success of variational methods for optical flow computation lies in their ability to regularize the problem at a differential (pixel) level and combine piecewise smoothness of the flow field with the brightness constancy assumptions. However, the piece ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · January 16, 2012
Understanding of articulated shape motion plays an important role in many applications in the mechanical engineering, movie industry, graphics, and vision communities. In this paper, we study motion-based segmentation of articulated 3D shapes into rigid pa ...
Full textCite
ConferenceProceedings 2nd Joint 3dim 3dpvt Conference 3D Imaging Modeling Processing Visualization and Transmission 3dimpvt 2012 · January 1, 2012
Structured light depth reconstruction is among the most commonly used methods for 3D data acquisition. Yet, in most structured light methods, modeling of the acquired scene is crude, and is executed separately from the decoding phase. Here, we bridge this ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · January 1, 2012
We present a novel method for estimation of articulated motion in depth scans. The method is based on a framework for regularization of vector- and matrix- valued functions on parametric surfaces. We extend augmented-Lagrangian total variation regularizati ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · August 27, 2009
The Beltrami flow is an efficient non-linear filter, that was shown to be effective for color image processing. The corresponding anisotropic diffusion operator strongly couples the spectral components. Usually, this flow is implemented by explicit schemes ...
Full textCite
Conference2009 IEEE 12th International Conference on Computer Vision Workshops Iccv Workshops 2009 · January 1, 2009
Shape-from-X is a generic type of inverse problems in computer vision, in which a shape is reconstructed from some measurements. A specially challenging setting of this problem is the case in which the reconstructed shapes are non-rigid. In this paper, we ...
Full textCite
ConferenceProceedings of the International Conference on Document Analysis and Recognition ICDAR · December 1, 2007
Documents scanned by sheet-fed scanners often exhibit distortions due to the feeding and scanning mechanism. This paper presents a new model, motivated by the distortions observed in such documents. Numerical problems affecting the use of this model are ad ...
Full textCite
ConferenceLecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics · January 1, 2007
The Beltrami image flow is an effective non-linear filter, often used in color image processing. It was shown to be closely related to the median, total variation, and bilateral filters. It treats the image as a 2D manifold embedded in a hybrid spatial-fea ...
Full textCite