CARLA simulator reposted this
CloningDCB research is supported by project TED2021-132802B-I00 funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
From Instituto de Biomecánica (IBV) we are very proud to have been selected to collaborate with Computer Vision Center (CVC) (https://www.cvc.uab.es/) in the project “CloningDCB: Autonomous Driving based on the Cloning of the Driver's Cognitive Behavior”. The goal of this project is to research whether the use of human drivers' attention maps, as prior cognitive supervision for training end-to-end AI drivers, actually improves their driving performance. Computer Vision Center term this approach cognitive behavior cloning. This project addresses such research relying on CARLA simulator (carla.org). In this part of the project, Instituto de Biomecánica (IBV) is generating datasets carrying out tests with real users in its HAV driving simulator in a CARLA simulator environment, acquiring the brain signals, driver’s gaze and vehicle telemetry. These datasets are used in the Computer Vision Center to train the DL-based sensorimotor models at the core of end-to-end AI drivers while providing explainability to the models. The experimental design, driver data fusion and synchronization with the driving scenario is a key challenge for the involvement of real drivers for generating valuables datasets. Being able to develop AI drivers is key to pioneering AV technology and Instituto de Biomecánica (IBV) has become, thanks to the collaboration with relevant agents such as Computer Vision Center, an actor in this scene.
Civil Engineering Researcher @ FIU | Enhancing Safety Through Research and Collaboration
5moThat's impressive!