CNBI-NISSAN

Brain-Machine Interface for drivers

Nissan is undertaking this pioneering work in collaboration with the École Polytechnique Fédérale de Lausanne in Switzerland (EPFL). Far reaching research on Brain Machine Interface (BMI) systems by scientists at EPFL already allows disabled
users to manoeuvre their wheelchairs by thought transference alone. The next stage is to adapt the BMI processes to the car – and driver – of the future.

Professor José del R. Millán, leading the project, said: “The idea is to blend driver and vehicle intelligence together in such a way that eliminates conflicts between them, leading to a safer motoring environment.”

Although thought control – via brain-machine interface – is well established in the scientific world, the levels of concentration needed are exceptionally high. The Nissan/EPFL collaboration is developing systems that go to the next stage using
statistical analysis to predict a driver’s intentions and to evaluate a driver’s cognitive state relevant to the driving environment.

Using brain activity measurement, eye movement patterns and by scanning the environment around the car in conjunction with the car’s own sensors, it should be possible to predict what the driver plans to do – be it a turn, an overtake, a lane
change – and then assist with the manoeuvre in complete safety, thus improving the driving experience.

media coverage:

Press Release (09/2011)

MITTech Review Nissan’s Cars Will Read Your Mind

Autoblog Greece Nissan working on a car that reads your mind

FastCompany Nissan’s Future Mind-Reading Cars Won’t Steer You Wrong

MSNBC Future cars will read our minds

Fox News Nissan Developing Mind-Reading Cars

La Repubblica L’auto si guida col pensiero Nissan accetta la sfida

People

Ricardo Chavarriaga Zahra Khaliliardali Huaijian Zhang José del R. Millán

Journal Articles

H. Zhang; R. Chavarriaga; Z. Khaliliardali; L. A. Gheorghe; I. Iturrate et al. : EEG-based decoding of error-related brain activity in a real-world driving task; Journal of Neural Engineering. 2015. DOI : 10.1088/1741-2560/12/6/066028.
Z. Khaliliardali; R. Chavarriaga; L. A. Gheorghe; J. d. R. Millán : Action prediction based on anticipatory brain potentials during simulated driving; Journal of Neural Engineering. 2015. DOI : 10.1088/1741-2560/12/6/066006.
H. Zhang; R. Chavarriaga; J. d. R. Millán : Discriminant Brain Connectivity Patterns of Performance Monitoring at Average and Single-Trial Levels; NeuroImage. 2015. DOI : 10.1016/j.neuroimage.2015.07.012.

Conference Papers

Z. Khaliliardali; R. Chavarriaga; H. Zhang; L. A. Gheorghe; J. d. R. Millán : Single Trial Classification of Neural Correlates of Anticipatory Behavior during Real Car Driving. 2016. 6th International Brain-Computer Interface Meeting, Asilomar, California, USA, May 30-June 3, 2016. DOI : 10.3217/978-3-85125-467-9-75.
H. Zhang; R. Chavarriaga; L. A. Gheorghe; J. d. R. Millán : Brain Correlates of Lane Changing Reaction Time in Simulated Driving. 2015. 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC2015), Hong-Kong, October 9-12, 2015.
H. Renold; R. Chavarriaga; L. A. Gheorghe; J. d. R. Millán : EEG correlates of active visual search during simulated driving: An exploratory study. 2014. 2014 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, USA, October 5-8, 2014.
L. A. Gheorghe; R. Chavarriaga; J. d. R. Millán : Steering Timing Prediction in a Driving Simulator Task. 2013. 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Osaka, Japan, July 3-7, 2013.
H. Zhang; R. Chavarriaga; L. A. Gheorghe; J. d. R. Millán : Inferring Driver’s Turning Direction through Detection of Error Related Brain Activity. 2013. 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Osaka, Japan, July 3-7, 2013.
R. Chavarriaga; L. A. Gheorghe; H. Zhang; Z. Khaliliardali; J. d. R. Millán : Detecting Cognitive States for Enhancing Driving Experience. 2013. 5th International BCI Meeting, Asilomar Conference Center, Pacific Grove, California, June 3-7, 2013. DOI : 10.3217/978-3-85125-260-6-60.
H. Zhang; R. Chavarriaga; M. K. Goel; L. A. Gheorghe; J. d. R. Millán : Improved Recognition of Error Related Potentials through the use of Brain Connectivity Features. 2012. The 34th Annual International Conference of the Engineering in Medicine and Biology Society, San Diego, California, USA, August 28 - September 1, 2012. p. 6740-6743.
Z. Khaliliardali; R. Chavarriaga; L. A. Gheorghe; J. d. R. Millán : Detection of Anticipatory Brain Potentials during Car Driving. 2012. The 34th Annual International Conference of the Engineering in Medicine and Biology Society, San Diego, USA, Aug 28-Sep 1.