Visual attention and steering wheel control: From engagement to disengagement of Tesla Autopilot
Abstract
Previous research indicates that drivers may forgo their supervisory role with partial-automation. We investigated if this behavior change is the result of the time automation was active. Naturalistic data was collected from 16 Tesla owners driving under free-flow highway conditions. We coded glance location and steering-wheel control level around Tesla Autopilot (AP) engagements, driver-initiated AP disengagements, and AP steady-state use in-between engagement and disengagement. Results indicated that immediately after AP engagement, glances downwards and to the center-stack increased above 18% and there was a 32% increase in the proportion of hands-free driving. The decrease in driver engagement in driving was not gradual over-time but occurred immediately after engaging AP. These behaviors were maintained throughout the drive with AP until drivers approached AP disengagement. In conclusion, drivers may not be using AP as recommended (intentionally or not), reinforcing the call for improved ways to ensure drivers’ supervisory role when using partial-automation.
References
Abraham H., McAnulty H., Mehler B., Reimer B. (2017a). Case Study of Today’s Automotive Dealerships: Introduction and Delivery of Advanced Driver Assistance Systems. Transportation research record, 2660(1), 7–14.
Abraham H., Seppelt B., Mehler B., Reimer B. (2017b). What’s in a Name: Vehicle Technology Branding & Consumer Expectations for Automation. Paper presented at the Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Oldenburg, Germany. https://doi-org.ezproxyberklee.flo.org/10.1145/3122986.3123018
Bianchi Piccinini G., Lehtonen E., Forcolin F., Engström J., Albers D., Markkula G., … Sandin J. (2020). How do drivers respond to silent automation failures? Driving simulator study and comparison of computational driver braking models. Human Factors, 62(7), 1212–1229.
Consumer Reports. (2020). Active Driving Assistance Systems: Test Results and Design Recommendations. Retrieved from https://data.consumerreports.org/wp-content/uploads/2020/11/consumerreports-active-driving-assistance-systems-november-16-2020.pdf
De Waard D., Van den Bold T., Lewis-Evans B. (2010). Driver hand position on the steering wheel while merging into motorway traffic. Transportation Research Part F: Traffic Psychology and Behaviour, 13(2), 129–140.
Endsley M. R. (2017). Autonomous driving systems: A preliminary naturalistic study of the Tesla Model S. Journal of Cognitive Engineering and Decision Making, 11(3), 225–238.
Fridman L., Brown D. E., Glazer M., Angell W., Dodd S., Jenik B., . . . Reimer B. (2019). MIT Advanced Vehicle Technology Study: Large-Scale Naturalistic Driving Study of Driver Behavior and Interaction With Automation. IEEE Access, 7, 102021–102038.
Gaspar J., Carney C. (2019). The Effect of Partial Automation on Driver Attention: A Naturalistic Driving Study. Human Factors, 61(8), 1261–1276.
General Motors Corporation Research and Development Center. (2005). Automotive collision avoidance system Field Operational Test: Final program report (DOT HS 809 886). Retrieved from https://www.nhtsa.gov/DOT/NHTSA/NRD/Multimedia/PDFs/Crash%20Avoidance/2005/ACAS%20FOT%20Final%20Program%20Report%20DOT%20HS%20809%20886.pdf
Lamble D., Laakso M., Summala H. (1999). Detection thresholds in car following situations and peripheral vision: Implications for positioning of visually demanding in-car displays. Ergonomics, 42(6), 807–815.
Lin R., Ma L., Zhang W. (2018). An interview study exploring Tesla drivers’ behavioural adaptation. Applied Ergonomics, 72, 37–47. https://doi-org.ezproxyberklee.flo.org/10.1016/j.apergo.2018.04.006
Llaneras R. E., Cannon B. R., Green C. A. (2017). Strategies to assist drivers in remaining attentive while under partially automated driving: Verification of human–machine interface concepts. Transportation research record, 2663(1), 20–26.
Llaneras R. E., Salinger J., Green C. A. (2013, June 17-20). Human factors issues associated with limited ability autonomous driving systems: Drivers’ allocation of visual attention to the forward roadway. Paper presented at the Seventh International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Bolton Landing, New York, USA.
Mackworth N. H. (1948). The breakdown of vigilance during prolonged visual search. Quarterly Journal of Experimental Psychology, 1(1), 6–21.
Malta L., Aust M. L., Faber F., Metz B., Pierre G. S., Benmimoun M., Schäfer R. (2012). EuroFOT Deliverable 6.4 -Final results: Impacts on traffic safety. Retrieved from http://www.eurofot-ip.eu/
Morando A., Gershon P., Mehler B., Reimer B. (2020). Driver-initiated Tesla Autopilot Disengagements in Naturalistic Driving. Paper presented at the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ‘20), Virtual event.
Morando A., Victor T., Dozza M. (2016). Drivers anticipate lead-vehicle conflicts during automated longitudinal control: Sensory cues capture driver attention and promote appropriate and timely responses. Accident Analysis & Prevention, 97, 206–219.
Morando A., Victor T., Dozza M. (2019). A Reference Model for Driver Attention in Automation: Glance Behavior Changes During Lateral and Longitudinal Assistance. IEEE Transactions on Intelligent Transportation Systems, 20(8), 2999–3009.
Mueller A. S., Reagan I. J., Cicchino J. B. (2021). Addressing Driver Disengagement and Proper System Use: Human Factors Recommendations for Level 2 Driving Automation Design. Journal of Cognitive Engineering and Decision Making, 0(0), 1555343420983126.
National Transportation Safety Board. (2020a). Collision Between a Sport Utility Vehicle Operating With Partial Driving Automation and a Crash Attenuator (NTSB/HAR-20/01 PB2020-100112). Retrieved from Washington, DC:
National Transportation Safety Board. (2020b). Collision Between Car Operating with Partial Driving Automation and Truck-Tractor Semitrailer (NTSB/HAB-20/01). Retrieved from Washington, DC:
National Transportation Safety Board. (2020c). Tesla Crash Investigation Yields 9 NTSB Safety Recommendations. Retrieved from https://www.ntsb.gov/news/press-releases/Pages/NR20200225.aspx
Parasuraman R., Riley V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230–230.
Reagan I. J., Cicchino J. B., Kidd D. G. (2020). Driver acceptance of partial automation after a brief exposure. Transportation Research Part F: Traffic Psychology and Behaviour, 68, 1–14. https://doi-org.ezproxyberklee.flo.org/10.1016/j.trf.2019.11.015
Reimer B. (2020). Should Tesla Take The Initiative To Better Monitor And Manage Driver Behavior With Autopilot? Forbes.
SAE. (2018). j3016 -Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems. In: SAE International.
Seppelt B., Reimer B., Angell L., Seaman S. (2017). Considering the Human across Levels of Automation: Implications for Reliance. Paper presented at the 9th International Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Equinox, Manchester Village, Vermont.
Seppelt B., Reimer B., Russo L., Mehler B., Fisher J., Friedman D. (2019). Consumer Confusion With Levels of Vehicle Automation. Paper presented at the 10th International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design.
Seppelt B. D., Victor T. W. (2016). Potential Solutions to Human Factors Challenges in Road Vehicle Automation. In Meyer G., Beiker S. (Eds.), Road Vehicle Automation 3 (pp. 131–148). Cham: Springer International Publishing.
Teoh E. R. (2020). What’s in a name? Drivers’ perceptions of the use of five SAE Level 2 driving automation systems. Journal of Safety Research, 72, 145–151. https://doi-org.ezproxyberklee.flo.org/10.1016/j.jsr.2019.11.005
Tesla. (2019). Model S owner’s manual. In (2019.16.1.1 ed.).
Tivesten E., Dozza M. (2015). Driving context influences drivers’ decision to engage in visual–manual phone tasks: Evidence from a naturalistic driving study. Journal of Safety Research, 53, 87–96.
Tivesten E., Morando A., Victor T. (2015). The timecourse of driver visual attention in naturalistic driving with adaptive cruise control and forward collision warning. Paper presented at the Driver distraction and inattention, Sydney, New South Wales.
Victor T. W., Tivesten E., Gustavsson P., Johansson J., Sangberg F., Ljung Aust M. (2018). Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel. Human Factors, 60(8), 1095–1116.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: November 12, 2021
Issue published: September 2021
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Proceedings of the Human Factors and Ergonomics Society Annual Meeting.
View All Journal MetricsArticle usage*
Total views and downloads: 973
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 0
Crossref: 10
- Visual Attention Patterns in Automated and Manual Lane Change Maneuvers
- Impact of level 2 automation and ADHD symptomatology on young drivers’ attention maintenance
- On the forces of driver distraction: Explainable predictions for the visual demand of in-vehicle touchscreen interactions
- Driver response and recovery following automation initiated disengagement in real-world hands-free driving
- A Novel Bluetooth-Odometer-Aided Smartphone-Based Vehicular Navigation in Satellite-Denied Environments
- (Mis-)use of standard Autopilot and Full Self-Driving (FSD) Beta: Results from interviews with users of Tesla's FSD Beta
- Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia
- Modeling Driver-Automation Interaction using A Naturalistic Multimodal Driving Dataset
- Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
- Beyond gaze fixation: Modeling peripheral vision in relation to speed, Tesla Autopilot, cognitive load, and age in highway driving
Figures and tables
Figures & Media
Tables
View Options
View options
PDF/EPUB
View PDF/EPUBAccess options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
I am signed in as:
View my profileSign out
I can access personal subscriptions, purchases, paired institutional access and free tools such as favourite journals, email alerts and saved searches.
loading institutional access options
HFES members can access this journal content using society membership credentials.
HFES members can access this journal content using society membership credentials.
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
