Effect of Working Experience on Air Traffic Controller Eye Movement

Abstract

Eye movement is an important indicator of information-seeking behavior and provides insight into cognitive strategies which are vital for decision-making. Various measures based on eye movements have been proposed to capture humans' ability to process information in a complex environment. The effectiveness of these measures has not yet been fully explored in the field of air traffic management. This paper presents a comparative study on eye-movement measures in air traffic controllers with different levels of working experience. Two commonly investigated oculomotor behaviors, fixation and saccades, together with gaze entropy, are examined. By comparing the statistical properties of the relevant metrics, it is shown that working experience has a notable effect on eye-movement patterns. Both fixation and saccades differ between qualified and novice controllers, with the former type of controller employing more efficient searching strategies. These findings are useful in enhancing the quality of controller training and contributing to an understanding of the information-seeking mechanisms humans use when executing complex tasks.

Keywords

Air traffic control / Human factors / Eye movements / Working experience

References

[[1]] Lee KW, Tillman FA, Higgins JJ. A literature survey of the human reliability component in a man–machine system. IEEE Trans Reliab 1988;37(1):24–34.

[[2]] Boring RL, Hendrickson SML, Forester JA, Tran TQ, Lois E. Issues in benchmarking human reliability analysis methods: a literature review. Reliab Eng Syst Safe 2010;95(6):591–605.

[[3]] Verma S, Tang H, Ballinger D, Chinn F, Kozon T, Farrahi A, et al. Human factors evaluation of conflict detection tool for terminal area. In: Proceedings of the 10th USA/Europe Air Traffic Management Research and Development Semina; 2013 Jun 10–13; Chicago, IL, USA; 2013.

[[4]] Helmke H, Ehr H, Kleinert M, Faubel F, Klakow D. Increased acceptance of controller assistance by automatic speech recognition. In: Proceedings of the 10th USA/Europe Air Traffic Management Research and Development Semina; 2013 Jun 10–13; Chicago, IL, USA; 2013.

[[5]] Amin R, Tang J, Ellejmi M, Kirby S, Abbass HA. Computational red teaming for correction of traffic events in real time human performance studies. In: Proceedings of the 10th USA/Europe Air Traffic Management Research and Development Semina; 2013 Jun 10–13; Chicago, IL, USA; 2013.

[[6]] Reynolds HJD, Lokhande K, Kuffner M, Yenson S. Human–systems integration design process of the air traffic control tower flight data manager. J Cogn Eng Decis Mak 2013;7(3):273. p. 273–92.

[[7]] Mercer J, Homola J, Cabrall C, Martin L, Prevot T. Human–automation cooperation for separation assurance in future NextGen environments. In: Proceedings of the International Conference on Human–Computer Interaction in Aerospace; 2014 Jul 30; Santa Clara, CA, USA. New York: Association for Computing Machinery; 2014.

[[8]] Hunt S, Martin L, Mercer J. Adapting a human–automation trust scale to an air traffic management environment. Proc Hum Factors Ergon Soc Annu Meet 2014;58(1):26–30.

[[9]] Thomas P, Smith N, Palmer E, Callantine T, Lee P, Mercer J, et al. An overview of current capabilities and research activities in the airspace operations laboratory at NASA Ames research center. In: Proceedings of the 14th AIAA Aviation Technology, Integration, and Operations; 2014 Jun 16–20; Atlanta, GA, USA; 2014.

[[10]] Loft S, Sanderson P, Neal A, Mooij M. Modeling and predicting mental workload in en route air traffic control: critical review and broader implications. Hum Factors 2007;49(3):376. p. 376–99.

[[11]] Galy E, Cariou M, Mélan C. What is the relationship between mental workload factors and cognitive load types? Int J Psychophysiol 2012;83(3):269–75.

[[12]] Zhang J, Yang J, Wu C. From trees to forest: relational complexity network and workload of air traffic controllers. Ergonomics 2015;58(8):1320–36.

[[13]] Hasse C, Grasshoff D, Bruder C. Eye-tracking parameters as a predictor of human performance in the detection of automation failures. In: de Waard D, Brookhuis K, Dehais F, Weikert C, Rottger S, Manzey D, editors. Human factors: a view from an integrative perspective. Heidelberg: Springer Berlin Heidelberg; 2012. p. 133–44.

[[14]] Kowler E. Eye movements: the past 25 years. Vision Res 2011;51(13):1457–83.

[[15]] Jacob RJK, Karn KS. Commentary on section 4—eye tracking in human– computer interaction and usability research: ready to deliver the promises. In: Hyönä J, Radach R, Deubel H, editors. The mind’s eye. Amsterdam: NorthHolland; 2003. p. 573–605.

[[16]] Shepley JP, Sanchez J, Johnson GM, Smith E. Eye-tracking analysis of near-term terminal automation for arrival coordination. In: Proceedings of the 9th AIAA Aviation Technology, Integration, and Operations Conference (ATIO); 2009 Sep 21–23; Hilton Head, CA, USA; 2009.

[[17]] May JG, Kennedy RS, Williams MC, Dunlap WP, Brannan JR. Eye movement indices of mental workload. Acta Psychol 1990;75(1):75. p. 75–89.

[[18]] Ha JS, Seong PH. Experimental investigation between attentional-resource effectiveness and perception and diagnosis in nuclear power plants. Nucl Eng Des 2014;278:758–72.

[[19]] Ahlstrom U, Friedman-Berg FJ. Using eye movement activity as a correlate of cognitive workload. Int J Ind Ergon 2006;36(7):623–36.

[[20]] McIntire LK, McKinley RA, Goodyear C, McIntire JP. Detection of vigilance performance using eye blinks. Appl Ergon 2014;45(2 Pt B):354–62.

[[21]] Di Stasi LL, Catena A, Cañas JJ, Macknik SL, Martinez-Conde S. Saccadic velocity as an arousal index in naturalistic tasks. Neurosci Biobehav Rev 2013;37 (5):968–75.

[[22]] Brunyé TT, Drew T, Weaver DL, Elmore JG. A review of eye tracking for understanding and improving diagnostic interpretation. Cogn Res Princ Implic 2019;4(7):1–16.

[[23]] Wu CC, Wolfe JM. Eye movements in medical image perception: a selective review of past, present and future. Vision 2019;3(2):32.

[[24]] Jang YM, Mallipeddi R, Lee S, Kwak HW, Lee M. Human intention recognition based on eyeball movement pattern and pupil size variation. Neurocomputing 2014;128:421–32.

[[25]] Jones RE, Milton JL, Fitts PM. Eye movements of aircraft pilots: I. a review of prior eye movment studies and a description of eye movements during instrument flight USAF technical report. Dayton: Wright-Patterson Air Force Base; 1949. Report No.: 5837.

[[26]] Fitts PM, Jones RE, Milton JL. Eye movements of aircraft pilots during instrument landing approaches. Aeronaut Eng Rev 1950;9(2):1–6.

[[27]] Senders JW. Man’s capacity to use information from complex displays. In: Quastler H, editor. Information theory in psychology. Glencoe: The Free Press; 1955. p. 360–3.

[[28]] Senders JW. The human operator as a monitor and controller of multidegree of freedom system. IEEE Trans Hum Factors Electron 1964;HFE-5(1):2–5.

[[29]] Gottlieb J, Oudeyer PY, Lopes M, Baranes A. Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn Sci 2013;17 (11):585–93.

[[30]] Willems B, Allen RC, Stein ES. Air traffic control specialist visual scanning II: task load, visual noise, and intrusions into controlled airspace. Technical report. Atlantic: Federal Aviation Administration, William J. Hughes Technical Center; 1999. Report No.: DOT/FAA/CT-TN99/2.

[[31]] Fehd HM, Seiffert AE. Eye movements during multiple object tracking: where do participants look? Cognition 2008;108(1):201–9.

[[32]] Van Meeuwen LW, Jarodzka H, Brand-Gruwel S, Kirschner PA, de Bock JJPR, van Merriënboer JJG. Identification of effective visual problem solving strategies in a complex visual domain. Learn Instr 2014;32:10–21.

[[33]] Kang Z, Bass EJ, Lee DW. Air traffic controllers’ visual scanning, aircraft selectdion, and comparison strategies in support of conflict detection. Proc Hum Factors Ergon Soc Annu Meet 2014;58(1):77–81.

[[34]] Kang Z, Landry SJ. An eye movement analysis algorithm for a multielement target tracking task: maximum transition-based agglomerative hierarchical clustering. IEEE T Hum–Mach Syst 2015;45(1):13–24.

[[35]] Wang Y, Vormer F, Hu M, Duong V. Empirical analysis of air traffic controller dynamics. Transp Res C Emerg Technol 2013;33:203–13.

[[36]] Wang Y, Bu J, Han K, Sun R, Hu M, Zhu C. A novel network approach to study communication activities of air traffic controllers. Transp Res C Emerg Technol 2016;68:369–88.

[[37]] Tole JR, Stephens AT, Vivaudou M, Harris RL, Ephrath AR. Entropy, instrument scan and pilot workload. In: IEEE Conference on Systems, Man and Cybernetics; Seattle, WA, USA; 1982.

[[38]] Shiferaw B, Downey L, Crewther D. A review of gaze entropy as a measure of visual scanning efficiency. Neurosci Biobehav Rev 2019;96:353–66.

[[39]] Fisher RA. Statistical methods, experimental design, and scientific inference. Oxford: Oxford University Press; 1990.