|
Sign In to gain access to subscriptions and/or personal tools.
|
Humans: Still Vital After All These Years of Automation
Raja Parasuraman
George Mason University, Fairfax, Virginia, rparasur{at}gmu.edu
Christopher D. Wickens
Alion Science & Technology, Inc., Boulder, Colorado
Objective: The authors discuss empirical studies of human-automation interaction and their implications for automation design. Background: Automation is prevalent in safety-critical systems and increasingly in everyday life. Many studies of human performance in automated systems have been conducted over the past 30 years. Methods: Developments in three areas are examined: levels and stages of automation, reliance on and compliance with automation, and adaptive automation. Results: Automation applied to information analysis or decision-making functions leads to differential system performance benefits and costs that must be considered in choosing appropriate levels and stages of automation. Human user dependence on automated alerts and advisories reflects two components of operator trust, reliance and compliance, which are in turn determined by the threshold designers use to balance automation misses and false alarms. Finally, adaptive automation can provide additional benefits in balancing workload and maintaining the user's situation awareness, although more research is required to identify when adaptation should be user controlled or system driven. Conclusions: The past three decades of empirical research on humans and automation has provided a strong science base that can be used to guide the design of automated systems. Application: This research can be applied to most current and future automated systems.
References
- Abowd, G.W., Mynatt, E.D., & Rodden, T. (2002). The human experience. IEEE Pervasive Computing, 1(1), 48-57.[CrossRef]
- Ahlstrom, V., Longo, M., & Truitt, T. (2005). Human factors design guide (DOT/FAA/CT-02-11). Atlantic City, NJ: Federal Aviation Administration.
- Allendoerfer, K., Friedman-Berg, F., & Pai, S. (2007). Human factors analysis of safety alerts in air traffic control (Tech. Rep. DOT/ FAA/TC-07/22). Atlantic City International Airport, NJ: Federal Aviation Administration William J. Hughes Technical Center.
- Bagheri, N., & Jamieson, G.A. (2004). Considering subjective trust and monitoring behavior in assessing automation-induced "complacency." In D. A. Vicenzi, M. Mouloua, & P. A. Hancock (Eds.), Human performance, situation awareness, and automation (HPSAA II, pp. 54-59). Mahwah, NJ: Erlbaum.
- Bailey, N., & Scerbo, M.W. (2007). Automation-induced complacency for monitoring highly-reliable systems: The role of task complexity, system experience, and operator trust. Theoretical Issues in Ergonomics Science, 8, 321-348.[CrossRef]
- Bailey, N.R., Scerbo, M.W., Freeman, F.G., Mikulka, P.J., & Scott, L.A. (2006). Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation. Human Factors, 48, 693-709.[CrossRef][Medline]
[Order article via Infotrieve]
- Barnes, L.R., Gunfest, E., Hayden, M.H., Schultz, D.M., & Benight, C. (2007). False alarms and close calls: A conceptual model of warning accuracy. Weather and Forecasting, 22, 1140-1147.[CrossRef]
- Billings, C.E., & Woods, D.D. (1994). Concerns about adaptive automation in aviation systems. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 24-29). Hillsdale, NJ: Erlbaum.
- Bliss, J. (2003). An investigation of alarm related accidents and incidents in aviation. International Journal of Aviation Psychology, 13, 249-268.[CrossRef]
- Breznitz, S. (1983). Cry-wolf: The psychology of false alarms. Hillsdale, NJ: Erlbaum.
- Byrne, E.A., & Parasuraman, R. (1996). Psychophysiology and adaptive automation. Biological Psychology, 42, 249-268.[CrossRef][Medline]
[Order article via Infotrieve]
- Cheok, A.D. (2003). Human Pacman: A sensing-based mobile entertainment system with ubiquitous computing and tangible interaction. In Proceedings of the 2nd Workshop on Network and System Support for Games (pp. 106-117). Redwood City, CA: ACM Special Interest Group on Data Communication.
- Crocoll, W.M., & Coury, B.G. (1990). Status or recommendation: Selecting the type of information for decision aiding. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1524-1528). Santa Monica, CA: Human Factors and Ergonomics Society.
- Degani, A. (2004). Taming Hal: Designing interfaces beyond 2001. New York: Palgrave-Macmillan.
- Dixon, S., & Wickens, C.D. (2006). Automation reliability in unmanned aerial vehicle flight control: A reliance-compliance model of automation dependence in high workload. Human Factors, 48, 474-486.[CrossRef][Medline]
[Order article via Infotrieve]
- Dixon, S., Wickens, C.D., & McCarley, J.M. (2007). On the independence of reliance and compliance: Are false alarms worse than misses? Human Factors, 49, 564-572.[Abstract/Free Full Text]
- Dornheim, M. (1999, October 18). Apache tests power of new cockpit tool. Aviation Week and Space Technology, pp. 46-49.
- Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., & Beck, H.P. (2003). The role of trust in automation reliance. International Journal of Human-Computer Studies, 58, 697-718.[CrossRef]
- Endsley, M.R., Bolte, B., & Jones, D.G. (2003). Designing for situation awareness: An approach to user centered design. New York: Taylor & Francis.
- Endsley, M.R., & Kaber, D.B. (1999). Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics, 42, 462-492.[Medline]
[Order article via Infotrieve]
- Endsley, M.R., & Kiris, E.O. (1995). The out-of-the-loop performance problem and level of control in automation. Human Factors, 37, 387-394.
- Farrell, S., & Lewandowsky, S. (2000). Aconnectionistmodel of complacency and adaptive recovery under automation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 395-410.[CrossRef][Medline]
[Order article via Infotrieve]
- Garg, A.X., Adhikari, N.K.J., McDonald, H., Rosas-Arellano, M.P., Devereaux, P.J., Beyene, J., et al. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. Journal of the American Medical Association, 293, 1223-1238.[Abstract/Free Full Text]
- Hancock, P., Chignell, M., & Lowenthal, A. (1985). An adaptive human-machine system. In Proceedings of the IEEE Conference on Systems, Man and Cybernetics (pp. 627-629). Washington, DC: IEEE.
- Hawley, J.K., Mares, A.L., & Giammanco, C.A. (2005). The human side of automation: Lessons for air defense command and control (Tech. Rep. ARL-TR-368). Aberdeen Proving Ground, MD: Army Research Laboratory, Human Research and Engineering Directorate.
- Hilburn, B., Jorna, P.G., Byrne, E.A., & Parasuraman, R. (1997). The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload. In M. Mouloua & J. Koonce (Eds.), Human-automation interaction: Research and practice (pp. 84-91). Mahwah, NJ: Erlbaum.
- Inagaki, T. (1999). Situation-adaptive autonomy: Trading control of authority in human-machine systems. In M. Scerbo & M. Mouloua (Eds.), Automation technology and human performance: Current research and trends (pp. 154-158). Mahwah, NJ: Erlbaum.
- Inagaki, T. (2003). Adaptive automation: Sharing and trading of control. In E. Hollnagel (Ed.), Handbook of cognitive task design (pp. 46-89). Mahwah, NJ: Erlbaum.
- Joint Planning and Development Office (JPDO). ( 2007). Concept for operations of the next generation air transportation system (Vol. 2). Washington, DC: Author.
- Kaber, D.B., & Endsley, M. (2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science, 5, 113-153.[CrossRef]
- Kirlik, A. (1993). Modeling strategic behavior in human-automation interaction: Why an "aid" can (and should) go unused. Human Factors, 35, 221-242.[Medline]
[Order article via Infotrieve]
- Kramer, A., & Parasuraman, R. (2007). Neuroergonomics - application of neuroscience to human factors. In J. Caccioppo, L. Tassinary, & G. Berntson (Eds.), Handbook of psychophysiology (2nd ed., pp. 704-722). New York: Cambridge University Press.
- Kurzweil, R. (1999). The age of spiritual machines: When computers exceed human intelligence. New York: Viking.
- Layton, C., Smith, P.J., & McCoy, E. (1994). Design of a cooperative problem-solving system for en-route flight planning: An empirical evaluation. Human Factors, 36, 94-119.
- Lee, J.D., & Moray, N. (1992). Trust, control strategies, and allocation of function in human machine systems. Ergonomics, 22, 671-691.
- Lee, J.D., & Moray, N. (1994). Trust, self-confidence, and operators' adaptation to automation. International Journal of Human-Computer Studies, 40, 153-184.[CrossRef]
- Lee, J.D., & See, K.A. (2004). Trust in automation and technology: Designing for appropriate reliance. Human Factors, 46, 50-80.[CrossRef][Medline]
[Order article via Infotrieve]
- Lees, N., & Lee, J.D. (2007). The influence of distraction and driving context on driver response to imperfect collision warning systems. Ergonomics, 30, 1264-1286.
- Lorenz, B., DiNocera, F., Roettger, S., & Parasuraman, R. (2002). Automated fault management in a simulated space flight micro-world. Aviation, Space, & Environmental Medicine, 73, 886-897.[Medline]
[Order article via Infotrieve]
- Madhavan, P., & Wiegmann, D.A. (2007). Similarities and differences between human-human and human-automation trust. Theoretical Issues in Ergonomics Science, 8, 277-301.[CrossRef]
- Maltz, M., & Shinar, D. (2004). Imperfect vehicle collision warning systems can aid drivers. Human Factors, 46, 357-366.[CrossRef][Medline]
[Order article via Infotrieve]
- Manzey, D., Bahner, J.E., & Hueper, A.-K. (2006). Misuse of automated aids in process control: Complacency, automation bias, and possible training interventions. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 220-224). Santa Monica, CA: Human Factors & Ergonomics Society.
- Metzger, U., & Parasuraman, R. (2005). Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors, 47, 35-49.[CrossRef][Medline]
[Order article via Infotrieve]
- Meyer, J. (2001). Effects of warning validity and proximity on responses to warnings. Human Factors, 43, 563-572.[CrossRef][Medline]
[Order article via Infotrieve]
- Meyer, J. (2004). Conceptual issues in the study of dynamic hazard warnings. Human Factors, 46, 196-204.[CrossRef][Medline]
[Order article via Infotrieve]
- Meyer, J., & Bitan, Y. (2002). Why better operators receive worse warnings. Human Factors, 44, 343-353.[CrossRef][Medline]
[Order article via Infotrieve]
- Miller, C., & Parasuraman, R. (2007). Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors, 49, 57-75.[Abstract/Free Full Text]
- Moray, N. (1986). Monitoring behavior and supervisory control. In K. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance: Vol. II. Cognitive processes and performance (pp. 40.1-40.51). New York: Wiley.
- Moray, N., & Inagaki, T. (2000). Attention and complacency. Theoretical Issues in Ergonomics Science, 1, 354-365.[CrossRef]
- Morrow, D.G., North, R., & Wickens, C.D. (2006). Reducing and mitigating human error in medicine. In R. S. Nickerson (Ed.), Annual review of human factors and ergonomics (Vol. 1, pp. 254-296). Santa Monica, CA: Human Factors and Ergonomics Society.
- Mouloua, M., Molloy, R., & Parasuraman, R. (1993). Monitoring automation failures: Effects of single and multiadaptive function allocation. In Proceedings of the Human Factors Society 37th Annual Meeting (pp. 1-5). Santa Monica, CA: Human Factors and Ergonomics Society.
- Mundra, A. (1989). A new automation aid for air traffic controllers for improving airport capacity (MP-89W00034). McLean, VA: The MITRE Corporation.
- National Aeronautics and Space Administration (NASA). (2008). National research announcement #IAFD. Washington, DC: Author.
- National Transportation Safety Board. (2006 ). Safety recommendation A-06-44 through -47. Washington, DC: Author.
- Opperman, R. (1994). Adaptive user support. Hillsdale, NJ: Erlbaum.
- Parasuraman, R. (1987). Human-computer monitoring. Human Factors, 29, 695-706.
- Parasuraman, R., Bahri, T., Deaton, J., Morrison, J., & Barnes, M. (1992). Theory and design of adaptive automation in aviation systems (Progress Rep. No. NAWCADWAR-92033-60). Warminster, PA: Naval Air Warfare Center.
- Parasuraman, R., Barnes, M., & Cosenzo, K. (2007). Adaptive automation for human-robot teaming in future command and control systems. International Journal of Command and Control, 1(2), 43-68.
- Parasuraman, R., Galster, S., Squire, P., Furukawa, H., & Miller, C.A. (2005). A flexible delegation interface enhances system performance in human supervision of multiple autonomous robots: Empirical studies with RoboFlag. IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans, 35, 481-493.[CrossRef]
- Parasuraman, R., Hancock, P.A., & Olofinboba, O. (1997). Alarm effectiveness in driver-centered collision-warning systems. Ergonomics, 40, 390-399.[Medline]
[Order article via Infotrieve]
- Parasuraman, R., Molloy, R., & Singh, I.L. (1993). Performance consequences of automation-induced "complacency." International Journal of Aviation Psychology, 3, 1-23.[CrossRef][Medline]
[Order article via Infotrieve]
- Parasuraman, R., Mouloua, M., & Hilburn, B. (1999). Adaptive aiding and adaptive task allocation enhance human-machine interaction. In M. W. Scerbo & M. Mouloua (Eds.), Automation technology and human performance: Current research and trends (pp. 119-123). Mahwah, NJ: Erlbaum.
- Parasuraman, R., Mouloua, M., & Molloy, R. (1996). Effects of adaptive task allocation on monitoring of automated systems. Human Factors, 38, 665-679.[CrossRef][Medline]
[Order article via Infotrieve]
- Parasuraman, R., & Riley, V.A. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230-253.[CrossRef]
- Parasuraman, R., Sheridan, T.B., & Wickens, C.D. (2000). A model of types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 30, 286-297.[CrossRef]
- Parasuraman, R., & Wilson, G. (2008; this issue). Putting the brain to work: Neuroergonomics past, present, and future. Humans Factors, 50, 468-474.
- Patterson, E., Nguyen, A.D., Halloran, J.M., &Asch,S.M. (2004). Human factors barriers to the effective use of ten HIV clinical reminders. Journal of American Medical Informatics Association, 11, 50-59.
- Posner, M.I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3-25.[CrossRef][Medline]
[Order article via Infotrieve]
- Riley, V.A. (2000). Developing a pilot-centered autoflight interface. In Proceedings of the World Aviation Congress and Exposition (pp. 123-128). San Diego: WAC.
- Rouse, W. (1988). Adaptive interfaces for human/computer control. Human Factors, 30, 431-488.
- Rovira, E., McGarry, K., & Parasuraman, R. (2007). Effects of imperfect automation on decision making in a simulated command and control task. Human Factors, 49, 76-87.[Abstract/Free Full Text]
- Sanquist, T.F., Doctor, P., & Parasuraman, R. (in press). A threat display concept for radiation detection in homeland security screening. IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews.
- Sarter, N., Mumaw, R., & Wickens, C.D. (2007). Pilots' monitoring strategies and performance on highly automated flight decks: An empirical study combining behavioral and eye tracking data. Human Factors, 49, 347-357.[Abstract/Free Full Text]
- Sarter, N., & Schroeder, B. (2001). Supporting decision making and action selection under time pressure and uncertainty: The case of in-flight icing. Human Factors, 43, 573-583.[CrossRef][Medline]
[Order article via Infotrieve]
- Sarter, N., & Woods, D. (1992). Pilot interaction with cockpit automation: Operational experiences with the Flight Management System. International Journal of Aviation Psychology, 2, 303-321.[CrossRef]
- Sarter, N., & Woods, D. (2000). Team play with a powerful and independent agent: A full-mission simulation study. Human Factors, 42, 390-402.[CrossRef][Medline]
[Order article via Infotrieve]
- Sarter, N., Woods, D., & Billings, C.E. (1997). Automation surprises. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (2nd ed., pp. 1926-1943). New York: Wiley.
- Sauer, J., & Ruttinger, B. (2007). Automation and decision support in interactive consumer products. Ergonomics, 50, 902-919.[Medline]
[Order article via Infotrieve]
- Scerbo, M. (2007). Adaptive automation. In R. Parasuraman & M. Rizzo (Eds.), Neuroergonomics: The brain at work (pp. 238-252). New York: Oxford University Press.
- Schmorrow, D., Stanney, K., Wilson, G., & Young, P. (2006). Augmented cognition in human-system interaction. In G. Salvendy (Ed.), Handbook of human factors & ergonomics (3rd ed., pp.1364-1384). Hoboken, NJ: Wiley.
- Schneiderman, B. (1992). Designing the user interface: Strategies for effective human-computer interaction. Boston: Addison-Wesley.
- Seagull, F.J., & Sanderson, P.M. (2001). Anesthesia alarms in context: An observational study. Human Factors, 43, 66-78.[CrossRef][Medline]
[Order article via Infotrieve]
- Sheridan, T.B. (2002). Humans and automation: Systems design and research issues. New York: Wiley.
- Sheridan, T.B., & Parasuraman, R. (2000). Human vs. automation in responding to failures: An expected-value analysis. Human Factors, 42, 403-407.[CrossRef][Medline]
[Order article via Infotrieve]
- Sheridan, T.B., & Parasuraman, R. (2006). Human-automation interaction. Reviews of Human Factors and Ergonomics, 1, 89-129.[CrossRef]
- Sheridan, T.B., & Verplank, W.L. (1978). Human and computer control of undersea teleoperators (Technical report). Cambridge, MA: Man Machine Systems Laboratory, MIT.
- Smith, K., Scallen, S.F., Knecht, W., & Hancock, P.A. (1998). An index of dynamic density. Human Factors, 40, 69-78.[CrossRef]
- Sorkin, R.D. (1989). Why are people turning off our alarms? Human Factors Bulletin, 32(4), 3-4.
- Sorkin, R.D., Kantowitz, B.H., & Kantowitz, S.C. (1988). Likelihood alarm displays. Human Factors, 30, 445-459.
- St. John, M., Kobus, D.A., Morrison, J.G., & Schmorrow, D. (2004). Overview of the DARPA augmented cognition technical integration experiment. International Journal of Human-Computer Interaction, 17, 131-149.[CrossRef]
- St. John, M., Smallman, H., Manes, D., Feher, B.A., & Morrison, J.G. (2005). Heuristic automation for decluttering tactical displays. Human Factors, 47, 509-525.[CrossRef][Medline]
[Order article via Infotrieve]
- U.S. Army. (2007). THAAD Theatre High Altitude Area Defense Missile System, USA. Retrieved April 25, 2008, from www.army-technology.com/projects/thaad/
- Warwick, K. (2004). I, cyborg. Champaign: University of Illinois Press.
- Wickens, C.D. (2000). Imperfect and unreliable automation and its implications for attention allocation, information access and situation awareness (Tech. Rep. ARL-00-10/NASA-00-2). Savoy: University of Illinois, Aviation Research Lab.
- Wickens, C.D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 159-177.[CrossRef]
- Wickens, C.D. (2008; this issue). Multiple resources and mental workload. Human Factors, 50, 449-455.[Abstract/Free Full Text]
- Wickens, C.D., & Colcombe, A. (2007). Performance consequences of imperfect alerting automation associated with a cockpit display of traffic information Human Factors, 49, 839-850.[Abstract/Free Full Text]
- Wickens, C.D., & Dixon, S.R. (2007). The benefits of imperfect diagnostic automation: A synthesis of the literature. Theoretical Issues in Ergonomics Science, 8, 201-212.[CrossRef]
- Wickens, C.D., Dixon, S., Goh, J., & Hammer, B. (2005). Pilot dependence on imperfect diagnostic automation in simulated UAV flights: An attentional visual scanning analysis. Paper presented at the 13th International Symposium on Aviation Psychology, April 18-21, Oklahoma City. Retrieved May 12, 2008, from http://www.humanfactors.uiuc.edu/Reports&PapersPDFs/isap05/wicdixgohhamavpsy05.pdf
- Wickens, C.D., Dixon, S.R., Leiden, K., Keller, D., Bagnall, T., Clayton, K., et al. (2008). Addressing the alert problem in air traffic control (Air Traffic Control Facilities Annual Report, FAA Grant #20070271). Las Cruces: New Mexico State University.
- Wickens, C.D., Gempler, K., & Morphew, M.E. (2000). Workload and reliability of predictor displays in aircraft traffic avoidance. Transportation Human Factors, 2, 99-126.[CrossRef]
- Wickens, C.D., & Kessel, C. (1979). The effect of participatory mode and task workload on the detection of dynamic system failures. IEEE Transactions on Systems, Man, and Cybernetics, SMC-9, 21-31.
- Wickens, C.D., Mavor, A., Parasuraman, R., & McGee, J. (1998). The future of air traffic control: Human operators and automation. Washington, DC: National Academy Press.
- Wickens, C.D., Rice, S.R., & Levinthal, B. (in press). Imperfect reliability in unmanned airvehicle supervision and control. InA.W. Evans (Ed.), Human-robotics interaction in future military systems. Brookfield, VT: Ashgate.
- Wiegmann, D., McCarley, J., Kramer, A., & Wickens, C.D. (2006). Age and automation interact to influence performance of a simulated luggage screening task. Aviation, Space, and Environmental Medicine, 77, 825-831.[Medline]
[Order article via Infotrieve]
- Wiener, E.L. (1988). Cockpit automation. In E. L. Wiener & D.C. Nagel (Eds.), Human factors in aviation (pp. 433-461). San Diego: Academic Press.
- Wiener, E.L., & Curry, R.E. (1980). Flight-deck automation: Promises and problems. Ergonomics, 23, 995-1011.
- Wilson, G., & Russell, C.A. (2003). Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Human Factors, 45, 635-644.[CrossRef][Medline]
[Order article via Infotrieve]
- Xiao, Y., Seagull, F.J., Nieves-Khouw, F., Barczak, N., & Perkins, S. (2004). Organizational-historical analysis of the "failure to respond to alarm" problem. IEEE Transactions on Systems, Man, and Cybernetics - Part A, 34, 772-778.[CrossRef]
- Yeh, M., & Wickens, C.D. (2001). Attentional filtering in the design of electronic map displays: A comparison of color-coding, intensity coding, and decluttering techniques. Human Factors, 43, 543-562.[CrossRef][Medline]
[Order article via Infotrieve]
- Yeh, M., Wickens, C.D., & Seagull, F.J. (1999). Target cueing in visual search: The effects of conformality and display location on the allocation of visual attention. Human Factors, 41, 524-542.[Abstract/Free Full Text]
Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 50, No. 3,
511-520 (2008)
DOI: 10.1518/001872008X312198

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
C. D. Wickens
Situation Awareness: Review of Mica Endsley's 1995 Articles on Situation Awareness Theory and Measurement
Human Factors: The Journal of the Human Factors and Ergonomics Society,
June 1, 2008;
50(3):
397 - 403.
[Abstract]
[PDF]
|
 |
|
|
|