|
Sign In to gain access to subscriptions and/or personal tools.
|
The Role of Expertise Research and Human Factors in Capturing, Explaining, and Producing Superior Performance
Neil Charness
Florida State University, Tallahassee, Florida, charnes{at}psy.fsu.edu
Michael Tuffiash
Florida State University, Tallahassee, Florida
Objectives: The goal of this article is to identify some of the major trends and findings in expertise research and their connections to human factors. Background: Progress in the study of superior human performance has come from improved methods of measuring expertise and the development of better tools for revealing the mechanisms that support expert performance, such as protocol analysis and eye tracking. Methods: We review some of the challenges of capturing superior human performance in the laboratory and the means by which the expert performance approach may overcome such challenges. We then discuss applications of the expert performance approach to a handful of domains that have long been of interest to human factors researchers. Results: Experts depend heavily on domain-specific knowledge for superior performance, and such knowledge enables the expert to anticipate and prepare for future actions more efficiently. Training programs designed to focus learners' attention on task-related knowledge and skills critical to expert performance have shown promise in facilitating skill acquisition among nonexperts and in reducing errors by experts on representative tasks. Conclusions: Although significant challenges remain, there is encouraging progress in domains such as sports, aviation, and medicine in understanding some of the mechanisms underlying human expertise and in structuring training and tools to improve skilled performance. Applications: Knowledge engineering techniques can capture expert knowledge and preserve it for organizations and for the development of expert systems. Understanding the mechanisms that underlie expert performance may provide insights into the structuring of better training programs for improving skill and in designing systems to support professional expertise.
References
- Alberdi, E., Becher, J., Gilhooly, K., Hunter, J., Logie, R., Lyon, A., et al. (2001). Expertise and the interpretation of computerized physiological data: Implications for the design of computerized monitoring in neonatal intensive care. International Journal of Human-Computer Studies, 55, 191-216.[CrossRef]
- Bellenkes,A.H., Wickens, C.D., & Kramer,A.F. (1997). Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space, and Environmental Medicine, 68, 569-579.[Medline]
[Order article via Infotrieve]
- Bryan, W.L., & Harter, N. (1899). Studies in the telegraphic language: The acquisition of a hierarchy of habits. Psychological Review, 6, 345-375.[CrossRef]
- Charness, N., & Krampe, R. Th. (2008). Expertise and knowledge. In D. F. Alwin & S. M. Hofer (Eds.), Handbook on cognitive aging: Interdisciplinary perspectives (pp. 244-258). Thousand Oaks, CA: Sage.
- Charness, N., Tuffiash, M., Krampe, R., Reingold, E.M., & Vasyukova, E. (2005). The role of deliberate practice in chess expertise. Applied Cognitive Psychology, 19, 151-165.[CrossRef]
- Chase, W.G., & Ericsson, K.A. (1982). Exceptional memory. American Scientist, 70, 607-615.[Medline]
[Order article via Infotrieve]
- Chase, W.G., & Simon, H.A. (1973). Perception in chess. Cognitive Psychology, 4, 55-81.[Medline]
[Order article via Infotrieve]
- Chi, M.T.H., Feltovich, P., & Glaser, R. (1981). Categorization and representations of physics problems by experts and novices. Cognitive Science, 5, 121-152.
- de Groot, A.D. (1978). Thought and choice in chess (Rev. translation, 1946; 2nd ed.). The Hague, the Netherlands: Mouton.
- Ericsson, K.A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 79, S70-S81.[Medline]
[Order article via Infotrieve]
- Ericsson, K.A. (2006). Protocol analysis and expert thought: Concurrent verbalizations of thinking during experts' performance on representative tasks. In K. A. Ericsson, N. Charness, P. Feltovich & R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 223-242). Cambridge, UK: Cambridge University Press.
- Ericsson, K.A., & Charness, N. (1994). Expert performance: Its structure and acquisition. American Psychologist, 49, 725-747.[CrossRef]
- Ericsson, K. A., Charness, N., Hoffman, R., & Feltovich, P. (Eds.). (2006). Cambridge handbook of expertise and expert performance. Cambridge, UK: Cambridge University Press.
- Ericsson, K.A., Delaney, P.F., Weaver, G., & Mahadevan, R. (2004). Uncovering the structure of a memorist's superior "basic" memory capacity. Cognitive Psychology, 49, 191-237.[CrossRef][Medline]
[Order article via Infotrieve]
- Ericsson, K.A., Krampe, R. Th., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406.[CrossRef]
- Ericsson, K.A., & Lehmann, A.C. (1996). Expert and exceptional performance: Evidence of adaptation to task constraints. Annual Review of Psychology, 47, 273-305.[CrossRef][Medline]
[Order article via Infotrieve]
- Ericsson, K.A., & Williams, M. (2007). Capturing naturally occurring superior performance in the laboratory: Translational research on expert performance. Journal of Experimental Psychology: Applied, 13, 115-123.[CrossRef][Medline]
[Order article via Infotrieve]
- Fadde, P.J. (2006). Interactive video training of perceptual decision-making in the sport of baseball. Technology, Instruction, Cognition and Learning, 4, 265-285.
- Fadde, P.J. (2007). Instructional design for advanced learners: Training recognition skills to hasten expertise. Educational Technology Research and Development. Available from http://www.springerlink.com/content/q8n175627t7500pr/
- Farrow, D., Chivers, P., Hardingham, C., & Sachse, S. (1998). The effect of video-based perceptual training on the tennis return of serve. International Journal of Sport Psychology, 29, 231-242.
- Fitts, P. (1947). Psychological research on equipment designs in the AAF. American Psychologist, 2, 93-98.[CrossRef]
- Fitts, P., Jones, R.E., & Milton, J.L. (1950). Eye movements of aircraft pilots during instrument-landing approaches. Aeronautical Engineering Review, 9, 1-6.
- Furneaux, S., & Land, M.F. (1999). The effects of skill on the eye-hand span during musical sight-reading. Proceedings of the Royal Society of London: Biological Sciences, 266, 2435-2440.[Abstract/Free Full Text]
- Gagne, R. (1954). Training devices and simulators: Some research issues. American Psychologist, 9, 95-107.[Medline]
[Order article via Infotrieve]
- Gopher, D., Weill, M., & Bareket, T. (1994). Transfer of skill from a computer trainer to flight. Human Factors, 36, 387-405.[Medline]
[Order article via Infotrieve]
- Gruson, L. (1988). Rehearsal skill and musical competence: Does practice make perfect? In J. A. Sloboda (Ed.), Generative processes in music: The psychology of performance, improvisation, and composition (pp. 91-112). Oxford, UK: Oxford University Press.
- Hoffman, R.R., Crandall, B., & Shadbolt, N.R. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40, 254-276.[CrossRef]
- Hoffman, R.R., & Lintern, G. (2006). Eliciting and representing the knowledge of experts. In K. A. Ericsson, N. Charness, P. Feltovich, & R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 203-222). Cambridge, UK: Cambridge University Press.
- Hollands, J.G., & Merikle, P.M. (1987). Menu organization and user expertise in information search tasks. Human Factors, 5, 577-586.
- Hunter, J., Ewing, G., Freer, Y., Logie, R., McCue, P., & McIntosh, N. (2003). NEONATE: Effective decision support in the neonatal intensive care unit - A preliminary report. In M. Dojat, E. T. Keravnou, & P. Barahona (Eds.), Artificial intelligence in medicine: 9th Conference on Artificial Intelligence in Medicine in Europe, AIME 2003 (pp. 41-45). Berlin: Springer Verlag.
- Jastrzembski, T., Charness, N., & Vasyukova, C. (2006). Expertise and age effects on knowledge activation in chess. Psychology and Aging, 21, 401-405.[CrossRef][Medline]
[Order article via Infotrieve]
- Jensen, R., & Hunter, D. (2002). General aviation aeronautical decision-making. Washington, DC: FAA.
- Kalyuga, S., Chandler, P., & Sweller, J. (1998). Levels of expertise and instructional design. Human Factors, 40, 1-17.[CrossRef]
- Kirlik, A., Walker, N., Fisk, A.D., & Nagel, K. (1996). Supporting perception in the service of dynamic decision making. Human Factors, 38, 288-299.[Medline]
[Order article via Infotrieve]
- Kneebone, R. (2003). Simulation in surgical training: Educational issues and practical implications. Medical Education, 37, 267-277.[CrossRef][Medline]
[Order article via Infotrieve]
- Koppel, R., Metlay, J.P., Cohen, A., Abaluck, B., Localio, A.R., Kimmel, S.E., et al. (2005). Role of computerized physician order entry systems in facilitating medication errors. Journal of the American Medical Association, 293, 1197-1203.[Abstract/Free Full Text]
- Maran, N.J., & Glavin, R.J. (2003). Low- to high-fidelity simulation: A continuum of medical education. Medical Education, 37, 22-28.[Medline]
[Order article via Infotrieve]
- McKinney, E.H., Jr., & Davis, K.J. (2003). Effects of deliberate practice on crisis decision performance. Human Factors, 45, 436-444.[CrossRef][Medline]
[Order article via Infotrieve]
- Moorthy, K., Munz, Y., Adams, S., Pandey, V., & Darzi, A. (2005). A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Annals of Surgery, 242, 631-639.[CrossRef][Medline]
[Order article via Infotrieve]
- National Transportation Safety Board. (2005 ). Risk factors associated with weather-related general aviation accidents (NTSB/SS-05/01). Washington, DC: Author.
- Patel, V.L., & Groen, G.J. (1986). Knowledge based solution strategies in medical reasoning. Cognitive Science, 10, 91-116.[CrossRef]
- Paull, G., & Glencross, D. (1997). Expert perception and decision making in baseball. International Journal of Sport Psychology, 28, 35-56.
- Prietula, M.J., Feltovich, P.J., & Marchak, F. (2000). Factors influencing analysis of complex cognitive tasks: A framework and example from industrial process control. Human Factors, 42, 56-74.[CrossRef][Medline]
[Order article via Infotrieve]
- Reingold, E.M., Charness, N., Pomplun, M., & Stampe, D.M. (2001). Visual span in expert chess players: Evidence from eye movements. Psychological Science, 12, 48-55.[CrossRef][Medline]
[Order article via Infotrieve]
- Rockwell, T.H., & McCoy, C.E. (1988). General aviation pilot error: A study of pilot strategies in computer simulated adverse weather scenarios. Cambridge, MA: U.S. Department of Transportation.
- Salthouse, T.A. (1986). Perceptual, cognitive, and motoric aspects of transcription typing. Psychological Bulletin, 99, 303-319.[CrossRef][Medline]
[Order article via Infotrieve]
- Salthouse, T.A. (1990). Influence of experience on age differences in cognitive functioning. Human Factors, 32, 551-569.[Medline]
[Order article via Infotrieve]
- Shortliffe, E.H. (1976). Computer-based medical consultations: MYCIN. New York: Elsevier.
- Smeeton, N.J., Williams, A.M., Hodges, N.J., & Ward, P. (2005). The relative effectiveness of various instructional approaches in developing anticipation skill. Journal of Experimental Psychology: Applied, 11, 98-110.[CrossRef][Medline]
[Order article via Infotrieve]
- Sohn, Y.W., &Doane, S.M. (2004). Memory processes of flight situation awareness: Interactive roles of working memory capacity, long-term working memory, and expertise. Human Factors, 46, 461-475.[CrossRef][Medline]
[Order article via Infotrieve]
- Sutter, C., & Ziefle, M. (2005). Interacting with notebook input devices: An analysis of motor performance and users' expertise. Human Factors, 47, 169-187.[CrossRef][Medline]
[Order article via Infotrieve]
- Walsh, T., & Beatty, P.C.W. (2002). Human factors error and patient monitoring. Physiological Measurement, 23, 111-132.[CrossRef]
- Ward, P., Williams, A.M., & Hancock, P. (2006). Simulation for performance and training. In K.A. Ericsson, N. Charness, P. Feltovich, & R. R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 243-262). Cambridge, UK: Cambridge University Press.
- Watson, M., & Sanderson, P. (2004). Sonification supports eyes-free respiratory monitoring and task time-sharing. Human Factors, 46, 497-517.[CrossRef][Medline]
[Order article via Infotrieve]
- Weiss, D.J., & Shanteau, J. (2003). Empirical assessment of expertise. Human Factors, 45, 104-116.[CrossRef][Medline]
[Order article via Infotrieve]
- Wiggins, M., & O'Hare, D. (1995). Expertise in aeronautical weather-related decision making: A cross-sectional analysis of general aviation pilots. Journal of Experimental Psychology: Applied, 1, 305-320.[CrossRef]
- Wiggins, M., & O'Hare, D. (2003). Weatherwise: Evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight. Human Factors, 45, 337-345.[CrossRef][Medline]
[Order article via Infotrieve]
- Williams, A.M., Ward, P., Knowles, J., & Smeeton, N. (2002). Anticipation skill in `real-world' tasks: Measurement, training and transfer. Journal of Experimental Psychology: Applied, 8, 259-270.[CrossRef][Medline]
[Order article via Infotrieve]
Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 50, No. 3,
427-432 (2008)
DOI: 10.1518/001872008X312206

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
|
|