This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Roth, E. M. Search for Related Content PubMed Articles by Roth, E. M. Social Bookmarking                         What's this?

Uncovering the Requirements of Cognitive Work

Roth Cognitive Engineering, Brookline, Massachusetts, emroth{at}mindspring.com

Objective: In this article, the author provides an overview of cognitive analysis methods and how they can be used to inform system analysis and design. Background: Human factors has seen a shift toward modeling and support of cognitively intensive work (e.g., military command and control, medical planning and decision making, supervisory control of automated systems). Cognitive task analysis and cognitive work analysis methods extend traditional task analysis techniques to uncover the knowledge and thought processes that underlie performance in cognitively complex settings. Methods: The author reviews the multidisciplinary roots of cognitive analysis and the variety of cognitive task analysis and cognitive work analysis methods that have emerged. Results: Cognitive analysis methods have been used successfully to guide system design, as well as development of function allocation, team structure, and training, so as to enhance performance and reduce the potential for error. Conclusions: A comprehensive characterization of cognitive work requires two mutually informing analyses: (a) examination of domain characteristics and constraints that define cognitive requirements and challenges and (b) examination of practitioner knowledge and strategies that underlie both expert and error-vulnerable performance. A variety of specific methods can be adapted to achieve these aims within the pragmatic constraints of particular projects. Application: Cognitive analysis methods can be used effectively to anticipate cognitive performance problems and specify ways to improve individual and team cognitive performance (be it through new forms of training, user interfaces, or decision aids).

References

• Annett, J. (2000). Theoretical and pragmatic influences on task analysis methods. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 27-37). Mahwah, NJ: Erlbaum.
• Armsby, D.H. (1962). Task demands analysis. Human Factors, 4, 381-387.
• Bisantz,A., & Roth, E. (2008).Analysis of cognitive work. In D. A. Boehm-Davis (Ed.), Reviews of human factors and ergonomics (Vol. 3, pp. 1-43). Santa Monica, CA: Human Factors and Ergonomics Society.
• Bisantz, A.M., Roth, E.M., Brickman, B., Gosbee, L., Hettinger, L., & McKinney, J. (2003). Integrating cognitive analyses in a large scale system design process. International Journal of Human Computer Studies, 58, 177-206.[CrossRef]
• Burns, C.M., Bisantz, A.M., & Roth, E.M. (2004). Lessons from a comparison of work domain models: Representational choices and their implications. Human Factors, 46, 711-727.[CrossRef][Medline] [Order article via Infotrieve]
• Burns, C.M., & Hajdukiewicz, J. (2004). Ecological interface design. Boca Raton, FL: CRC Press.
• Card, S., Moran, T., & Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.
• Chi, M., Feltovich, P., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5, 121-152.
• Cooke, N.J. (1994). Varieties of knowledge elicitation techniques. International Journal of Human-Computer Studies, 41, 801-849.[CrossRef]
• Cooke, N.J., Salas, E., Cannon-Bowers, J.A., & Stout, R.J. (2000). Measuring team knowledge. Human Factors, 42, 151-173.[Medline] [Order article via Infotrieve]
• Crandall, B., & Getchell-Reiter, K. (1993). Critical decision method: A technique for eliciting concrete assessment indicators from the "intuition" of NICU nurses. Advances in Nursing Sciences, 16, 42-51.
• Crandall, B., Klein, G.A., & Hoffman, R.R. (2006). Working minds: A practitioner's guide to cognitive task analysis. Cambridge, MA: MIT Press.
• Dekker, S.W.A. (2002). The field guide to human error investigations. London: Ashgate.
• Denihan, M.B. (2007). Decision making in naval aviation: Contextual factors influencing cue and factor saliency. In Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting (pp. 333-337). Santa Monica, CA: Human Factors and Ergonomics Society.
• Eggleston, R.G. (2003). Work-centered design: A cognitive engineering approach to system design. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 263-267). Santa Monica, CA: Human Factors and Ergonomics Society.
• Elm, W.C., Potter, S.S., Gualtieri, J.W., Easter, J.R., & Roth, E.M. (2003). Applied cognitive work analysis: A pragmatic methodology for designing revolutionary cognitive affordances. In E. Hollnagel (Ed.), Handbook of cognitive task design (pp. 357-382). Mahwah, NJ: Erlbaum.
• Endsley, M.R., Bolte, B., & Jones, D.G. (2003). Designing for situation awareness: An approach to user-centered design. New York: Taylor & Francis.
• Ericsson, K.A., & Simon, H.A. (1980). Verbal reports as data. Psychological Review, 87, 215-251.[CrossRef]
• Ericsson, K.A., & Simon, H.A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
• Flanagan, J.C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358.[CrossRef][Medline] [Order article via Infotrieve]
• Glaser, R., Lesgold,A., Lajoie, S., Eastman, R., Greenberg, L., Logan, D., et al. (1985). Cognitive task analysis to enhance technical skills training and assessment (Report). Pittsburg, PA: Learning Research and Development Center, University of Pittsburgh.
• Gray, W.D. (2007). Integrated models of cognitive systems. New York: Oxford University Press.
• Greeno, J.G., Riley, M.S., & Gelman, R. (1984). Conceptual competence and children's counting. Cognitive Psychology, 16, 94-143.[CrossRef]
• Hoffman, R. (1987, Summer). The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Magazine, 8, 53-67.
• Hoffman, R., Crandall, B., & Shadbolt, N. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40, 254-276.[CrossRef]
• Hoffman, R., & Lintern, G. (2006). Eliciting and representing the knowledge of experts. In K. A. Ericsson, N. Charness, P. Feltovich, & R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 203-222). New York: Cambridge University Press.
• Hoffman, R.R., & Militello, L. (2008). Perspectives on cognitive task analysis: Historical origins and modern communities of practice. Boca Raton, FL: CRC Press/Taylor & Francis.
• Hollnagel, E. (2003). Prolegomenon to cognitive task design. In E. Hollnagel (Ed.), Handbook of cognitive task design (pp. 3-15). Mahwah, NJ: Erlbaum.
• Hollnagel, E., & Woods, D.D. (1983). Cognitive systems engineering: New wine in new bottles. International Journal of Man-Machine Studies, 18, 583-600.[CrossRef]
• Hollnagel, E., & Woods, D.D. (2005). Joint cognitive systems: Foundations of cognitive systems engineering. Boca Raton, FL: Taylor & Francis.
• Hutchins, E. (1995a). Cognition in the wild. Cambridge, MA: MIT Press.
• Hutchins, E. (1995b). How a cockpit remembers its speeds. Cognitive Science, 19, 265-288.[CrossRef]
• Jordan, G., & Henderson, A. (1995). Interaction analysis: Foundations and practice. Journal of the Learning Sciences, 4, 39-103.[CrossRef]
• Klein, G. (1989). Recognition-primed decisions. In W. B. Rouse (Ed.), Advances in man-machine systems research (pp. 47-92). Greenwich, CT: JAI Press.
• Klein, G.A. (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.
• Klein, G.A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19, 462-472.[CrossRef]
• Klein, G. A., Orasanu, J., Calderwood, R., & Zsambok, C. E. (Eds.). (1993). Decision making in action: Models and methods. Norwood, NJ: Ablex.
• Klein, G.A., & Wolf, S.P. (1995). Decision-centered training. In Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting (pp. 1242-1252). Santa Monica, CA: Human Factors and Ergonomics Society.
• Klinger, D.W., & Gomes, M.G. (1993). A cognitive systems engineering application for interface design. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting (pp. 16-20). Santa Monica, CA: Human Factors and Ergonomics Society.
• Lesgold, A.M., Feltovich, P.J., Glaser, R., & Wang, Y. (1981). The acquisition of perceptual diagnostic skill in radiology (Tech. Rep. No. PDS-1). Pittsburgh, PA: University of Pittsburgh, Learning Research and Development Center.
• Militello, L.G., & Hutton, R.J.B. (1998). Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding task demands. Ergonomics, 41, 1618-1641.[Medline] [Order article via Infotrieve]
• Miller, R.B. (1953). A method for man-machine task analysis (Rep. 53-137). Dayton, OH: Wright Air Development Center.
• Mumaw, R.J., Roth, E.M., Vicente, K.J., & Burns, C.M. (2000). There is more to monitoring a nuclear power plant than meets the eye. Human Factors, 42, 36-55.[CrossRef][Medline] [Order article via Infotrieve]
• Naikar, N. (2006). Beyond interface design: Further applications of cognitive work analysis. International Journal of Industrial Ergonomics, 36, 423-438.[CrossRef]
• Naikar, N., Pearce, B., Drumm, D., & Sanderson, P.M. (2003). Designing teams for first-of-a-kind, complex systems using the initial phases of cognitive work analysis: A case study. Human Factors, 45, 202-233.[CrossRef][Medline] [Order article via Infotrieve]
• Naikar, N., & Sanderson, P.M. (2001). Evaluating design proposals for complex systems with work domain analysis. Human Factors, 43, 529-542.[CrossRef][Medline] [Order article via Infotrieve]
• Nardi, B.A. (1997). The use of ethnographic methods in design and evaluation. In M. Helander, T. K. Landauer, & P. Prabhu (Eds.), Handbook of human-computer interaction (2nd ed., pp. 361-366). Amsterdam: Elsevier Science B. V.
• Rasmussen, J. (1979). On the structure of knowledge - A morphology of mental models in a man-machine context (Rep. No. M-2192). Roskilde, Denmark: Riso National Laboratory.
• Rasmussen, J. (1986). Information processing and human-machine interaction: An approach to cognitive engineering. New York: North-Holland.
• Rasmusssen, J., & Jensen, A. (1974). Mental procedures in real-life tasks: Acase study of electronic troubleshooting. Ergonomics, 17, 293-307.[Medline] [Order article via Infotrieve]
• Rasmussen, J., Pejtersen, A.M., & Goodstein, L.P. (1994). Cognitive systems engineering. New York: Wiley.
• Rasmussen, J., & Vicente, K.J. (1989). Coping with human errors through system design: Implications for ecological interface design. International Journal of Man-Machine Studies, 31, 517-534.[CrossRef]
• Roth, E.M., Lin, L., Kerch, S., Kenney, S.J., & Sugibayashi, N. (2001). Designing a first-of-a kind group view display for team decision making: A case study. In E. Salas & G. Klein (Eds.), Linking expertise and naturalistic decision making (pp. 113-135). Mahwah, NJ: Erlbaum.
• Roth, E.M., Multer, J., & Raslear, T. (2006). Shared situation awareness as a contributor to high reliability performance in railroad operations. Organization Studies, 27, 967-987.[Abstract/Free Full Text]
• Roth, E.M., & Patterson, E.S. (2005). Using observational study as a tool for discovery: Uncovering cognitive and collaborative demands and adaptive strategies. In H. Montgomery, R. Lipshitz, & B. Brehmer (Eds.), How professionals make decisions (pp. 379-393). Mahwah, NJ: Erlbaum.
• Roth, E.M., Stilson, M., Scott, R., Whitaker, R., Kazmierczak, T., Thomas-Meyers, G., et al. (2006). Work-centered design and evaluation of a C2 visualization aid. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 332-336). Santa Monica, CA: Human Factors and Ergonomics Society.
• Roth, E.M., & Woods, D.D. (1988). Aiding human performance 1: Cognitive analysis. Le Travail Humain, 41, 39-64.
• Sanderson, P.M. (2003). Cognitive work analysis. In J. M. Carroll (Ed.), HCI models, theories, and frameworks: Toward a multi-disciplinary science (pp. 225-264). San Francisco: Morgan Kaufmann.
• Schaafstal, A., Schraagen, J.M., & van Berlo, M. (2000). Cognitive task analysis and innovation of training: A case of structured troubleshooting. Human Factors, 42, 75-86.[CrossRef][Medline] [Order article via Infotrieve]
• Schraagen, J. M., Chipman, S. F., & Shalin, V. L. (Eds.). (2000). Cognitive task analysis. Mahwah, NJ: Erlbaum.
• Scott, R., Roth, E.M., Deutsch, S.E., Malchiodi, E., Kazmierczak, T., Eggleston, R., et al. (2005). Work-centered support systems: A human-centered approach to intelligent system design. IEEE Intelligent Systems, 20, 73-81.[CrossRef]
• Suchman, L. (1987). Plans and situated actions. Cambridge, UK: Cambridge University Press.
• Taylor, F.W. (1911). Principles of scientific management. New York: Harper & Row.
• Vicente, K.J. (1999). Cognitive work analysis. Mahwah, NJ: Erlbaum.
• Watson, M.O., & Sanderson, P.M. (2007). Designing for attention with sound: Challenges and extensions to ecological interface design. Human Factors, 49, 331-346.[Abstract/Free Full Text]
• Woods, D.D. (1993). Process tracing methods for the study of cognition outside of the experimental psychology laboratory. In G. A. Klein, J. Orasanu, R. Calderwood, & C. E. Zsambok (Eds.), Decision-making in action: Models and methods (pp. 228-251). Norwood, NJ: Ablex.
• Woods, D.D., & Hollnagel, E. (1987). Mapping cognitive demands in complex problem-solving worlds. International Journal of Man-Machine Studies, 26, 257-275.[CrossRef]
• Woods, D.D., & Hollnagel, E. (2006). Joint cognitive systems: Patterns in cognitive systems engineering. Boca Raton, FL: Taylor & Francis.
• Woods, D.D., & Roth, E.M. (1988). Cognitive engineering: Human problem-solving with tools. Human Factors, 30, 415-430.
• Xu, W. (2007). Identifying problems and generating recommendations for enhancing complex systems: Applying the abstraction hierarchy framework as an analytic tool. Human Factors, 49, 975-994.[Abstract/Free Full Text]

Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 50, No. 3, 475-480 (2008)
DOI: 10.1518/001872008X288556


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Roth, E. M. Search for Related Content PubMed Articles by Roth, E. M. Social Bookmarking                         What's this?