This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by McGuirl, J. M. Articles by Sarter, N. B. Search for Related Content PubMed Articles by McGuirl, J. M. Articles by Sarter, N. B. Social Bookmarking                         What's this?

Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information

Ohio State University, Columbus, Ohio

Nadine B. Sarter

University of Michigan, Ann Arbor, Michigan

Objective: To examine whether continually updated information about a system's confidence in its ability to perform assigned tasks improves operators' trust calibration in, and use of, an automated decision support system (DSS). Background: The introduction of decision aids often leads to performance breakdowns that are related to automation bias and trust miscalibration. This can be explained, in part, by the fact that operators are informed about overall system reliability only, which makes it impossible for them to decide on a case-by-case basis whether to follow the system's advice. Method: The application for this research was a neural net-based decision aid that assists pilots with detecting and handling in-flight icing encounters. A multifactorial experiment was carried out with two groups of 15 instructor pilots each flying a series of 28 approaches in a motion-base simulator. One group was informed about the system's overall reliability only, whereas the other group received updated system confidence information. Results: Pilots in the updated group experienced significantly fewer icing-related stalls and were more likely to reverse their initial response to an icing condition when it did not produce desired results. Their estimate of the system's accuracy was more accurate than that of the fixed group. Conclusion: The presentation of continually updated system confidence information can improve trust calibration and thus lead to better performance of the human-machine team. Application: The findings from this research can inform the design of decision support systems in a variety of event-driven high-tempo domains.

Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 48, No. 4, 656-665 (2006)
DOI: 10.1518/001872006779166334


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?