Automation bias

From automation, ultimately Greek automatos, "self-acting." The term arose in human-factors research on aviation and clinical systems in the 1990s (notably work by Mosier and Skitka), which found operators would follow a computer’s recommendation and even ignore contradictory instruments — errors of both commission and omission.

  1. noun · /aw-tuh-MAY-shun BY-us/

    The tendency to over-trust automated systems, accepting their outputs even when your own judgment or the evidence disagrees.

    Why people drive into lakes because the GPS said so — a machine’s confident answer can override the senses telling you it’s wrong.

    Automation bias let the radiologist wave past a tumor the AI had flagged as clear.

    Anchoring effect fixes you to a starting number; automation bias fixes you to a machine’s verdict as the default truth.