Chapter 7 Part II — The System Design Lifecycle
System Design, Human Factors, Usability, and Clinical Decision Support
Designing clinical systems around human cognitive work, safe interaction, and decision support rather than around software capability alone.
Chapter Orientation
Clinical systems are used under interruption, uncertainty, time pressure, and competing demands. A screen that looks clean during a demonstration may fail when a nurse is managing five patients, a medication alert interrupts a handoff, or critical information is distributed across multiple tabs.
Human factors and usability are therefore patient-safety disciplines. They ask whether the system supports human capabilities and limitations. Clinical decision support adds another layer: the system is not merely displaying information but attempting to influence a decision or action.
Learning Objectives
By the end of this chapter, you should be able to:
- Explain human factors and usability in clinical informatics.
- Distinguish usability dimensions such as effectiveness, efficiency, and satisfaction.
- Identify cognitive load, memory burden, visibility, consistency, and error-recovery issues.
- Use prototypes and heuristic evaluation appropriately.
- Explain the major forms and workflow requirements of clinical decision support.
- Analyze alert fatigue, automation bias, and overreliance.
- Design CDS around timing, recipient, actionability, and measurement.
Lesson 7.1 — Human Factors: Design for the Human Who Actually Shows Up
-
Human factors studies the relationship between people, tasks, tools, environment, and system design. The goal is not to make users more careful; it is to design work so normal human limitations are less likely to produce harm. Memory is limited, attention is selective, interruptions are common, and people develop shortcuts under pressure.
-
Cognitive load is a design variable. A nurse who must remember a result from one screen while navigating through three menus to act on it is carrying avoidable working-memory burden. Systems should externalize important information when possible through clear displays, task state, and meaningful defaults.
-
Visibility affects action. Information can technically exist in the chart while being functionally invisible. A critical code-status field buried several clicks away may satisfy documentation requirements without supporting time-sensitive care.
-
Consistency reduces the need to relearn. If the same clinical concept appears in different locations or uses different labels across modules, users must translate constantly. Some variation is clinically necessary, but arbitrary variation increases cognitive work.
-
Error recovery matters as much as error prevention. Users will make mistakes. Safe design allows them to notice, undo, correct, and understand consequences. A destructive action with no confirmation or clear recovery path turns ordinary slips into larger failures.
Clinical Example
Clinical Example — The Hidden Allergy Detail
An EHR displays an allergy icon prominently but requires a separate window to view reaction severity. During medication administration, nurses often see “penicillin allergy” without noticing that the recorded reaction is mild intolerance rather than anaphylaxis. The system contains the detail but does not present it at the decision point. Human factors asks what information should be visible when the user must act.
NI-BC Connection: System Design Lifecycle — evaluating user experience, usability, ergonomics.
Retrieval Checkpoint
Retrieval Checkpoint
- Why is human factors different from telling users to be more careful?
- Give an example of avoidable working-memory burden in an EHR.
- What is the difference between information existing and information being visible?
- Why should design include error recovery?
Lesson 7.2 — Usability Is Measurable
-
Usability concerns whether intended users can achieve intended goals effectively, efficiently, and with acceptable experience in the intended context. A system can be learnable but inefficient, attractive but error-prone, or fast for experts but confusing for occasional users.
-
Task-based testing is more informative than asking whether users “like” the system. Give representative users realistic tasks and measure completion, errors, time, navigation, help needed, and points of confusion. Satisfaction matters, but it should be interpreted alongside performance and safety.
-
Heuristic evaluation uses established design principles to identify likely problems. Common heuristics include visibility of system status, match with the real world, user control, consistency, error prevention, recognition rather than recall, and clear recovery. Heuristics do not replace user testing; they help find problems early and cheaply.
-
Representative users and environments matter. Testing with informatics staff who already know the build underestimates difficulty. Include novice and experienced users, relevant roles, device types, and realistic interruptions when possible.
-
Usability is not a one-time certification event. New content, devices, upgrades, and workflow changes can create new usability problems. Post-go-live tickets and workarounds are usability evidence.
AI in Practice
AI in Practice — Heuristic Critique of a Mockup
An LLM with vision can generate hypotheses about inconsistent labels, crowded layouts, weak hierarchy, or unclear actions from a screenshot or prototype. Treat this as a preliminary heuristic review. It cannot substitute for representative-user testing because it does not experience the workflow, interruptions, or organizational context.
NI-BC Connection: System Design Lifecycle — user experience, adoption, satisfaction, usability heuristics, ergonomics.
Retrieval Checkpoint
Retrieval Checkpoint
- What dimensions should be considered besides satisfaction when evaluating usability?
- Why are realistic tasks more useful than asking users whether they like a screen?
- How do heuristic review and user testing differ?
- Why should usability be reevaluated after go-live?
Lesson 7.3 — Prototyping and Clinical Content Design
-
A prototype is a learning tool, not a promise. Low-fidelity sketches help test information organization and workflow before expensive build. Higher-fidelity prototypes help test interaction details. Teams should state what is fixed and what remains open so users do not mistake a prototype for final design.
-
Clinical content should be designed around decisions and work, not around the database schema. A field may be easy for the system to store but awkward for clinicians to interpret. Group information according to clinical meaning, sequence, and decision points.
-
Defaults reduce effort but can create silent error. A default is appropriate when it is correct most of the time and the user can easily see and change it. Defaults are dangerous when users may accept them without reassessment, especially for time-sensitive clinical facts.
-
Structured data and narrative serve different purposes. Structured fields support consistency, decision support, exchange, and analytics. Narrative captures nuance and context that predefined categories may miss. Good design uses structure where standardization matters and narrative where meaningful variation cannot be represented safely.
Informatics in Practice
Informatics in Practice — Ask “What Decision Does This Screen Support?”
If the answer is only “documentation,” the design may be missing the clinical purpose. Even regulatory documentation exists within a care process. Identify what the user needs to notice, decide, communicate, or hand off at that point.
NI-BC Connection: System Design Lifecycle — clinical content building, prototypes, templates, workflow maps.
Retrieval Checkpoint
Retrieval Checkpoint
- Why should prototypes be treated as learning tools?
- What risk can defaults create?
- When is structured data preferable to free text?
- What question connects screen design back to clinical purpose?
Lesson 7.4 — Clinical Decision Support Is About the Decision
-
Clinical decision support (CDS) uses patient- or context-specific information to support a clinical or operational decision. CDS includes alerts, reminders, order sets, dosing support, risk scores, documentation guidance, and relevant information display. Merely displaying data is not necessarily CDS; the system must meaningfully support a decision or action.
-
The “five rights” idea is a useful design test: right information, right person, right format, right channel, right time. A correct recommendation delivered after the decision is useless. A relevant alert sent to someone who cannot act creates noise. A complex explanation in a high-interruption moment may fail even if accurate.
-
Actionability is central. Good CDS should make the next appropriate action clear or reduce the effort required to act. Alerts that say “consider reviewing” without context may transfer cognitive burden to the clinician rather than support the decision.
-
CDS needs a closed-loop evaluation. Measure not only firing rate and clicks but whether the intended clinical action occurred, whether unintended actions increased, whether the effect persists, and whether some groups experience different performance or burden.
Figure
Figure 7.1 — Clinical Decision Support as a Closed Loop
Visual structure: Patient/context data → logic/model → intervention → clinician interpretation → action → clinical/workflow outcome → monitoring → logic/design refinement.
Alt text: Closed-loop CDS lifecycle connecting source data, decision logic, clinician action, outcomes, and monitoring.
NI-BC Connection: System Design Lifecycle — evidence-based care in CDS logic; clinical content design.
Retrieval Checkpoint
Retrieval Checkpoint
- What distinguishes CDS from simple information display?
- Explain the importance of timing and recipient in CDS.
- What makes a CDS intervention actionable?
- Why should CDS evaluation extend beyond firing and click rates?
Lesson 7.5 — Alert Fatigue, Automation Bias, and Overreliance
-
Alert fatigue is not simply “too many alerts.” It is a deterioration in appropriate response associated with repeated exposure to alerts that are excessive, low-value, poorly timed, or irrelevant. Recent systematic review work shows that alert-fatigue measurement remains inconsistently defined; override rate alone does not prove fatigue.
-
Override can be appropriate. A clinician may correctly dismiss an alert because the system lacks context. A high override rate should trigger investigation of specificity, timing, duplication, actionability, and workflow rather than automatic blame.
-
Automation bias occurs when people give excessive weight to automated recommendations. The opposite problem can also occur: repeated poor recommendations create distrust and underuse. Safe design needs calibrated trust—users should understand what the system is good at, where uncertainty exists, and when independent verification is necessary.
-
Explanations must support action, not decorate the output. A risk score labeled “high” without contributing factors or recommended next steps may not help the clinician. For AI-supported CDS, provenance, intended use, limitations, and relevant inputs become increasingly important.
-
Monitoring should look for both under-response and over-response. A highly sensitive alert may cause unnecessary testing; an AI recommendation may be followed too readily; a sepsis score may alter care differently across units. Evaluation should compare benefits, burden, and harm.
Clinical Example
Clinical Example — 92% Override Rate
A medication alert has a 92% override rate. Review shows that many alerts fire for historical orders and duplicate a pharmacy review already completed. Some overrides are clinically appropriate. The response is not simply to retrain prescribers; the team changes firing logic, removes duplicates, and monitors whether the remaining alerts receive more appropriate attention.
NI-BC Connection: System Design Lifecycle — usability, adoption, clinical decision support.
Retrieval Checkpoint
Retrieval Checkpoint
- Why does a high override rate not prove alert fatigue?
- What is automation bias?
- What does calibrated trust mean?
- Name two ways CDS can cause harm besides missing a true problem.
- What should be monitored after alert logic is changed?
Chapter Case Study — The Sepsis Alert Redesign
A hospital’s sepsis alert fires frequently in the emergency department and inpatient units. Physicians override 84% of alerts. Nurses report that alerts often appear after they have already escalated concerns. The quality department wants the alert to become interruptive for everyone. The vendor proposes a new predictive model with better retrospective discrimination.
A usability review finds that the alert does not show which variables drove the score. In the ED, clinicians receive several other interruptive alerts during triage. On medical units, the alert often reaches the assigned nurse, who may be unable to initiate the recommended order set. Leadership wants a rapid solution because sepsis performance is under scrutiny.
Analyze the case
- What evidence is needed before concluding that alert fatigue is the main problem?
- How do timing, recipient, and actionability differ across the ED and inpatient workflow?
- Why is better retrospective model discrimination insufficient to justify implementation?
- What human-factors risks could an interruptive design create?
- What information should be presented to support calibrated trust?
- Propose outcome, process, and balancing measures for the redesign.
Chapter Synthesis
- Human factors treats normal human limitations as design inputs.
- Usability is measured through performance, safety, efficiency, and experience.
- Prototypes should expose assumptions before build becomes expensive.
- CDS succeeds only when information reaches the right person at the right time in an actionable form.
- Alert behavior must be interpreted, not moralized. Override, fatigue, and automation bias require evidence and workflow context.
Key Terminology
- Human factors
- Discipline examining interactions among people, tasks, tools, environments, and systems to improve performance and safety.
- Usability
- Degree to which specified users can achieve specified goals effectively, efficiently, and satisfactorily in a specified context.
- Cognitive load
- Mental effort required to process information and perform a task.
- Heuristic evaluation
- Expert review using established usability principles.
- Prototype
- Preliminary representation used to test assumptions and design ideas.
- Clinical decision support
- Patient- or context-specific information and logic designed to support clinical decisions or actions.
- Alert fatigue
- Reduced appropriate response associated with sustained exposure to excessive or low-value alerts.
- Automation bias
- Tendency to over-rely on automated recommendations or outputs.
- Calibrated trust
- Level of trust appropriately matched to system capability and uncertainty.
NI-BC Chapter Mapping
| Domain | Blueprint area | Lessons | Depth |
|---|---|---|---|
| II. Lifecycle | Clinical content building | 7.3 | Applied |
| II. Lifecycle | Systems supporting workflow / CDS | 7.4 | Applied |
| II. Lifecycle | Prototypes and workflow maps | 7.3 | Applied |
| II. Lifecycle | User experience, adoption, satisfaction, heuristics, ergonomics | 7.1, 7.2, 7.5 | Applied |
Chapter Quiz
Answer each question, then select “Check answer” to reveal feedback. For Select All That Apply items, choose every correct option before checking. Expand “Why?” after checking to read the rationale.
A nurse must remember a lab value while navigating several screens to act on it. This primarily represents:
Why?
Forcing a nurse to remember information while navigating multiple screens creates avoidable working-memory and cognitive-load demands.
Which usability method best measures whether representative nurses can safely complete a workflow?
Why?
Task-based testing with representative users directly evaluates whether the intended workflow can be completed safely and effectively.
Useful usability measures include:Select all that apply
Why?
Completion, errors, time, assistance, and satisfaction are useful usability measures. Server age does not measure user interaction quality.
What is the greatest risk of an inappropriate default in a clinical form?
Why?
A poorly chosen default can be accepted without active reassessment, allowing stale or incorrect data to propagate into clinical documentation.
Which is the best example of CDS?
Why?
CDS combines patient-specific information with knowledge or logic at a decision point; a renal-dose warning at medication ordering is a clear example.
Which statement best explains the “right time” in CDS?
Why?
Decision support must arrive while the responsible user can still act on the decision. Technically early or late information can be clinically useless.
A high alert override rate may reflect:Select all that apply
Why?
Overrides may reflect poor specificity, timing, duplication, missing context, or sound clinical judgment. A high override rate alone does not prove alert fatigue.
Automation bias is most likely when:
Why?
Automation bias is over-reliance on automated recommendations at the expense of sufficient independent review.
What is the strongest reason to include contributing factors with an AI risk score?
Why?
Contributing factors can help users interpret why a score is elevated and support appropriately calibrated trust, though they do not replace validation.
Evaluation of a new alert should examine:Select all that apply
Why?
Alert evaluation should include outcomes, responses, unintended care, burden, and subgroup effects; firing count alone cannot establish value or safety. —
References and Further Reading
- Park, S., Marquard, J., Austin, R. R., Pieczkiewicz, D., Jantraporn, R., & Delaney, C. W. (2024). A systematic review of nurses’ perceptions of electronic health record usability based on the human factor goals of satisfaction, performance, and safety. Computers, Informatics, Nursing, 42(3), 168–175. https://doi.org/10.1097/CIN.0000000000001084
- Assistant Secretary for Technology Policy / Office of the National Coordinator for Health Information Technology. (2025). SAFER Guides. https://healthit.gov/clinical-quality-and-safety/safer-guides
- Agency for Healthcare Research and Quality. Improving Electronic Health Record Usability for Patient Safety. https://digital.ahrq.gov/program-overview/research-stories/improving-electronic-health-record-usability-patient-safety
- International Organization for Standardization. (2019; confirmed 2025). ISO 9241-210:2019 Ergonomics of human-system interaction—Part 210: Human-centred design for interactive systems. https://www.iso.org/standard/77520.html
- Middleton, B., Bloomrosen, M., Dente, M. A., et al. (2013). Enhancing patient safety and quality of care by improving the usability of electronic health record systems: Recommendations from AMIA. Journal of the American Medical Informatics Association, 20(e1), e2–e8. https://doi.org/10.1136/amiajnl-2012-001458
- Ray, C. E., Wilson, G. M., Hughes, A. M., et al. (2026). Alert fatigue measurement in clinical decision support: A systematic review. Journal of the American Medical Informatics Association, 33(8), 1523–1531. https://doi.org/10.1093/jamia/ocag064