返回 Papers
AI 扩展计划 / Playbooks

AI Product Responsibility / Accountability Boundary Playbook

Important note: this playbook is an execution guide for product, architecture, BA, and internal governance work. It is not legal advice, regulatory advice, audit opinion, model validation, contract in

597AI_PRODUCT_RESPONSIBILITY_ACCOUNTABILITY_BOUNDARY_PLAYBOOK.md

AI Product Responsibility / Accountability Boundary / Decision Ownership Playbook

Applicable audience: Senior AI PM, AI Architect, Enterprise Architect, CBAP-level BA, Product Governance Lead, Model Risk Partner, Risk / Compliance Partner, Operations Owner, Vendor Owner, Platform Owner, and Financial Retail Business Owner. Core question: how do teams execute responsibility boundary design so AI product promises, human accountability, vendor/platform responsibilities, release gates, customer recourse, and executive evidence are explicit before launch and measurable after launch?

Important note: this playbook is an execution guide for product, architecture, BA, and internal governance work. It is not legal advice, regulatory advice, audit opinion, model validation, contract interpretation, liability conclusion, or release approval. Formal decisions must be made by institution-authorized roles using applicable jurisdiction, product scope, customer impact, internal policy, contracts, and governance forums.


1. Source Anchors

Access discipline: official anchors reviewed for this learning artifact on 2026-06-30. Use these sources as governance and evidence design anchors, not as automatic compliance conclusions.

AnchorOfficial linkPlaybook use
NIST AI Risk Management Frameworkhttps://www.nist.gov/itl/ai-risk-management-frameworkStructure responsibility work through Govern, Map, Measure, and Manage activities.
ISO/IEC 42001 AI management systemhttps://www.iso.org/standard/81230.htmlDefine scope, roles, operation, performance evaluation, management review, and improvement.
ISO/IEC/IEEE 42010 Architecture Descriptionhttps://www.iso.org/standard/74393.htmlCreate views for product promise, decision ownership, human oversight, vendor boundary, and evidence trace.
ISO/IEC/IEEE 29148 Requirements Engineeringhttps://www.iso.org/standard/72089.htmlConvert stakeholder needs and product claims into requirements, acceptance criteria, verification, validation, and traceability.
OECD AI Principleshttps://oecd.ai/en/ai-principlesAnchor human-centered values, transparency, robustness, safety, security, and accountability expectations.

2. One-Page Executive Summary

Responsibility boundary work converts vague AI governance into executable product decisions:

Product promise
-> AI behavior boundary
-> decision and action rights
-> human accountability
-> vendor/platform boundary
-> recourse and harm prevention
-> release gate evidence
-> residual risk ownership
-> post-release monitoring

The playbook has five operating principles:

PrincipleExecution meaning
Start from promiseDefine what the product claims before debating model metrics
Separate AI rolesRetrieval, summarization, recommendation, decision, drafting, execution, and escalation carry different responsibilities
Name decision rightsDecision authority, action authority, exception authority, stop authority, and residual risk authority must be explicit
Prove human accountabilityHumans need authority, evidence, capacity, training, escalation, and audit trail
Tie boundary to recourseCustomers must be able to challenge, correct, recover, or reach a human when AI influences high-impact outcomes

Recommended operating artifact set:

1. Responsibility Boundary Canvas
2. Product Promise Inventory
3. AI Behavior Boundary Matrix
4. Decision Ownership Map
5. Human Accountability Evidence Pack
6. Vendor / Platform Shared Responsibility Matrix
7. Customer Harm and Recourse Map
8. Release Gate Decision Record
9. Residual Risk Record
10. Executive Accountability Evidence Pack

3. Quick Start Workflow

Use this workflow for a new AI product, a material feature change, or a scale decision.

StepOutputOwnerPass condition
1. Identify product promiseProduct promise inventoryAI PMClaims, exclusions, customer/user audience, and evidence owner are explicit
2. Classify AI behaviorAI behavior boundary matrixPM + BA + ArchitectAI role is classified as retrieve, summarize, classify, recommend, draft, decide, execute, or escalate
3. Map decisions and actionsDecision ownership mapBA + PMDecision authority and action authority are separated
4. Design human accountabilityHuman accountability evidence packOps + PM + BAReviewer authority, capacity, UI evidence, training, and escalation are proven
5. Define vendor/platform boundaryShared responsibility matrixArchitect + Vendor / Platform OwnerData, model, logs, versioning, SLA, incident, and exit boundaries are documented
6. Link recourse and harmHarm and recourse mapPM + Ops + RiskCustomer challenge, correction, remediation, and evidence path are defined
7. Build release evidenceGate decision recordPM + Architect + RiskEvidence supports release scope, conditions, exceptions, and stop triggers
8. Assign residual riskResidual risk recordBusiness Owner + RiskOwner, scope, expiry, monitoring, and escalation are named
9. Launch with monitoringBoundary dashboardPM + SRE + OpsBreach signals trigger action
10. Review and improveManagement action logGovernance forumActions close with evidence and product boundary is refreshed

4. Operating Model

4.1 Core Roles

RoleResponsibility in this playbook
AI PMOwns product promise, scope, user value, boundary narrative, release recommendation, and executive evidence
CBAP-level BAOwns decision modeling, process impact, stakeholder needs, rules, exceptions, escalation, and traceability
AI ArchitectOwns responsibility architecture views, system boundaries, logs, versioning, tool permissions, rollback, and platform controls
Business OwnerAccountable for business outcome, customer-impacting decisions, and residual risk within authorized scope
Operations OwnerOwns SOP, staffing, training, human review, queue management, escalation, and action closure
Risk / Compliance PartnerChallenges customer impact, control design, recourse, residual risk, and governance evidence
Model Risk / Eval LeadOwns eval approach, model performance evidence, reviewer calibration, and critical failure analysis
Vendor / Platform OwnerOwns shared responsibility evidence, service monitoring, change notices, incident routing, and exit readiness
Executive SponsorOwns funding, strategic priority, scale/stop decision, and management action when residual risk exceeds appetite

4.2 Forum Design

ForumFrequencyDecisions
Boundary design workshopBefore pilot or material changeProduct promise, AI role, decision ownership, human boundary
Release readiness gateBefore pilot, release, and scaleGo, conditional go, hold, stop, or reduce scope
Weekly boundary operations reviewDuring pilot and early launchOverrides, escalations, incidents, recourse, queue pressure
Monthly product accountability reviewAfter launchProduct promise evidence, residual risk, customer harm, vendor changes
Quarterly management reviewPortfolio levelScale, restrict, retire, invest, update governance, refresh controls

5. Responsibility Boundary Canvas

Use this canvas as the first artifact.

FieldGuidanceExample
use_case_idStable identifierAI-DISPUTE-EVIDENCE-2026-01
business capabilityCapability affectedPayment dispute operations
product promiseSpecific claimReduce incomplete dispute evidence packets
customer-visible impactMoney, access, eligibility, advice, explanation, delay, privacy, or nonePotential dispute outcome and explanation
internal userRole using AIClaims analyst
AI behaviorRetrieve, summarize, classify, recommend, draft, decide, execute, escalateRetrieve, summarize, recommend missing evidence
prohibited AI behaviorActions AI must not performDeny dispute, send final notice, issue credit
human decision ownerRole owning final case judgmentClaims analyst / dispute operations lead
action ownerRole or system allowed to change stateDispute workflow after human approval
vendor/platform dependencyExternal or internal servicesModel gateway, RAG index, observability
recourse ownerRole owning customer challenge and recoveryDispute servicing owner
residual risk ownerAuthorized ownerPayments business risk owner
release forumDecision forumAI release readiness forum
stop authorityNamed role or forumIncident commander with business owner

Canvas acceptance standard:

  • Every customer-impacting action has a human or authorized system owner.
  • Every product promise has evidence and exclusions.
  • Every vendor/platform dependency has a responsibility boundary.
  • Every residual risk has owner, scope, expiry, and monitoring.

6. Product Promise Inventory

6.1 Inventory Structure

FieldRequired content
promise_idStable claim identifier
audienceCustomer, employee, manager, executive, regulator-facing team
promise_textExact claim or intended message
promise_typeSpeed, quality, consistency, safety, explanation, automation, education, advice boundary
evidence_standardWhat proves the claim
exclusionWhat the AI does not do
ownerPM or business owner accountable for claim
review_dateDate claim must be refreshed
customer_visibleYes or no
recourse_linkChallenge or correction path if claim fails

6.2 Promise Examples

Weak claimStrong claim
AI improves underwritingAI drafts a credit memo and checklist for underwriter review; it does not approve, decline, price, or send adverse notices
AI resolves payment disputesAI organizes evidence and identifies missing items for analyst review; final outcomes remain in approved dispute workflow
AI helps with AMLAI summarizes alert evidence and drafts escalation rationale; authorized investigators decide SAR escalation
AI gives wealth guidanceAI provides educational content; it does not determine suitability or recommend a transaction
AI automates KYCAI extracts and classifies onboarding documents; analysts own RFI and decline decisions

6.3 Promise Review Checklist

  • The claim is specific to a workflow, cohort, channel, and AI role.
  • The claim states what AI does not do.
  • The claim does not use model confidence as business certainty.
  • The claim does not imply legal, financial, credit, or investment advice unless approved through the appropriate product and governance path.
  • The claim has measurement evidence, not only user anecdotes.
  • Customer-facing language aligns with the actual decision boundary.
  • Internal training does not encourage users to over-rely on AI outputs.

7. AI Behavior Boundary Matrix

AI behaviorAllowed examplesProhibited examplesEvidence
RetrieveFind approved policy, case facts, transaction records, or source documentsRetrieve unauthorized customer records or stale policysource manifest, ACL test, retrieval QA
SummarizeSummarize documents, notes, calls, transactions, and evidenceOmit required facts or present summary as final decisionsummary QA, edit history, missing fact test
ClassifyClassify dispute type, alert typology, document completeness, or queue priorityClassify protected or vulnerable status without approved useclassification eval, false positive/negative analysis
RecommendSuggest missing evidence, next review step, or escalationRecommend decline, fee, freeze, or investment action outside scoperecommendation catalog, confidence calibration
DraftDraft memo, narrative, response, checklist, or explanation supportSend customer notice or regulator-facing document without reviewdraft approval record, citation QA
DecideSelect outcome or eligibilityDecide credit decline, KYC rejection, SAR filing, hardship denial, investment suitability unless formally approveddecision authority record, model risk evidence
ExecuteChange account, issue credit, freeze funds, send notice, update caseExecute high-impact state change without authorizationtool permission, action ledger, rollback test
EscalateRoute high-risk, low-confidence, or vulnerable-customer case to humanHide escalation path or route to unstaffed queueescalation trigger test, SLA report

Design rule: the higher the behavior moves from retrieve to execute, the stronger the authority, evidence, review, and recourse requirements become.


8. Decision Ownership Map

8.1 Map Structure

Decision or actionAI roleDecision authorityAction authorityConsultedInformedEvidence
Start pilotProvides readiness evidenceBusiness owner / release forumProduct teamRisk, Ops, ArchitectExecutive sponsorgate memo
Recommend case actionGenerates recommendationHuman specialistHuman specialist or workflowPolicy ownerSupervisorAI output, evidence, reason
Send customer communicationDraft supportAuthorized business or communications ownerWorkflow after approvalLegal / Compliance as applicableService teamapproved message, source trace
Pause AI capabilityAlert signalStop authorityPlatform owner executesPM, Risk, OpsExecutive sponsorincident record, stop event
Accept residual riskProvides uncertainty evidenceAuthorized risk/business ownerGovernance forum recordsLegal, Compliance, Model Risk as applicableExecutive sponsorresidual risk record

8.2 Decision Rights Tests

  • One role or forum has final decision authority.
  • The person pressing a button has authority to make that decision.
  • Tool execution cannot exceed the approved action authority.
  • Escalation route is staffed and has SLA.
  • Exceptions have a higher authority than standard decisions.
  • Residual risk owner is not the delivery team unless formally authorized.
  • Informed roles are not treated as approvers.

9. RACI and RAPID-Like Decision Rights

9.1 RACI Matrix

ActivityPMBAArchitectBusiness OwnerOpsRisk / ComplianceVendor / PlatformExecutive
Promise inventoryA/RRCACCII
AI behavior boundaryA/RRRACCCI
Decision ownership mapA/RA/RCACCII
Human accountability designRRCAA/RCCI
Vendor/platform boundaryCCA/RACCA/RI
Harm and recourse mapA/RRCAA/RCII
Release gate memoA/RRRARRRI
Residual risk recordCRCACA/RCA for material risk
Stop trigger operationRCRARCRI
Scale decisionRCCARCCA

Legend: A = accountable, R = responsible, C = consulted, I = informed.

9.2 RAPID-Like Decision Table

DecisionRecommendAgreePerformInputDecide
Approve customer-visible boundaryPMLegal / Compliance when applicableProduct teamBA, CX, Ops, RiskBusiness owner
Release limited pilotPMRisk, Ops, ArchitectureProduct and platform teamsEval, BA, VendorRelease forum
Expand from recommendation to executionPMRisk, Compliance, Architecture, OpsProduct and platform teamsModel Risk, BA, customer evidenceBusiness owner / governance forum
Accept residual riskRisk partner prepares challengeLegal / Compliance / Model Risk when applicablePM tracks conditionsArchitect, Ops, VendorAuthorized risk or business owner
Pause or rollbackIncident leadBusiness and RiskPlatform ownerPM, Ops, VendorStop authority

10. Human Accountability Evidence Pack

10.1 Required Evidence

EvidenceDescription
role charterHuman reviewer role, authority, and limitations
UI evidence viewScreens or field list showing source evidence, AI output, confidence, limitations, and actions
reviewer capacity modelExpected volume, time per case, SLA, staffing, and queue aging thresholds
AI literacy trainingScenario-specific training on hallucination, automation bias, missing evidence, prompt injection, and escalation
reviewer calibrationSample review exercises showing reviewers can identify AI errors and boundary breaches
override reason taxonomyReasons for accept, edit, reject, escalate, and request more information
escalation runbookTrigger, route, SLA, owner, and case status during escalation
stop authority recordWho can pause route, model, workflow, tool, or full product
audit traceWhat the reviewer saw, did, changed, and approved

10.2 Automation Bias Control Checklist

  • AI recommendation is not the only visually dominant item in high-impact review.
  • Source evidence and missing data are visible before final decision.
  • Reviewer can reject, edit, escalate, and request more evidence.
  • Accepting AI requires reason or policy confirmation for material decisions.
  • Review quality metrics are balanced against speed metrics.
  • Override and appeal outcomes are reviewed by segment and case type.
  • Low-confidence or conflicting evidence triggers escalation.
  • Reviewer training includes challenge cases and not only product use instructions.

11. Vendor / Platform Shared Responsibility Matrix

DomainProduct team ownsPlatform or vendor ownsEvidence to collect
Use-case scopeWorkflow, customer impact, accepted AI roleCapability documentation and limitationsscope memo, vendor documentation
DataAllowed data, purpose, minimization, retention needProcessing, storage, deletion, access logs as agreeddata flow, retention record, access report
Model versionApproved model route and regression requirementVersion support, change notice, service behaviorversion manifest, release note, regression result
RAG / knowledgeSource selection, policy owner, freshness rulesIndexing, ACL enforcement, retrieval telemetry as agreedsource manifest, ACL test, freshness report
Tool usePermission tier, approval rules, action limitsTool gateway, auth, idempotency, tracetool permission matrix, action ledger
ObservabilityMetrics, thresholds, review cadenceLogs, traces, dashboards, exporttelemetry schema, dashboard, export test
IncidentCustomer impact assessment and remediationService incident notification and root cause supportincident notice, timeline, action closure
ExitReplacement plan and migration decisionExport, deletion, transition support as agreedexit test, export file, deletion proof

Vendor boundary acceptance standard:

  • Vendor claims are mapped to use-case requirements.
  • Contract or internal platform service commitments cover logs, changes, incidents, and support.
  • Regression is triggered by model, prompt, data, policy, tool, or vendor service change.
  • Exit path is credible for material dependencies.

12. Customer Harm and Recourse Map

12.1 Map Structure

FieldRequired content
harm_scenarioWhat can go wrong for the customer
AI contributionRetrieve, summarize, classify, recommend, draft, decide, execute, escalate
customer impactMoney, access, delay, privacy, explanation, eligibility, advice, burden
detection signalComplaint, appeal, override, queue aging, QA, monitoring, external inquiry
recourse pathHow customer challenges or corrects
remediation actionRestore access, correct record, reimburse, reissue notice, rerun review, apologize, escalate
evidenceLogs, decision record, customer notice, remediation record, owner approval
ownerRole accountable for recovery
recurrence controlProduct, process, model, policy, or training change

12.2 Recourse Checklist

  • Customer can reach a human for high-impact outcomes.
  • Customer can submit corrected or additional evidence.
  • Appeal or reconsideration uses the final decision record and AI trace where relevant.
  • Customer communication explains actionable next steps, not model mechanics.
  • Remediation owner has authority to correct accounts, records, notices, or fees within policy.
  • Batch impact analysis is possible when a model, prompt, source, or rule causes repeated harm.
  • Recourse signals feed back into eval, release gates, training, and product roadmap.

13. Release Gate Evidence

13.1 Gate Checklist

GateRequired evidenceDecision options
Opportunityproblem baseline, promise inventory, ownerfund discovery, redirect, stop
Risk tiercustomer impact, data sensitivity, decision/action impact, reversibilitylow, controlled, material, high-impact
BoundaryAI behavior matrix, prohibited actions, decision rightsapprove scope, reduce scope, hold
Human accountabilityreviewer authority, UI evidence, training, capacity, escalationready, conditional, not ready
Vendor/platformshared responsibility, SLA, change route, incident route, exit pathapprove dependency, add condition, replace
Eval and UATdomain eval, critical failures, segment review, workflow UATpilot, improve, hold
Recourseharm map, appeal path, remediation evidence modelready, conditional, hold
Release decisiongate memo, residual risk, exceptions, stop triggersgo, conditional go, no-go
Launch monitoringdashboard, alert thresholds, rollback, stop authoritycontinue, pause, rollback
Scaleproduction evidence, value, risk, recourse, vendor performancescale, restrict, redesign, retire

13.2 Gate Decision Record

FieldContent
gate_nameOpportunity, pilot, release, launch, scale, or change gate
decision_requestedPilot, release, scale, restrict, pause, rollback, retire
scopeCohort, channel, region, customer segment, workflow, AI behavior
product_promiseClaims and exclusions reviewed
evidence_reviewedLinks to eval, UAT, architecture, vendor, oversight, recourse, monitoring
accountable_ownerBusiness owner accountable for outcome
residual_risk_ownerAuthorized role accepting remaining risk
conditionsScope limits, extra review, sampling, manual controls, traffic caps
exceptionsOpen gaps with owner, expiry, compensating control
stop_triggersThresholds that pause, rollback, or escalate
next_reviewDate, forum, and evidence required

14. Scenario Playbooks

14.1 Credit Underwriting Recommendation

StepExecution guidance
Promise"AI drafts credit memo and policy checklist for underwriter review."
BoundaryAI may summarize, calculate from verified inputs, and recommend missing evidence; it may not approve, decline, price, or issue adverse action.
Decision ownerUnderwriter owns recommendation; credit officer owns final decision.
Human evidenceSource documents, policy citations, ratio calculations, missing data, confidence limitations.
RecourseCustomer can correct data, provide evidence, and use appeal or reconsideration path.
Release evidenceReason-code trace, fairness review, adverse explanation QA, override analytics, segment monitoring.

14.2 AML SAR Escalation Support

StepExecution guidance
Promise"AI summarizes alert evidence and drafts escalation rationale for investigator review."
BoundaryAI may retrieve transactions, summarize notes, suggest typology tags; it may not file SAR or decide no-SAR.
Decision ownerInvestigator owns disposition; financial crime governance owns SAR escalation standards.
Human evidenceTransaction timeline, typology source, confidence limits, contradictory evidence, prior case context.
RecourseCustomer recourse may be constrained; internal review, confidentiality, and evidence integrity are still required.
Release evidenceFalse negative review, typology coverage, confidentiality controls, investigator override, audit trace.

14.3 KYC Onboarding Decline / RFI

StepExecution guidance
Promise"AI identifies missing or inconsistent onboarding evidence for analyst review."
BoundaryAI may extract, classify, and suggest RFI items; it may not decline onboarding or send final RFI without review.
Decision ownerOnboarding analyst owns RFI; KYC policy owner owns decline rules.
Human evidenceDocument image, extraction confidence, policy requirement, customer-provided context.
RecourseCustomer can provide corrected documents, access assistance, and receive clear next steps.
Release evidenceDocument accuracy by segment, language and accessibility review, RFI reason trace, abandonment monitoring.

14.4 Collections Hardship Treatment

StepExecution guidance
Promise"AI suggests hardship support options within approved collections policy."
BoundaryAI may summarize hardship signals and suggest approved options; it may not threaten, deny support, or make unsupported promises.
Decision ownerCollections specialist owns treatment; supervisor owns exceptions.
Human evidenceCustomer statement, account status, policy options, vulnerability flags, tone guidance.
RecourseCustomer can request human review, correct facts, and challenge treatment path.
Release evidenceVulnerable customer safeguards, tone QA, complaint monitoring, hardship outcome review.

14.5 Robo-Advisor Education / Advice Boundary

StepExecution guidance
Promise"AI provides educational content and helps customers prepare questions for advisors."
BoundaryAI may explain concepts; it may not recommend transactions, assess suitability, guarantee returns, or replace a licensed advisor.
Decision ownerWealth product owner owns content boundary; licensed advisor owns advice interactions.
Human evidenceApproved content source, prohibited advice tests, escalation route to qualified human.
RecourseCustomer can report inaccurate content and reach human support.
Release evidenceAdvice-boundary eval, suitability refusal tests, customer comprehension review, escalation metrics.

14.6 Payment Dispute Evidence Assistant

StepExecution guidance
Promise"AI organizes dispute evidence and suggests missing information for analyst review."
BoundaryAI may summarize evidence, classify dispute type, and draft checklist; it may not deny dispute rights or issue final outcome.
Decision ownerClaims analyst owns recommendation; dispute operations owner owns final workflow.
Human evidenceTransaction record, customer statement, merchant evidence, network rule source, deadline indicator.
RecourseCustomer can submit additional evidence, appeal outcome, and receive clear explanation.
Release evidenceDeadline monitoring, evidence completeness QA, appeal upheld trend, customer communication review.

15. Liability and Residual Risk Evidence Pack

This pack supports internal governance and legal or compliance review without making legal conclusions.

Evidence categoryRequired content
product claimsUI, training, sales, internal guidance, customer communications
actual AI behaviorLogs showing retrieve, summarize, classify, recommend, draft, decide, execute, or escalate
human reviewWhat human saw, action taken, reason, edits, escalation, override
decision authorityRole, forum, policy, and approval trail
vendor/platform dependencyService, version, change notice, incident, SLA, logs, data use
control operationEvidence that controls existed and operated
customer impactAffected cohort, money, access, delay, privacy, explanation, eligibility, burden
recourse and remediationCustomer challenge, correction, reimbursement, account restoration, notice
management actionWhen issue was known, decision made, actions assigned, closure evidence
residual riskOwner, scope, expiry, monitoring, thresholds, escalation

15.1 Residual Risk Record

FieldExample content
risk_statementAI may omit one evidence category in complex dispute cases, causing incomplete analyst review
affected_promise"Reduce incomplete dispute evidence packets"
affected_customer_impactPotential delay or incorrect dispute outcome if analyst does not catch omission
controlsRequired evidence checklist, analyst review, QA sample, appeal monitoring
remaining_uncertaintyLow-frequency complex cases not fully represented in eval set
ownerPayments business risk owner
scopePilot cohort, credit card disputes, English-language cases, 60 days
expiryEnd of pilot review date
monitoringOmission rate, analyst override, appeal upheld, customer complaints
escalationPause AI checklist recommendation if omission rate breaches threshold

16. Boundary Dashboard

Dashboard laneMetricAction threshold
Promise evidenceClaims with expired evidence or unsupported wordingRefresh or remove claim before next release
Human oversightAccept/edit/reject/escalate rate by reviewer and case typeInvestigate default acceptance or abnormal rejection
Automation biasMedian review time, evidence panel opens, challenge prompt completionRedesign UI or training if review is superficial
RecourseAppeal rate, appeal upheld, time to correction, complaint trendReview decision boundary and customer communication
HarmCustomer impact events, near misses, segment disparityEscalate, pause, or remediate
Vendor/platformModel changes, SLA breaches, incident notices, evidence export failuresTrigger regression or dependency review
Residual riskOpen exceptions, expired risk acceptance, condition breachesGovernance escalation
ReleaseStop trigger status, rollback readiness, action closureContinue, restrict, pause, rollback

17. Anti-Pattern Review

Run this review before each release gate.

Anti-patternDetection questionRequired correction
Vague human accountabilityCan we name who decides, acts, escalates, pauses, and accepts residual risk?Update decision ownership map
Model confidence misuseAre model scores presented as decision certainty?Add calibration, limitation, and evidence completeness design
Advisory AI becoming automationDo users accept AI by default because workflow or metrics pressure them?Change UI, incentives, review sampling, and reason capture
Vendor assurance overreachAre vendor claims treated as use-case proof?Map vendor evidence to internal requirements and eval
Recourse missingCan the customer challenge or correct a high-impact outcome?Add recourse path and remediation evidence
RACI dilutionAre multiple roles marked accountable for one decision?Assign one accountable owner and clarify consulted roles
No stop authorityWho can pause the capability during harm or evidence breach?Name stop authority and implement switch
Internal AI treated as low riskDoes internal output influence customer-impacting decisions?Risk tier based on downstream impact
Release without residual risk ownerAre exceptions open without owner, expiry, or monitoring?Create residual risk record or hold release

18. Interview Answers

18.1 How would you build accountability boundaries for an AI product?

I would start with a product promise inventory and classify each AI behavior as retrieval, summarization, classification, recommendation, drafting, decisioning, execution, or escalation. Then I would map decision authority, action authority, human accountability, vendor/platform responsibility, recourse, release evidence, and residual risk ownership. The output is not a policy statement; it is a set of artifacts that can pass a release gate and support post-launch monitoring.

18.2 How do you avoid the weak answer "the human is responsible"?

I test whether the human has real authority, capacity, training, evidence, and escalation rights. If the UI hides source evidence, the queue pressure forces fast acceptance, or the reviewer cannot reverse or escalate, then the human is not meaningfully accountable. I would require reviewer calibration, override analytics, reason capture, and stop triggers.

18.3 What should a vendor own versus what the institution owns?

The vendor may own service commitments, model or platform operation within contract, change notices, data processing controls, support, and evidence export. The institution owns use-case suitability, product claims, customer impact, human oversight, recourse, release decisions, and residual risk. I make this explicit with a shared responsibility matrix.

18.4 How do accountability boundaries improve customer trust?

They prevent over-promising and make recovery possible. Customers trust systems when high-impact outcomes have clear explanation, human access, correction routes, appeal paths, and remediation. Accountability boundaries connect product claims to those paths and make the evidence reconstructable.

18.5 What evidence would you bring to an executive release forum?

I would bring the product promise inventory, AI behavior boundary, decision ownership map, human accountability pack, vendor/platform matrix, eval and UAT evidence, harm and recourse map, release gate memo, residual risk record, stop triggers, and launch dashboard. I would state what evidence supports release, what uncertainty remains, who owns it, and when the next review occurs.


19. Portfolio Exercise

Build a complete boundary pack for one of the six financial retail scenarios:

  1. Credit underwriting recommendation.
  2. AML SAR escalation support.
  3. KYC onboarding decline or RFI support.
  4. Collections hardship treatment.
  5. Robo-advisor education versus advice boundary.
  6. Payment dispute evidence assistant.

19.1 Required Portfolio Assets

AssetContent
One-page executive memoRelease recommendation, scope, evidence, uncertainty, residual risk owner
Responsibility Boundary CanvasUse case, promise, AI behavior, decision/action owners, recourse, stop authority
Product Promise InventoryClaims, exclusions, evidence standard, owner, review date
Decision Ownership MapDecision authority, action authority, consulted, informed, evidence
Human Accountability Evidence PackUI evidence, training, calibration, capacity, escalation, audit trail
Vendor / Platform MatrixData, model, RAG, tool, logs, SLA, change, incident, exit
Harm and Recourse MapHarm scenarios, detection, recourse, remediation, owner
Release Gate RecordConditions, exceptions, stop triggers, next review
Boundary Dashboard MockMetrics, thresholds, owner, action rule

19.2 Scoring Rubric

DimensionStrong portfolio evidence
Product thinkingPromise is specific, valuable, bounded, and measurable
BA disciplineDecisions, rules, exceptions, and recourse are traceable
Architecture disciplineLogs, versions, permissions, rollback, and dependency boundaries are concrete
Governance disciplineRACI, RAPID-like rights, residual risk, and gate evidence are explicit
Customer trustHarm prevention and recovery are designed before launch
Executive narrativeMemo explains evidence, uncertainty, options, and recommended decision

20. Implementation Calendar

WeekWorkstreamOutputs
Week 1Promise and boundary discoveryproduct promise inventory, AI behavior matrix, initial risk tier
Week 2Decision and human accountability designdecision ownership map, RACI/RAPID, human accountability pack
Week 3Vendor/platform and architecture evidenceshared responsibility matrix, evidence trace view, logging and rollback design
Week 4Harm, recourse, and release readinessharm map, recourse path, release gate record, residual risk record
Week 5Pilot launch and monitoringdashboard, stop triggers, weekly review cadence, action closure
Week 6Scale or restrict decisionproduction evidence review, executive memo, updated boundaries

21. Final Acceptance Checklist

Use this checklist before release:

  • Product promise is specific and has exclusions.
  • AI behavior is classified and prohibited actions are documented.
  • Decision authority and action authority are separated.
  • Human reviewers have authority, capacity, training, evidence, and escalation.
  • Vendor/platform responsibilities are mapped and evidenced.
  • Customer harm scenarios and recourse paths are defined.
  • Release gates include evidence, conditions, exceptions, and stop triggers.
  • Residual risk has owner, scope, expiry, monitoring, and escalation.
  • Runtime dashboard can detect boundary breaches.
  • Executive memo states what is known, what remains uncertain, who owns it, and when it will be reviewed.

The practical standard: no material AI release should depend on a vague sentence like "the human remains accountable." The product should prove accountability through decision rights, evidence, recourse, and operating controls.