Saltar al contenido

    Biblioteca gratuita · IA y salud

    Aprender a gobernar
    la IA en hospitales.

    Estoy estudiando para obtener la certificación AIGP de la IAPP. Comparto gratuitamente mis notas y audios con otras personas que quieren preparar conceptos de gobierno de IA y aplicarlos al contexto de la salud.

    8 capítulos. 136 min 32 s.Audios en inglés. Guías en español.
    Material de Roberto Echeverría Cárdenas.

    Para acompañar la escucha

    Guía visual de estudio

    Veinte páginas con un mapa de los ocho temas, una hoja rápida, esquemas originales, un caso práctico y preguntas de repaso. Consulte los documentos de CHAI enlazados en cada capítulo para profundizar.

    Descargar PDF (20 páginas) ↗

    Escucha continua

    Los ocho capítulos en una sola reproducción

    Escuche la guía completa en YouTube (2 h 16 min), con marcas de tiempo para cada capítulo. Los audios individuales y sus índices por minuto siguen disponibles más abajo.

    Escuchar la guía completa en YouTube ↗

    Otra guía de audio

    Go-to-market engineer

    Once pistas en inglés con mi plan acelerado para volverme ingeniero de go-to-market: evaluaciones de agentes, SQL, observabilidad, Python, MCP y experimentación. 185 horas en 33 días, con índice por secciones y materiales gratuitos.

    Escuchar la guía en inglés ↗
    Sobre esta biblioteca y sus fuentes

    Este es un apoyo comunitario e independiente. Los audios están en inglés porque las fuentes originales que estudio están en ese idioma; los resúmenes, índices y preguntas permiten repasar en español.

    Comparto explicaciones y ejemplos propios, no lecturas ni adaptaciones de los PDF. Cada capítulo enlaza los documentos originales para que pueda consultarlos directamente.

    Estos materiales no sustituyen la preparación oficial ni cubren todo el examen AIGP. No cuentan con el aval de CHAI ni de la IAPP, y mi certificación aún está en preparación.

    Consultar AIGP y sus recursos oficiales en la IAPP

    Capítulo 01 · Gobierno de IA

    Política de IA antes del primer piloto

    Escuchar el capítulo

    15 min 01 sDescargar para escuchar sin conexión

    Un recorrido complementario y completo por los conceptos de este capítulo: aprobación, alcance y mantenimiento de una política de IA hospitalaria. El audio está en inglés; el resumen y el índice por minutos están en español.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. Los temas dentro de cada minuto son aproximados. El reproductor puede seguir sonando con la pantalla bloqueada, según su teléfono y navegador.

    Resumen del capítulo

    1. Autoridad: la política de IA necesita aprobación directiva y acceso para el personal pertinente.
    2. Alcance: debe aclarar qué usos cubre, qué términos emplea y cómo se solicita revisión.
    3. Mantenimiento: personas designadas supervisan los cambios para que la política siga describiendo la práctica real.

    La guía desarrolla esas decisiones con ejemplos propios, preguntas de dirección hospitalaria y repaso activo. Es material complementario; los originales ofrecen la formulación precisa de los controles y más sugerencias de aplicación.

    Leer la transcripción en inglés

    Propósito y tres decisiones de gobierno

    Welcome to this audio study guide on artificial intelligence and hospitals in Latin America, shared by Roberto Echeverría. It is made for a walk, a commute, or any time when you prefer to learn without looking at a screen. Our question is simple: before a hospital uses a new AI capability, how does it decide who can approve that use? A demonstration, a vendor contract, and an enthusiastic champion do not answer that question. A usable policy connects decisions to an approved rule, a defined process, and a responsible owner. Keep those three ideas in mind throughout the chapter.

    The starting source is the Coalition for Health AI's Domain One playbook on AI policy. It identifies three baseline operational controls for healthcare delivery organizations. One: a formal policy approved by leadership and accessible to relevant staff. Two: key concepts and the scope of AI use, including an approval process. Three: designated oversight for changes to the policy. This episode uses those controls as reference points. The explanations, examples, and study questions are original. The full source is linked with the episode. Always consult it directly, especially where a decision depends on the exact wording of a source.

    Control, sugerencia y obligación legal

    Begin by separating three kinds of statement. The baseline controls describe what this voluntary governance playbook considers foundational. The implementation guidance offers possible ways to put them into practice. Local laws and accreditation requirements are a different category entirely. The playbook does not create a clinical standard of care or settle the law in any particular jurisdiction. When speaking with a hospital director, precision matters. Saying that CHAI's playbook recommends a named owner is accurate. Saying that every hospital is legally required to create a particular committee because CHAI said so would be misleading.

    Use that distinction as a listening technique. When you hear a practice, ask: is this one of the three controls, a suggested implementation, or our own thought experiment? For instance, someone overseeing policy changes is part of the core control. A particular annual timetable is suggested in the playbook's guidance. Testing a fictional hospital case is our learning method. These distinctions make the guide more useful, not less. You can take the governance questions into different health systems while leaving decisions about local law to qualified people in those systems.

    Aprobación y patrocinio de la dirección

    The first control calls for a formal AI policy approved by organizational leadership. Why at that level? AI decisions cut across departments. Clinical teams consider care and workflow, technical teams examine integration and security, privacy teams examine data flows, and operations teams manage training and resources. A rule written by one group alone may not resolve conflicts among them. Leadership approval creates common authority. It also turns safety, workforce effects, and accountability into management concerns rather than leaving them as technology preferences. A hospital can choose its own approval body; the important point is that approval is real and traceable.

    Imagine asking a board to show the current policy. Can someone identify its version, approval date, and approving authority? Can they explain how it relates to rules for patient information, cybersecurity, procurement, and quality? Those are our practical questions, not an official audit checklist. A cross-functional review before approval can prevent contradictions. If one policy permits a data transfer and another forbids it, staff face conflicting instructions. An executive sponsor is useful when they help resolve those conflicts and allocate time for a process that crosses clinical, technical, and operational boundaries.

    Acceso del personal e IA no declarada

    The policy also has to reach relevant staff. A PDF stored in a committee folder may have formal approval yet little effect on daily decisions. Think of the people who buy, configure, supervise, and use AI. Do they know where the current policy lives? Do they know when a new feature requires review? If a nurse manager and a technology buyer give incompatible answers, the institution has a communication problem even if the document is well written. Accessibility includes discoverability and a practical route to ask questions. It does not mean that everyone must become an expert in the entire AI lifecycle.

    The CHAI playbook discusses shadow AI: AI capabilities used, embedded, procured, or developed outside an organization's established intake and approval path. The point is not to catch people out. The point is to make legitimate use visible early enough to govern it. A vendor may enable a feature in an existing system. A research team may run a local model. Staff may use a public assistant to draft material. The risks differ, but each raises a visibility question. A clear and approachable request process can reveal both what people already use and what they hope to use next.

    Definiciones y alcance de la política

    The second control asks a hospital to define key concepts, its scope of AI use, and an approval process. The word AI is broad. It may refer to predictive models, generative assistants, machine learning in imaging, or functions embedded in existing software. Definitions from regulators and technical standards vary because their purposes vary. A hospital does not need to solve every philosophical disagreement. It needs a usable boundary. Which kinds of function require governance? Which do not? What should a staff member do when a tool sits near the boundary? A definition succeeds when it supports a decision.

    Consider four ways a capability can enter a hospital: an external vendor product, an internal project, an update to an existing platform, or direct use of a public AI service. Now consider clinical, research, administrative, and operational settings. A policy can explain which combinations require formal review and what level of review is proportionate. It should also make prohibited uses intelligible, such as sending sensitive patient information to an unapproved public service. A useful scope is broader than a list of purchased products, because the same product can be used in different ways with different consequences.

    Ruta de aprobación proporcional al riesgo

    If every proposed use requires the same committee and evidence package, governance may become a bottleneck. If almost no use receives meaningful review, the policy becomes decorative. A risk-based route asks what the tool does, who is affected, what information it processes, how much autonomy it has, and what would happen if it failed. A system that drafts an internal meeting note is different from one that influences clinical priority. That does not mean the first is risk-free or the second unacceptable. It means the depth and expertise of review should follow the actual use.

    Try a first-pass conversation instead of beginning with a giant form. What task will the tool support? Who will see its output and act on it? Is it drafting, recommending, or deciding? What data enters it and where does the data go? Who can stop its use if it behaves unexpectedly? These questions are our own study exercise. They help identify which clinical, privacy, security, legal, and operational reviewers should participate. The policy should make the route clear to a busy department, including what happens when a use falls into a grey area.

    Ciclo de vida, proveedores y cambios de uso

    Approval is a starting point, not a finish line. A model can change, a vendor can update its product, and staff can use an output differently from the way a pilot described. The playbook connects policy to governance across the AI lifecycle and points readers toward other playbooks for detailed processes. A hospital should be able to ask what evidence supported an approval, what conditions were attached to it, how the use will be monitored, and what change would require renewed review. A product name alone does not tell you whether an old approval still fits a new feature.

    Here is a fictional case. A hospital approves a tool to help allocate staff time. Later, the supplier adds a feature that recommends which patient requests receive priority. The software brand has not changed, but the purpose, people affected, and consequences have. A policy organized only around vendor names may miss that. A policy organized around use and risk can trigger a fresh question. What did we approve, and does it still describe reality? Records, vendor communication, and monitoring help answer. Not every update is a crisis, but every organization needs a way to notice meaningful change.

    Relación con privacidad, calidad y seguridad

    An AI policy does not replace existing rules for data protection, security, patient safety, clinical quality, procurement, research, or consent. Repeating every rule in one document can create contradictions and unnecessary maintenance. The better question is where the AI policy adds a decision and where it points to an existing authority. If a proposed tool transfers patient information to an external service, AI approval does not override the organization's data protection rules. If a tool changes a clinical workflow, established clinical governance still matters. A cross-functional review helps connect these systems before the policy is approved.

    Roles should be clear even if job titles differ by institution. Who reviews the clinical implications? Who examines security and integration? Who checks what a vendor can document? Who records the decision and its conditions? A smaller hospital may extend an existing committee. A larger network may have a dedicated pathway. Either way, the policy must connect requests to accountable people. Informal conversations may be valuable, but they are difficult to audit or repeat when the person who remembers the decision leaves the organization.

    Responsables de revisar y actualizar

    The third control asks for designated oversight of policy changes. Even an excellent policy can become obsolete. New applications appear, technologies gain new capabilities, and an adverse event may reveal an unclear rule. Someone must notice, propose revisions, obtain appropriate approval, and communicate what changed. The owner may be an individual or a group, but responsibility needs to be identifiable. Without that, a policy may drift through informal edits or remain frozen while the hospital's AI uses evolve.

    The playbook suggests regular review, at least annually, and review triggered by important events. That is implementation guidance, not a universal legal timetable. A change record can answer four useful questions: what changed, why, who approved it, and when it took effect. Staff should also know whether a revision affects uses that were approved under an older version. Imagine that a policy expands to cover agents that initiate actions in connected systems. Which existing projects now deserve another look? Maintenance is the bridge between a written rule and the hospital's current portfolio.

    Caso práctico: función nueva en un sistema conocido

    Test the ideas in a fictional hospital. Its appointment system has been in place for years. An update introduces a model suggesting which requests get an earlier slot. The vendor calls this an ordinary improvement, and a department wants to enable it next week. The policy should help answer whether the function falls within its definition and scope, whether a new review is needed despite the old purchasing approval, what information the model uses, and whose decisions it influences. These questions come before a yes or no. Governance is the ability to make the decision in a visible, responsible way.

    Who should participate? Operations can describe the workflow. Clinicians can assess whether prioritization might affect care. Privacy and security teams can inspect data flows. Procurement can ask what the supplier promises and documents. The hospital may decide to test the function before wider use. This example does not prescribe one correct outcome. It shows how a policy turns a vague proposal into specific questions, responsible reviewers, and a recorded decision. If nobody knows who owns that decision, the policy has not yet become a practical process.

    Caso práctico: IA generativa para pacientes

    Now consider a communications team that wants generative AI to draft patient education material. The team says it will not upload identifying patient data. That may reduce one concern but does not settle all of them. Does the hospital approve this service? Who checks the clinical accuracy and reading level before material reaches patients? Is the tool's output clearly treated as a draft? The policy need not apply exactly the same review as it would to a model that directly influences diagnosis. It should still identify scope, approval, and human responsibility.

    Suppose staff later paste real patient examples into prompts or publish drafts without clinical review. The use has materially changed from the one first described. Clear communication and a route for questions help staff recognize that change. This is why governance should enable thoughtful experimentation rather than simply prohibit everything unfamiliar. The institution can support useful exploration while requiring people to describe the use honestly, protect information, and escalate when a project begins to affect patients or clinical decisions in a new way.

    Preguntas directivas y repaso activo

    If you were advising a hospital director, begin with evidence. Show me the current AI policy and the authority that approved it. Show me how a department decides whether a proposed use falls within scope. Walk me through one recent request from intake to decision. Name the owner of the next policy revision. Show me how staff learn that a rule changed. These are our own diagnostic questions, not an official CHAI checklist or an accreditation audit. Ask local clinical and legal leaders what their own requirements add. Do not import a foreign legal rule by implication.

    For active recall, pause and answer four questions aloud. What are the three baseline controls? Why is accessibility different from simply having a PDF? Name two ways AI may enter a hospital without a new product purchase. What is the difference between a designated owner and a suggested review calendar? Use the chapter markers to revisit uncertain answers. This audio guide is a complementary way to learn and deepen the concepts while moving through your day. It does not replace the original document. Open CHAI's Domain One playbook from the source links, compare its controls with its examples and guidance, and note where a decision belongs to the hospital itself.

    Capítulo 02 · Gobierno de IA

    Quién gobierna la IA hospitalaria

    Escuchar el capítulo

    18 min 21 sDescargar para escuchar sin conexión

    Un recorrido en inglés por responsables, comité, admisión de propuestas, seguimiento y escalamiento. El resumen y el índice están en español.

    Índice minuto a minuto

    Toque un minuto para ir a ese concepto. Los temas dentro de cada minuto son aproximados.

    Resumen del capítulo

    1. Asigne personas preparadas y autoridad para revisar, aprobar, vigilar y suspender usos de IA.
    2. Reúna las funciones pertinentes en un comité o estructura formal que pueda decidir.
    3. Use una vía de admisión, evaluación y seguimiento proporcional al riesgo.
    4. Defina a quién se reportan los incidentes, cuándo se escalan y cómo se cierra el caso.

    La guía explica esos controles con ejemplos propios, preguntas de dirección y repaso. Para el lenguaje exacto, los detalles y las limitaciones, consulte el original.

    Leer la transcripción en inglés

    Propósito y cuatro controles

    Welcome to the second chapter of Roberto Echeverría's audio study guide on artificial intelligence and hospitals. This chapter is about people and decisions. A policy may explain what should happen, but an organizational structure determines who receives a request, who asks difficult questions, who approves a use, who watches it after launch, and who acts when something goes wrong. You can use this guide while walking or doing another activity. Return to the original Coalition for Health AI playbook whenever you need its precise wording or examples.

    The Domain Two playbook identifies four baseline operational controls. First, assign appropriately trained people to critical AI governance responsibilities. Second, establish a formal committee structure that brings those responsibilities together. Third, create an intake, assessment, and monitoring process for proposed and deployed tools. Fourth, specify how concerns and incidents reach the governance structure for resolution. These are the four anchors of this chapter. The document treats them as baseline controls in a voluntary framework. Its many implementation examples are suggestions to adapt, not universal legal requirements or a clinical standard of care.

    Keep one question in mind: if a department proposes a new AI feature this morning, can everyone identify the person who receives it, the body that decides, the evidence required, the owner who monitors it, and the path for a serious incident? If any answer is missing, the organizational chart may look complete while the real process is not.

    Funciones y principios de IA responsable

    The playbook begins by mapping governance functions before naming job titles. A hospital may need risk, bias, and impact assessment; lifecycle oversight; validation of usefulness and safety; data stewardship; vendor review; workforce education; feedback; and incident response. The same person can sometimes hold several responsibilities, especially in a small institution. What matters is that responsibilities and authority are explicit, and that the institution has the competence and time to carry them out.

    Risk-based governance is a recurring idea. A low-risk administrative proposal may need a short review. A system that influences clinical prioritization may need stronger evidence, broader expertise, and closer monitoring. Risk categorization is not a synonym for approval. It decides how deep the review should be. The related CHAI playbooks cover risk assessment and AI lifecycle management in greater depth; Domain Two asks who performs these functions and how their work reaches a decision.

    The source also connects governance to responsible AI principles. Consider usefulness, usability, efficacy, fairness, safety, privacy, security, and transparency. Each principle needs an operational counterpart. For example, fairness can imply subgroup evaluation, and transparency can imply suitable documentation and training for the people affected. A principle in a presentation cannot protect patients by itself. The structure must assign evidence collection, review, follow-up, and authority to intervene.

    Responsables, capacidades y autoridad

    Control two point one concerns critical roles and responsibilities. The playbook suggests surveying the skills of clinical leaders and leaders in technology, quality, risk management, and clinical informatics. A title alone does not establish expertise in predictive, generative, or agentic AI. A skills assessment can reveal who needs training, who can be supported by an external expert, and where a new role may be justified.

    Several authorities must be distinguishable. Who may introduce an AI solution? Who performs technical or clinical validation? Who approves a pilot? Who authorizes procurement and deployment? Who owns the tool in daily use? Who can suspend it, switch it off, or retire it? If the institution cannot answer these questions for internally built tools and vendor products, an incident will expose the gap. A useful responsibility map names one accountable owner for every tool while identifying the teams consulted and informed at each stage.

    CHAI calls attention to a conflict of interest: the person validating a solution should not simply be the person who developed it. Separation does not always require two large departments. In a small organization, an independent reviewer, shared network resource, or outside expert may supply a second perspective. The goal is credible challenge, not bureaucracy for its own sake. At minimum, the institution should identify responsibility for oversight, validation, monitoring, and data stewardship.

    Comité que puede tomar decisiones

    Control two point two calls for a formal committee structure that brings relevant governance stakeholders together. This does not necessarily mean creating an entirely new committee. An existing data governance, quality improvement, technology, or patient-safety body may be expanded if its charter, membership, and decision process truly cover AI. The source gives examples of organizations that integrated AI oversight with preexisting structures.

    Membership should match the risks being governed. The playbook names executive leadership, finance, regulatory and ethical compliance, information technology, safety and incident reporting, clinical and operational expertise, cybersecurity, privacy, and a perspective reflecting people affected by the tools. That perspective may come from staff, clinicians, patients, or caregivers. It also recommends a designated individual with suitable technology expertise, ideally in AI. Every member does not need to attend every low-risk request, but the right expertise must be available when the decision warrants it.

    A committee charter should make the structure usable. It can specify its purpose, scope, decision rights, membership, quorum, meeting cadence, delegation, records, and escalation route. It should also explain which decisions a tool owner can make, which require a subgroup, and which demand full committee or executive attention. Merely announcing that a committee exists says little about whether a nurse, data steward, purchaser, or vendor knows how to use it.

    Modelos de gobierno organizacional

    CHAI compares three structures rather than declaring a universal winner. In a centralized model, one organization-wide body owns standards and approvals. That can improve consistency and visibility, but a crowded central queue can delay decisions and overlook local workflow details. In a decentralized model, departments make more of their own decisions. That can respond to local needs, yet evidence, terminology, and safeguards may diverge, making undeclared use harder to see.

    A distributed model combines central standards with local execution. A central body can establish policy, risk tiers, minimum evidence, and escalation rules. Local teams define intended use, manage day-to-day operations, and monitor performance in their specific setting. This works only when the institution shares concrete artifacts, such as a common intake form, risk classification, inventory, decision record, and monitoring plan. Shared templates turn a policy into comparable, reviewable decisions.

    A structure should evolve. A small AI portfolio may initially fit a compact centralized committee. As uses multiply across facilities, a distributed approach may become more practical. Reassess after substantial growth, organizational changes, or shifts in external expectations. The test is not whether a model sounds sophisticated. The test is whether decisions remain timely, consistent, accountable, and sensitive to the setting where the AI is used.

    Organizaciones pequeñas y recursos compartidos

    The playbook discusses community health centers and other less-resourced organizations. They may not have a separate privacy officer, AI scientist, and clinical informatics specialist available for every proposal. Multiple responsibilities may sit with one person. Existing committees can carry additional work. Regional associations or shared networks may help with policy starters, vendor questions, risk templates, training, procurement, inventories, and incident trend analysis.

    Sharing expertise does not remove local accountability. A local organization still determines whether a tool fits its patients and workflows, approves its own use, and responds to incidents. This distinction matters wherever institutions differ greatly in size. The aim of risk-based and shared governance is to make careful adoption possible even when specialist capacity is limited. It is not a license to accept a vendor's assurances as the entire review.

    One practical lesson from the source is that committee decisions need an operational path. If a review concludes that a tool needs a restricted data flow, a warning in the user interface, or monthly subgroup checks, someone must turn each condition into an assigned task, a control, and evidence of completion. Otherwise the minutes record a decision that never changes the system.

    Admisión y primera revisión

    Control two point three links intake, assessment, and monitoring. Governance is continuous. A new AI tool needs review before deployment, but its real-world use can diverge from the pilot, data can change, and a vendor can update the product. The organization needs a way to notice, investigate, and respond. The playbook recommends a standard entry point for both internal developers and vendors.

    An initial application can identify the intended use, proposed users, clinical or administrative workflow, expected benefit, patient or staff impact, data involved, vendor or internal developer, and an accountable sponsor. A model card or similar document can organize what is known about the applied solution. CHAI stresses that its applied model card is about a solution in its intended context, not an abstract foundation model detached from a use case. A generic model card alone is rarely enough for procurement, regulatory, security, or risk review.

    A short first-stage screen can identify non-negotiable conditions before anyone invests in a deeper evaluation. If a vendor cannot meet a hospital's baseline information or data requirements, that may be apparent early. More detailed questions follow according to risk. The review can request information about security, privacy, compliance, clinical and operational risks, testing, known limitations, mitigation, and monitoring. The institution should know what evidence is missing, who will obtain it, and what happens if it remains unavailable.

    Evaluación, despliegue y seguimiento

    After the first screen, the source describes risk categorization of the developer and the proposed solution, identifying gaps, asking follow-up questions, and planning how effectiveness and fit will be evaluated. Existing security or procurement reviews can often be extended with AI-specific questions instead of duplicated. Risk should determine the rigor of assessment, the specialists involved, and the monitoring schedule. A proposed use should not be approved merely because a model performs well on a vendor's test set; the local intended use and workflow matter.

    Before launch, define success and failure conditions. Decide who owns the model, who trains users, how feedback arrives, which metrics are monitored, how often results are reviewed, and what changes require re-review. A vendor update, altered patient population, or use beyond the agreed scope can turn an earlier approval into a new question. A monitoring plan should make these triggers visible, especially for tools that influence care.

    The playbook also explores using AI to support governance itself. Automated checks might flag missing intake documents, unexpected usage, performance drift, or inconsistency between a deployed tool and an updated policy. Reports can summarize queue size, review time, approvals, and open actions. These tools can make human oversight more efficient, but the level of human supervision should still reflect risk. The committee remains accountable for decisions and exceptions.

    Escalamiento de incidentes

    Control two point four asks for protocols to escalate and communicate concerns or incidents to the governance structure. An AI owner may solve a minor problem locally, but serious harm or a systemic pattern may require broader action. Define triggers in advance. Without them, one team may report every small anomaly while another may wait too long to flag a safety concern.

    The playbook illustrates three levels. A routine concern, such as an isolated complaint or small anomaly, may be logged and handled by the operational owner. A moderate concern, such as repeated complaints, a pattern of degraded performance, or use beyond intended scope, reaches a named governance contact within a defined window. A serious concern, such as a patient-safety event involving AI output, suspected unequal harm, a data breach, or substantial deviation from intended function, needs immediate escalation to governance and other relevant functions. The document gives examples of time windows; each organization must define its own actionable deadlines and follow applicable requirements.

    A pathway needs a recipient, not just the phrase report to the committee. Name a chair, clinical informatics lead, or AI governance officer to acknowledge the report and triage it. Establish a consistent secure channel and a short minimum report: which tool, intended use, observed event, timing, affected workflow or people, immediate containment, available evidence, and person responsible for follow-up. The governance structure must then know who can convene reviewers, request investigation, pause a pilot, switch off a tool, notify others, and document the decision.

    Cerrar el ciclo y aprender

    Escalation is incomplete if the reporter never learns what happened. A case should have a disposition: what was decided, why, who is implementing the action, and when the issue will be checked again. The playbook suggests an incident register, which could be part of the AI inventory. Patterns across cases can reveal that a risk tier was too low, monitoring was understaffed, training failed, or the escalation protocol itself needs revision.

    Imagine an AI assistant drafting messages to patients. One user reports a confusing instruction. The owner logs a routine concern and checks the output. If similar errors recur, the pattern moves to the governance contact. If a message creates a credible immediate safety risk, the team may need to pause the tool while the appropriate safety, clinical, privacy, and technical people investigate. The example is hypothetical, but it shows why a contact name, a decision authority, and a working stop mechanism all belong in the structure.

    A governance meeting should ask not only what the incident was, but whether the reporting channel worked. Was it easy for the user to speak up? Did the owner acknowledge it? Did the issue reach the right people within the defined time? Was the action completed? Did monitoring verify improvement? These questions turn incident handling into organizational learning.

    Ejemplos de instituciones

    CHAI offers several institutional examples without presenting one as mandatory. A multi-hospital system described decentralized proposals with technology and medical informatics leadership overseeing governance. In the playbook's account of Johns Hopkins, a proposed vendor tool needs an internal sponsor, detailed intake, routing to an appropriate clinical, imaging, or operational review group, and success measures. The example shows how a single front door can still send decisions to specialized reviewers.

    The Mayo Clinic example describes an independent multidisciplinary physician-led board assessing risk and regulatory applicability. Lower-risk administrative tools can receive a faster review, while potential medical devices need a more detailed process. The TrueCare example highlights board education, a shared intake path, different clinical and administrative review routes, leadership approval, and monitoring indicators. These examples are useful for comparing design choices, but your institution's actual authorities, resources, and legal duties must be established locally.

    Notice the common pattern rather than copying an organization chart. Each approach makes a sponsor visible, separates relevant review functions, asks for evidence, and connects a decision to deployment and monitoring. The source also makes clear that governance structures can start within existing bodies and grow as the AI portfolio grows.

    Preguntas directivas y repaso

    To finish, imagine that a hospital director asks for a status report. Ask for the AI inventory and the accountable owner of each tool. Ask who can approve, validate, pause, and retire a solution. Ask to see the committee charter and one recent decision record. Ask how an internal developer or vendor submits a proposed use, which evidence is required at the first screen, and how risk changes the depth of review. Ask for a monitoring plan and the name of the person who receives serious incidents. These documents demonstrate whether the structure operates rather than merely exists.

    For active recall, pause after each question. What are the four baseline controls in Domain Two? Which roles are essential even if one person holds several? Why should validation be independent from development? When would centralized, decentralized, or distributed governance create a bottleneck or a gap? What is the difference between intake and ongoing monitoring? What information makes an escalation actionable? Who closes the loop with the reporter?

    This guide is Roberto Echeverría's independent study material. It helps organize the ideas for listening, but the Coalition for Health AI's Domain Two Organizational Structures Playbook is the primary source. Review that original for its full control language, examples, tools, and important limitations before applying its ideas to a real hospital.

    Capítulo 03 · Gobierno de IA

    Los recursos que hacen posible gobernar la IA

    Escuchar el capítulo

    14 min 33 sDescargar para escuchar sin conexión

    Una política necesita personas, datos, herramientas y tiempo para funcionar. Este capítulo propone cómo revisar esa capacidad, documentar las soluciones y preparar su evaluación antes de ampliar el uso de IA en un hospital.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español.

    Resumen del capítulo

    1. Distinguir los recursos disponibles de los que cada caso de uso realmente necesita.
    2. Conectar el inventario de IA con responsables, versiones, datos y evidencia.
    3. Presupuestar validación, seguimiento, formación y continuidad, además de licencias.
    4. Evaluar la capacidad de supervisión antes de ampliar un piloto.

    Preguntas para repasar

    1. ¿Quién mantiene el inventario y responde por cada solución?
    2. ¿Qué evidencia local necesitamos y quién tiene tiempo para obtenerla?
    3. ¿Cuál sería el costo de operar, supervisar y retirar esta solución?
    Leer la transcripción en inglés

    De la política a la capacidad real

    Welcome to chapter three of Roberto Echeverría's independent study library on artificial intelligence and hospitals. We have already discussed policy and the people who make governance decisions. Today we turn to the resources that make those decisions possible. A committee can approve an evaluation, but someone still needs access to suitable data, time to conduct the review, a place to record evidence, and authority to follow up. Governance becomes operational when those resources are available to the people responsible for using them.

    Our starting reference is the Coalition for Health AI's organizational resources playbook. It addresses security and data, records of AI assets, evaluation and documentation tools, computing infrastructure, and workforce capability. There is a useful nuance in the original: its summary includes eight baseline controls and two additional workforce controls that it describes as highly recommended. This is voluntary educational guidance. It does not establish a legal duty or a standard of care. For the exact framework, use the original document linked beside this recording.

    The rest of this chapter uses an original fictional example. Imagine a hospital network considering an assistant that drafts replies to administrative questions about appointments. A person would review the drafts before sending them. No real hospital, patient, vendor, or performance result is being described. The purchase proposal contains a subscription price and an attractive demonstration. The operating proposal is less clear. Who maintains the answers? Who reviews an incorrect instruction? Who can stop the service? These questions reveal resources that a price quotation does not include.

    Try a two-column exercise. On the left, write what the proposed use needs. On the right, write what the hospital can actually provide today. Be specific. The need is not simply security. It might be an approved place to store appointment information and a person who reviews access. The need is not simply evaluation. It might be protected reviewer time and a set of representative questions. The gap between the columns becomes a decision about capacity, scope, or timing. Buying software alone does not close that gap.

    Datos, acceso y seguridad

    Follow one question through the fictional appointment assistant. A request arrives, a staff member opens it, information may be retrieved from a hospital system, and a draft appears. The draft may then be edited, sent, and stored in a log. Each step is a place where information moves or persists. A resource review asks which systems and people are involved, which information is necessary, how access is controlled, and how the hospital can inspect what happened later. A simple data-flow sketch often makes the discussion more concrete than a list of product features.

    For study purposes, distinguish protecting stored information from protecting information while it travels. Both matter. Also distinguish an access policy from evidence that access is limited as intended. A document may say that only authorized staff can use a service, while a shared account prevents anyone from knowing which individual made a change. The resource question is whether the organization has the identity controls, records, technical expertise, and review time needed for its chosen arrangement. The appropriate implementation depends on the environment and the information involved.

    Security testing and clinical or operational evaluation answer different questions. A system might be protected against an unauthorized user and still produce an incorrect response. It might produce useful responses and still expose information through an integration. In our example, the hospital needs a route for security review and a separate way to judge the drafts. Responsibility can be coordinated, but the evidence should not be confused. A supplier's assurance report is relevant evidence about a defined scope; it is not proof that every feature, integration, or local workflow is safe.

    The CHAI source uses several United States frameworks and regulatory references. A hospital in Mexico or Costa Rica should not automatically treat those references as local legal requirements. For this exercise, keep the practical question separate from legal applicability: can the organization explain its data flows and demonstrate the controls it has chosen? Its legal and privacy teams determine the rules that apply to the actual service. The lesson is to identify the resources for that work, rather than assume that a familiar acronym has completed it.

    Inventario, versiones y documentación útil

    Now imagine that three departments use the same supplier. One drafts appointment replies, another summarizes internal meeting notes, and a third is testing a different feature. A list containing only the supplier's name would hide those differences. The unit of governance is the solution in its intended context. Useful records distinguish the purpose, users, information, environment, responsible person, version, and current status. That makes it possible to ask whether a permission granted for one use also covers another. Often it does not, and someone must decide.

    An inventory and a model card serve related but different purposes. Think of the inventory as the map of what exists. Think of a model card or comparable record as a place to explain one solution, including its use and limits. The exact software used to maintain these records can vary. A smaller organization might begin with a controlled register and linked evidence folders. A larger network may need more integration and automation. What matters in our example is whether someone can find the current record, trust its status, and identify who is responsible for updating it.

    Consider a supplier changing the language model behind the appointment assistant while leaving the product name unchanged. Consider a local team adding a new source of answers. Consider expanding from one location to the whole network. These are three different changes. A record that captures only the original purchase date will not explain them. The hospital needs an agreed way to identify meaningful changes, record the affected configuration, and route the change for the appropriate review. Documentation has value when it helps reconstruct a decision, not merely when it fills a folder.

    Here is an original study prompt. A director asks, Which version answered this complaint yesterday? To answer, the team may need the deployment record, the relevant configuration, the approved reference material, and an appropriate record of the interaction. If those records do not exist, a dashboard displaying usage will not repair the missing history. Traceability is a capability built over time. Ask who maintains it, how changes are reconciled, and how the hospital protects the information in those records. An inventory without an owner can become an outdated snapshot surprisingly quickly.

    Capacidad para evaluar y supervisar

    A request to evaluate an AI tool should come with a realistic plan for producing evidence. In the fictional example, the hospital needs representative administrative questions, people who understand the correct workflow, a way to record disagreements, and time to review the results. The test should include ordinary cases and plausible difficult cases. For example, a question may contain incomplete appointment details or ask about a service unavailable at one location. These are illustrative study cases, not a validated test set or a prescribed evaluation protocol.

    Separate the claim being evaluated from the resources needed to evaluate it. If the claim is that drafts reduce staff effort, the team needs a definition of effort and a comparison with the current process. If the claim concerns correct information, it needs a way to judge correctness. If different patient groups may experience the service differently, it needs suitable expertise and evidence to investigate that possibility. The governance team should know when a sample is too small or unrepresentative to support a confident conclusion. Reporting uncertainty is part of useful evaluation.

    It also helps to distinguish model performance from the performance of the full service. A draft may look correct in isolation, but an integration could place it in the wrong conversation. A reviewer may have insufficient time to check it. A response may arrive too late to be useful. The relevant resources therefore include operational observation and human feedback, alongside technical testing. An evaluation plan that assumes reviewers have unlimited attention is describing a different system from the one the hospital intends to operate.

    Ask a question about the day after launch: who receives an unexpected pattern, and what can that person do? Monitoring needs people, information, and a route to action. It may involve incident reports, sampled reviews, performance measures, or other methods appropriate to the risk and available access. A supplier may not expose every technical signal. The organization then needs to decide what alternative evidence is sufficient and where uncertainty remains unacceptable. If the necessary supervision cannot be provided, reducing the scope or delaying deployment can be a more credible decision than promising monitoring that nobody can perform.

    Personas, presupuesto y continuidad

    Let us return to the purchase quotation. A subscription may be easy to price. Integration work, reviewer time, staff training, support, incident handling, and a future exit may be harder to estimate. These costs still belong in the operating discussion. The goal is not to produce an impressive financial model with invented precision. It is to identify the people and activities the service depends on, make assumptions visible, and establish how actual effort will be reviewed. A low subscription price can coexist with a demanding operating model.

    Consider three questions for a resource conversation. Who has protected time to perform the work? Who can cover that responsibility when the primary person is unavailable? Who controls the budget when an evaluation identifies a gap? Assigning a name without time or backup may create the appearance of ownership. In our fictional network, a reviewer might also handle a busy reception desk. That does not make the reviewer incapable, but it changes the design problem. The proposed workload must fit the real service, including peak periods and absences.

    Training is also specific to a task. General AI literacy can help staff understand limitations and ask better questions. It does not automatically teach them how to review a particular draft, recognize a problem, or report an incident in a particular system. Conversely, learning where to click does not establish the judgment needed for safe use. The resource discussion should identify the relevant competencies, the people who provide instruction, and the evidence used to check readiness. Refresher needs can change when the tool, workflow, or observed patterns change.

    Finally, think about continuity before it is urgently needed. If the appointment assistant becomes unavailable, can staff continue the underlying service? If the hospital decides to stop using it, who removes access, handles retained information, updates instructions, and tells affected teams? These questions do not require a universal technical design. They require an explicit local plan and the resources to carry it out. A service that is easy to activate but difficult to supervise or retire may create dependencies that are not visible in its initial demonstration.

    Caso directivo y repaso activo

    Imagine presenting the fictional project to a hospital director. Instead of starting with a demonstration, bring a short operating account. Explain the problem, the proposed scope, the accountable person, the information involved, the current resource gaps, and the evidence needed for the next decision. Describe who will conduct the review and how much time is available. Identify a fallback process. State which assumptions remain untested. This is an original exercise for learning how to connect a governance discussion to actual institutional capability.

    There is more than one defensible outcome. The director may support a limited evaluation, request additional resources, narrow the use, or decide that the proposed benefit does not justify the operating demands. The important point is that the decision reflects the real conditions. Do not confuse an evaluation budget with a commitment to full deployment. Do not describe a projected benefit as a measured result. Record what is being authorized now and what evidence is needed before the scope changes. This makes later review easier for people who did not attend the first meeting.

    Pause the audio after each of these questions. What is the difference between an AI inventory and the documentation of a particular solution? Why does a supplier's product name fail to describe every local use? Which resources are needed to assess correctness, security, and staff effort? How would you know whether a named owner has enough capacity? What happens if the person who monitors the service is unavailable? Which costs appear after the subscription has been purchased? What evidence would persuade you to delay expansion? Try to answer using a concrete example rather than a general aspiration.

    The central lesson is simple: a governance decision is only as practical as the resources available to carry it out. Policy describes the rules. Organizational structure assigns decisions. Resources give people the ability to act. In the next chapter we will connect those elements across the life of an AI service, from an initial proposal to review, use, monitoring, change, and eventual retirement. This recording is an independent study commentary by Roberto Echeverría, with original examples and questions. It is not a CHAI course, endorsement, certification, or replacement for the original playbook. The source and a Spanish guide are available on the library page.

    Capítulo 04 · Gobierno de IA

    Del piloto al uso responsable de la IA

    Escuchar el capítulo

    15 min 00 sDescargar para escuchar sin conexión

    Una demostración prometedora no resuelve cómo usar, supervisar, cambiar o retirar una solución. Este capítulo recorre las decisiones del ciclo de vida con un caso ficticio, criterios de evaluación y preguntas para la dirección.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español.

    Resumen del capítulo

    1. Registrar las soluciones que llegan por compras, desarrollo propio, investigación o actualizaciones.
    2. Definir el uso previsto, los límites y las personas afectadas antes del piloto.
    3. Separar la evaluación, la autorización para ampliar y el seguimiento posterior.
    4. Establecer responsables, señales de revisión y una salida antes de depender del sistema.

    Preguntas para repasar

    1. ¿Qué uso exacto se autorizó y qué cambios exigen volver a revisar?
    2. ¿Qué evidencia determina si el piloto puede ampliarse?
    3. ¿Quién puede pausar el sistema y cómo continúa el servicio?
    Leer la transcripción en inglés

    Cómo entra la IA al hospital

    Welcome to chapter four of Roberto Echeverría's independent audio study library on artificial intelligence and hospitals. The first chapters connected policy, decision-making roles, and resources. This chapter follows an AI service over time. Our starting reference is the Coalition for Health AI playbook on responsible AI lifecycle management and use. It brings attention to intended use, organizational principles, evaluation, monitoring, performance reporting, and communication. The framework is voluntary educational guidance, and its implementation examples are not universal legal or clinical requirements.

    AI can arrive through more than a purchase. A research team can develop a promising model. An internal team can build a service for operations. A supplier can offer a new product or work with the organization on one. An existing hospital system can acquire an AI feature through an update. These routes create different questions about evidence, access, ownership, and change. A procurement register alone may not reveal every AI capability in use. The practical study question is how the organization learns that a capability exists and decides what review it needs.

    Our original fictional case concerns an assistant that prepares a draft handover summary for an administrative service team. A staff member reviews the draft against the original information before using it. We are not describing a real hospital, validated product, or clinical handover protocol. The example lets us examine a service whose apparent simplicity can hide important dependencies. What information reaches the assistant? What gets omitted? Who receives the draft? How is a correction handled? What happens if a new feature changes the behavior without changing the product name?

    Think of the lifecycle as a sequence of decisions connected by evidence. A proposal is not an authorization to operate. An authorization for a limited evaluation is not an authorization to expand. An earlier evaluation is not permanent proof that every future version or setting remains acceptable. The amount of review should reflect the actual risk and context. The purpose of a lifecycle process is to make those distinctions visible and to connect them to accountable people, rather than rely on the memory of everyone who happened to be present when the tool was first introduced.

    Uso previsto y decisiones antes del piloto

    Begin by describing the intended use in terms a person can test. In the fictional example, which administrative team receives the summary? Which records may it summarize? What decision does the summary support? Who reviews it? Which uses are excluded? A statement such as improve efficiency leaves these questions unanswered. A more useful description identifies the task, information, users, setting, and limits. It also identifies who is affected by an error, even if that person never operates the tool directly. This description becomes a reference for evaluation and later change.

    Now distinguish the proposed service from its underlying model. The service includes how information is selected, how a prompt or instruction is constructed, which reference material is available, where an output appears, and what people do with it. A model that performs well on a broad benchmark may behave differently in a particular workflow. This does not mean that external evidence has no value. It means that the organization must understand what that evidence actually supports and what remains uncertain about its own intended use.

    For an original study exercise, list three possible failure paths. The assistant could omit an unresolved request. It could combine information from different cases. It could produce a clear-sounding statement that is unsupported by the source. These are hypothetical possibilities, not measured performance claims. Ask how each problem would be detected, who would correct it, and what the consequence would be if it passed unnoticed. The answers help the team choose appropriate review depth and clarify where a human reviewer needs access to the underlying information.

    Responsible AI principles become useful when they influence a decision. If the hospital values transparency, what should a staff member understand about the draft? If it values fairness, which differences in experience or performance need investigation? If it values privacy, which information is necessary for this task? If it values reliability, how should the service behave when information is missing? The team should define objectives and ways to evaluate them in context. A list of principles on a slide does not settle these questions. Nor does this educational example supply thresholds suitable for a real deployment.

    Evaluación local y criterios del piloto

    Before a pilot, the fictional team needs to know what would count as useful evidence. That includes the current process used for comparison, representative situations to review, who judges results, and what uncertainty remains acceptable for a limited test. The evaluation should examine the full workflow. A draft may reduce writing time but increase the time spent checking omissions. A summary may be accurate but presented in a place where staff overlook it. Looking only at the generated text can miss the operational effects that determine whether the service is useful.

    Separate a demonstration from an evaluation. A demonstration shows selected behavior under particular conditions. An evaluation asks a defined question using an appropriate method and records what happened, including failures. In our example, the reviewers might compare drafts against source material and note omissions, unsupported statements, correction effort, and disagreements. These are illustrative dimensions to consider, not a standardized measurement instrument. The appropriate sample, method, and review expertise depend on the actual task and risk. Where evidence is weak, the report should say so clearly.

    A limited pilot also needs boundaries. Which team and environment are included? What may staff do with the outputs? Who can authorize changes during the test? How are problems reported? When will the results be reviewed? Define the basis for proceeding, modifying the approach, pausing, or ending the test before enthusiasm about early results makes every outcome look successful. In a real organization, the designated clinical, operational, technical, and governance authorities establish the relevant criteria. This chapter explains the decision pattern, not a ready-to-use authorization protocol.

    Consider a common learning trap. The first participants are highly motivated and receive close support. The tool looks useful in that setting. A larger rollout would involve different people, workload, locations, and support. The pilot has produced evidence, but the proposed expansion also changes the conditions. Ask which findings transfer and which assumptions require further review. The next decision should be explicit about what it authorizes. A purchase contract, an enthusiastic sponsor, and a successful presentation do not remove the need to examine whether the actual evidence supports that next step.

    Despliegue y supervisión con responsables

    Suppose the appropriate decision-makers authorize broader use of the fictional assistant. Deployment changes the service from an experiment into something people may begin to depend on. Its owner, support arrangements, user instructions, training, and monitoring therefore need to fit routine operations. The team should know how to recognize the AI-generated draft, what review is expected, and how to reach a person who can address a problem. Communication is part of the operating design. People should not have to infer the limits of a tool from its confident tone or polished interface.

    Monitoring is more than collecting activity. A count of summaries produced tells us about use. It does not, by itself, show whether important information is being lost or whether correction work has increased. The team needs measures and feedback appropriate to the questions it is trying to answer. It also needs a process for reviewing the information. Ask who receives a signal, how quickly that person can assess it, and which actions are available. A report that nobody has time to interpret is not the same thing as an operating monitoring process.

    Human behavior matters too. Users may become more trusting after a period of apparently good performance. They may find workarounds or expand the tool to tasks beyond its approved scope. A low rate of corrections can mean that drafts are good, but it can also mean that reviewers are no longer checking them carefully. The interpretation requires context. For study, ask what additional observation or feedback could distinguish those possibilities. Avoid treating a single convenient metric as a complete account of safety, usefulness, or responsible use.

    The organization also needs a way to communicate changes and concerns to the relevant stakeholders. That may involve users, service owners, governance teams, suppliers, or others affected by the system. What they need to know differs. A user may need updated instructions. A technical team may need a reproducible problem report. A decision-maker may need the scope of a concern and the available options. Good reporting connects evidence to a decision without hiding uncertainty. The route and urgency should reflect the real situation and established local responsibilities, not a universal timetable invented for this fictional exercise.

    Cambios, pausas y retiro de una solución

    A lifecycle continues after deployment because the service does not remain frozen in time. The supplier may change a model. The hospital may connect another source of information, revise instructions, change a workflow, or introduce the tool to another group. Each change can affect the assumptions behind the earlier decision. A useful change process identifies what changed, which use is affected, who owns the review, and what evidence is needed before continuing or expanding. The relevant unit is the operational service, not only the name or version number of a language model.

    Consider an assistant that retrieves information from a hospital knowledge base. The underlying model could remain the same while the source material changes. If the knowledge base contains outdated instructions or inconsistent documents, behavior can change without a model update. That makes reference content part of the governed service. In our example, a new administrative procedure should prompt questions about which material is current, who approved it, and whether existing evaluation cases still represent the task. This is an original application of lifecycle thinking, not a claim that all systems need the same review for every edit.

    A pause or retirement also needs operational thought. Who can disable the assistant? Can the underlying service continue? Who tells the staff? How are outstanding tasks handled? What records must be retained, and which information can be removed under the applicable policies and requirements? These questions become harder if a tool is deeply embedded in a larger platform. Sometimes a feature cannot be isolated easily. The organization then needs to understand the available controls and consequences before it relies on a promise that the system can simply be switched off.

    Do not let retirement mean that the institution loses its learning. A record of why the service ended, what happened during use, which assumptions failed, and how the transition was managed can improve future decisions. Equally, retaining information without a purpose or appropriate controls is not automatically good governance. The actual retention and disposal decisions belong to the relevant organizational and legal processes. The study lesson is to assign those decisions and connect them to the exit plan. Ending a supplier relationship and safely ending an operational dependency are related, but they are not always the same event.

    Una conversación con la dirección y repaso

    Let us put the fictional case into a short conversation with a hospital director. The director asks whether the assistant is ready for the whole network. A useful answer begins with the authorized use, the conditions tested, the findings, and the remaining uncertainty. It explains whether the proposed expansion changes the users, information, workload, or support. It identifies the person accountable for routine operation and the mechanism for noticing problems. The recommendation then follows from those facts. A headline about accuracy or time saved should not substitute for that account.

    The director might also ask what would bring the service back for review. The team should be able to identify meaningful changes, concerning signals, and the next planned decision point. It should explain how a concern reaches someone with authority to act and how routine work would continue during a pause. These answers make governance visible in daily operations. They do not require a claim that every risk has been eliminated. They require the organization to be clear about the scope it is accepting, the evidence behind that decision, and how it will learn when conditions change.

    Pause for active recall. Name several routes through which AI can enter a hospital without a new standalone purchase. Explain why intended use must identify the users and setting. Describe the difference between a demonstration, an evaluation, and a limited pilot. Why might success with a small motivated team fail to establish readiness for a wider rollout? What can a usage count tell you, and what can it not tell you? Give an example of a meaningful change that leaves the model unchanged. Who should be able to pause a service, and what would the institution need in order to keep working?

    Across these four chapters, we have connected policy, decision-making roles, resources, and the lifecycle of an AI service. Together they help you ask more concrete questions about a proposal and follow those questions into operation. The detailed methods should be adapted to the organization, intended use, and applicable requirements. This recording is independent study commentary by Roberto Echeverría. It uses original explanations, a fictional case, and review questions. It is not a CHAI course, endorsement, or certification. Consult the linked CHAI playbook for its full framework and limitations, and use the Spanish guide and transcript to revisit the concepts after listening.

    Capítulo 05 · Gobierno de IA

    Riesgo e impacto antes de escalar la IA

    Escuchar el capítulo

    17 min 11 sDescargar para escuchar sin conexión

    Cómo categorizar el riesgo de un uso concreto, cuándo profundizar la evaluación, qué impacto medir y cómo documentar el riesgo que permanece. Incluye un caso ficticio y preguntas para dirección.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español. La primera vez que salte por minutos, el navegador cargará el capítulo completo (aproximadamente 13 MB).

    Resumen del capítulo

    1. Categorizar el caso de uso y su contexto antes del despliegue, no solo el modelo base.
    2. Documentar criterios, evidencia, autoridad, revisión y cambios que alteren la categoría.
    3. Evaluar con mayor rigor los casos de riesgo alto, sus mitigaciones y el riesgo residual.
    4. Valorar beneficios y efectos sobre personas, flujos de trabajo y portafolio de IA.
    5. Monitorear señales y reabrir decisiones cuando cambie el uso o aparezca daño.

    Preguntas para repasar

    1. ¿Cuál es el uso exacto y qué factores pueden multiplicar su riesgo?
    2. ¿Qué evidencia demuestra que las mitigaciones funcionan en el trabajo real?
    3. ¿Quién acepta el riesgo residual, y qué señal obligaría a pausar o revisar?
    Leer la transcripción en inglés

    Del nombre del modelo al caso de uso

    Welcome to chapter five of Roberto Echeverría's independent audio study library. We now turn from the overall lifecycle to risk and impact. The reference is the Coalition for Health AI playbook for subdomain four point two. Its central question is not whether an AI model is generally safe. It is whether a specific solution, used for a defined purpose in a particular healthcare workflow, presents risks the organization understands and is prepared to manage. The playbook describes a flexible framework, not a universal authorization rule. Its examples are educational and its legal references are situated in the United States.

    Imagine two fictional uses of the same language model. One drafts internal meeting notes for a purchasing team. The other proposes a summary of information that a clinician may use when considering patient care. Even with identical underlying software, their inputs, users, time pressure, opportunities for review, and potential consequences differ. Categorizing the foundation model once would miss this difference. A useful inventory records the solution and the authorized use case. It asks what the system can actually do inside the workflow, which people it can affect, and which decisions may depend on its output.

    The playbook organizes risk work into four connected phases: categorization, assessment, mitigation, and monitoring. Categorization is the early triage. Assessment is deeper investigation when the chosen threshold calls for it. Mitigation changes the design or the surrounding workflow to lower a known risk. Monitoring checks whether assumptions continue to hold during real use. Do not merge these into a single checkbox labelled review complete. The evidence and decision at each phase are different. Ask who is authorized to decide, where the rationale is recorded, and what new information would reopen the decision.

    Our running example will be a fictional assistant that drafts a referral coordination summary from existing records. The organization has not validated this product, and we are not setting clinical instructions. The case exists to test reasoning. The draft could save time, but it could also omit a prior appointment, combine details from two people, or create an unsupported statement. A human reviewer and a visible source record might reduce some risk, depending on how the work is actually performed. Our aim is to trace those assumptions rather than call the tool low risk because it is called an assistant.

    Categorizar antes de desplegar

    Control four point two point one calls for a predeployment risk categorization in the context of the organization's intended use. The guide describes low, medium, and high categories. Life and patient safety, and technology and data, are high-priority domains. Financial, legal, operational, and reputational effects may also matter. A hospital should use its own risk domains and its formally defined appetite and tolerance thresholds. The label is a decision aid: it determines the attention and rigor that follow. It does not replace detailed evaluation or mean that a low-risk system can never cause harm.

    Ask how close the output is to a patient or consequential decision. What is the worst plausible negative outcome if it is wrong? Can someone detect and reverse the error before it matters? What does the human reviewer actually see and have time to verify? Are sensitive data involved? Could an outage disrupt a service? In our fictional referral case, a draft that remains in a separate training environment has a different exposure from one placed directly in a busy live queue. A claim that a human remains in the loop needs to describe the real opportunity to notice a problem, not merely the presence of a review button.

    Context can multiply risk. A small omission may become serious when staffing is thin, when a team uses several AI tools in sequence, or when many cases are affected before anyone sees a pattern. The playbook asks organizations to consider aggregate use across workflows and patient populations, not just one tool at a time. It also points to emerging agentic concerns: how much independent authority an agent has, whether actions can be undone, what happens when agents hand work to other agents, and whether meaningful stop conditions exist. These are modifiers, not a claim that every automated action is equally dangerous.

    For study, categorize three versions of the same case. In version one, a staff member sees a draft with source links and can reject it before use. In version two, the draft is silently copied into a live task. In version three, an agent sends the summary externally without prior confirmation. Explain why the category might change. State which facts you would need to verify before assigning it. The exercise is deliberately open. No fictional risk score in this chapter should be adopted as a hospital threshold.

    Conservar la justificación y la autoridad

    Control four point two point two concerns how risk categorization is evaluated, recorded, retained, and reviewed. A category without its reasons is fragile. Six months later, someone may know that the assistant was labelled medium risk but not know which version, user group, data flow, or safeguard was assumed. The record should identify the use case, the domains considered, evidence available, important gaps, the decision-maker, the review date, and the condition that would trigger another look. An intake questionnaire, a vendor's model card, and local workflow observations can inform the record, but each supports a different kind of claim.

    Think of the categorization record as the first page of a decision history. If a new release gives the fictional assistant permission to access additional records, the same product name no longer guarantees the same exposure. If the service expands from a supervised team to multiple sites, operational context changes. If people begin using an output for a different purpose, the authorized use case has shifted. The record makes it possible to compare present use with the assumptions behind the initial label. Without that comparison, review becomes a matter of memory and informal assurance.

    There should also be a route for disagreement. An operations sponsor may regard the use as harmless because it produces a draft. A safety reviewer may focus on missed or mixed information. A privacy lead may identify a data flow the sponsor did not see. The process needs a designated authority to decide the category, a way to document dissent or uncertainty, and a cadence for re-review. A vendor's assertion about the underlying model cannot settle the hospital's question about its own workflow. Conversely, a risk label should not be inflated simply because the technology sounds unfamiliar. The point is a reasoned, reviewable decision.

    Ask a director for the current register of AI cases classified as high risk and how those cases appear in the wider enterprise risk process. The playbook explicitly connects AI risk to enterprise risk management and, where appropriate, executive or board oversight. This connection matters because risk cannot be managed well if it disappears inside a technical project list. The director's question is about exposure, ownership, evidence, and the ability to act if conditions change.

    Evaluación profunda y riesgo residual

    Control four point two point three calls for a rigorous risk assessment for solutions categorized as higher risk under the organization's own definition. The playbook says at least high-risk solutions warrant that deeper review. This is not merely a longer version of initial triage. The team identifies credible hazards, possible harms, who could be affected, the likelihood and severity where estimable, existing safeguards, evidence gaps, and what risk remains after proposed mitigations. The depth should match the use and the organization's tolerance, not the length of a standard questionnaire.

    For our referral summary, an assessment could trace an omission from its origin to its consequence. Maybe an outdated source record is retrieved, the draft makes a confident statement, a reviewer under time pressure misses it, and coordination proceeds on the wrong premise. Possible safeguards include limiting source material to approved records, showing provenance, testing representative examples, training reviewers on failure modes, and requiring a check of particular fields. Each safeguard must be assessed for effectiveness. A label such as human oversight is only useful when the reviewer has the information, time, and authority to intervene.

    Assessment should consider different people and settings. Could performance vary by language, service line, data completeness, or institution? Are there rare but consequential conditions that ordinary examples miss? What does the vendor know about limitations, and what has the hospital tested locally? If evidence is absent, record that absence. The playbook also discusses predeclared thresholds: circumstances in which risk is unacceptable, who may reject or halt a proposal, and how an appeal or exception would be documented. The answer cannot be improvised only after a sponsor has invested in a launch.

    Control four point two point four then focuses on the assessment record. Preserve the method, evidence, identified risks, mitigation decisions, the reasoning about residual risk, review and retention arrangements, and the authority that accepted or refused the result. Residual risk means what is left after safeguards. It should not be disguised as zero simply because the mitigation plan is attractive. The organization may approve a narrow pilot while declining a broad deployment. Such a decision needs a clear scope and follow-up. The record turns analysis into an accountable choice.

    Impacto: beneficios, daño y personas afectadas

    Control four point two point five asks for an AI system impact assessment that considers risks and benefits. An impact assessment asks a wider question than whether the software works. Whose time might be saved, and whose work might become harder? Could a convenient summary change how staff interact with people? Might patients have less chance to correct missing information? Could financial incentives encourage use even when quality concerns appear? The playbook emphasizes effects on stakeholders and organizational culture, including unintended effects that a technical performance score would not reveal.

    In the fictional case, the vendor may report that drafting is faster. An impact assessment would ask whether reviewers spend extra time checking every sentence, whether handoffs become clearer, whether some referral types are summarized less accurately, and whether people affected have a practical way to correct errors. It would also ask how to weigh benefits against risks and what evidence supports the comparison. Faster production of inaccurate summaries is not a benefit. Equally, a possible error does not automatically mean the tool has no value. The institution should make the trade-off visible and test its assumptions.

    The guide suggests thresholds for when a formal, deeper impact assessment is warranted and when a lighter approach is proportionate. This should be tied to the local risk classification and decision authority. Consider the portfolio, too. One service may have a modest effect, while several automated summaries, routing tools, and decision aids together alter staff attention or patient access. A governance committee looking only at individual approval files may miss cumulative impact. The impact assessment should therefore be revisited when the portfolio or workflow changes in ways that affect the original balance.

    A simple study question for a board conversation is this: what evidence would convince us that the solution's benefit reaches the patients and teams we intended, without shifting hidden costs onto those with the least opportunity to object? The answer is not supplied by a model score alone. It requires the people who understand the workflow and those affected by it. The playbook provides a structure for inquiry, but each organization must define the process that fits its setting.

    Mitigar, vigilar y volver a decidir

    A risk assessment is incomplete if it ends with a list of concerns and no action. A mitigation can change the model, restrict the use case, improve source data, add human review, alter the interface, train staff, increase monitoring, or stop the proposal. Its owner and evidence of effectiveness should be recorded. For our fictional case, displaying the source beside a drafted summary might improve review, but it needs local testing. If reviewers do not open the source under normal workload, the planned safeguard may be weaker than it looks on paper.

    Monitoring begins once use changes from test to routine. The questions are what signals matter, who reviews them, at what interval, and what action follows. Watch for errors, near misses, complaints, differences across groups or settings, workflow workarounds, and changes made by the supplier. An increase in output volume alone does not establish safety. A low number of reported incidents may reflect good performance or a reporting channel that staff do not trust. Combine technical measures with observation and feedback. Return to categorization or assessment when there is a material change, a pattern of concern, or a new population or setting.

    If an AI feature can act through other systems, monitor permissions and actions as well as generated words. How much autonomy is authorized? Which actions are irreversible? What alerts a person, and what actually stops the agent? The assessment of these questions should connect to operational controls and incident reporting. The framework should not become a ritual where a committee approves a document but nobody can pause the service. Responsible use means the organization can identify an emerging problem, understand it, and make a new decision.

    Imagine the director asks, is this assistant safe enough to scale? A disciplined answer states the use case, risk category and reasoning, what deeper assessment found, which benefits and harms were examined, what risk remains, who accepted it, and what monitoring would cause a pause or revision. If any of these are unknown, name the gap. An honest incomplete answer is more useful than a general claim that the underlying model passed an external benchmark.

    Repaso para una conversación de dirección

    Let us review the distinctions aloud. First, risk categorization is predeployment triage for the specific solution and use. It guides the level of scrutiny. Second, higher-risk cases receive a more rigorous risk assessment of hazards, harms, mitigation and residual risk. Third, an impact assessment considers both benefits and harms across stakeholders, workflows and the wider AI portfolio. Fourth, monitoring tests whether the decision continues to hold after deployment. Each step needs evidence, ownership, documentation and a route to re-review.

    Try active recall without looking at the page. Why could the same foundation model be low risk in one workflow and high risk in another? Name two high-priority risk domains from the playbook and two additional domains an organization might consider. Give an example of risk stacking across several AI services. Explain what changes when an assistant may act without confirmation. What information must accompany a risk category so that another person can understand it later? Why is a reviewer in a diagram not automatically an effective safeguard? What does residual risk mean?

    Now practice a short board answer. Say, we have defined the exact use and the population affected. We assigned a category using agreed tolerance thresholds and documented why. For a higher-risk use, we evaluated plausible failures, the safeguards and the risk remaining. We examined benefits and unintended effects on patients and staff. We named an owner, monitoring signals and a decision path for pause or expansion. This is a pattern for organizing evidence, not an assertion that a real deployment is approved.

    This chapter is original, independent study commentary by Roberto Echeverría. It is based on the Coalition for Health AI playbook for risk and impact assessments, and it uses a fictional example and original review questions. It is not a CHAI course, endorsement, credential or substitute for the full source. Please consult the linked playbook to see its exact language, tools and limitations. In the next chapter we will ask a different but connected question: what data was used, where it came from, what the agreements allow, and how its quality is checked.

    Capítulo 06 · Gobierno de IA

    Gobernar los datos que alimentan la IA

    Escuchar el capítulo

    19 min 46 sDescargar para escuchar sin conexión

    Registro y procedencia de datos, acuerdos con proveedores, desidentificación, calidad y sesgos, y preparación reproducible. Los términos HIPAA se explican como contexto estadounidense del original.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español. La primera vez que salte por minutos, el navegador cargará el capítulo completo (aproximadamente 13 MB).

    Resumen del capítulo

    1. Registrar fuentes, propósito, propietarios, transformaciones, usos autorizados y datos de inferencia.
    2. Definir con precisión qué puede hacer el proveedor con los datos y qué ocurre al terminar.
    3. Tratar la desidentificación como evaluación documentada, especialmente con texto, imágenes y enlaces.
    4. Asignar dueño a la revisión recurrente de calidad y sesgos por grupos y contextos.
    5. Documentar limpieza, particiones y corpus de recuperación para evitar fugas y resultados engañosos.

    Preguntas para repasar

    1. ¿Qué datos se autorizó usar y cuáles se consultaron realmente?
    2. ¿Qué derechos de entrenamiento y retención tiene el proveedor sobre datos y derivados?
    3. ¿Cómo detectaría una fuga de datos entre entrenamiento y evaluación o un corpus desactualizado?
    Leer la transcripción en inglés

    Los datos que hacen posible el sistema

    Welcome to chapter six of Roberto Echeverría's independent audio study library. Our source is the Coalition for Health AI playbook for responsible data management and use, subdomain four point three. It addresses five connected controls: a register of data acquired or used for AI, agreements governing data use, de-identification and privacy, recurring quality and bias evaluation, and a standard process for preparing data. The document is written for healthcare delivery organizations in the United States and discusses HIPAA, business associate agreements, and data use agreements in that context. We study its methods without presenting those laws as universal requirements.

    A system can use data at several stages. Data may develop or co-develop a model, tune it, test it retrospectively, or enter it during routine inference when the deployed service generates an output. These flows are not interchangeable. A vendor may have broad evidence about training data but little visibility into the daily input records a local service actually reaches. An organization might log a one-time training extract yet overlook a continuous feed from an electronic record. The playbook notes that operational inference data is often the least documented and a major governance gap.

    Consider a fictional assistant that drafts a referral coordination summary. It may access appointment records, prior notes, and a directory of service locations. Even if its function is called summarization, the data questions are concrete. Which fields does it read? Are those fields complete and current? Who supplied them? Which vendor or subprocessors see them? Can the assistant retain them, learn from them, or use them for another purpose? What happens when the organization stops the service? The answers require a map of data, agreements and access, not merely a statement that the product is compliant.

    The key study discipline is to separate what the organization authorized from what the system actually accessed. A register records approved data sources, purposes, owners and constraints. Access logs, where feasible, show what happened in operation. Agreements describe rights and obligations between parties. Quality checks reveal whether the information is suitable for the intended use. None of these artifacts alone proves trustworthy AI, but together they let the organization ask a much sharper question when a result is wrong or a vendor changes its service.

    Registro, procedencia y trazabilidad

    Control four point three point one asks for a structured data acquisition register for data used in AI. Imagine a spreadsheet row that only says patient records. It would not reveal source system, time period, population, sensitivity, owner, legal basis, transformations, linked AI service, or limitations. The playbook describes several kinds of metadata: descriptive information about purpose and origin; structural information such as schema, fields, units and codes; administrative information about access, stewardship, retention and version; lineage showing transformations and derivative use; and quality information about gaps, validation and cautioned uses.

    The register need not begin as a perfect catalog. A practical first record for our fictitious referral assistant would identify each data source, who owns it, which people or time periods it represents, what information it contains, why the service needs it, how it is shared, which systems use it, and what limits apply. Then the institution can add richer details as its capacity grows. The playbook emphasizes provenance, structural basics and administrative responsibility as especially useful starting fields. It also warns that unstructured material, images and genomic data may require different documentation than ordinary tables.

    A register should include more than training data. The referral assistant may receive new notes each day. If the source set expands dynamically, a static authorization list can fall behind reality. Logging actual access becomes an important complement. If a data source is linked with another dataset, the lineage must reflect that change. If a supplier fine-tunes a model using local records, there should be a trace from agreement to dataset to model or derivative artifact. A record of who owned a dataset last year may be insufficient when an incident needs reconstruction today.

    For study, ask how you would investigate an unsupported statement in a summary. Can you identify which source version was visible, which transformations were applied, whether a record had a known missing field, and who was responsible for it? If the answer depends on asking a single employee who remembers the project, the register is not yet functioning as organizational memory. The purpose is traceability and decision support, not paperwork for its own sake.

    Datos protegidos y acuerdos de uso

    Control four point three point two covers data use agreements and, in the United States context, business associate agreements. The source distinguishes protected health information, limited data sets, and data treated as de-identified under HIPAA. These categories have different rules and contractual paths. A Spanish-speaking hospital outside the United States must identify its own applicable law and terminology. The transferable lesson is to classify the data, document the basis for sharing and use, and make the supplier's permissions specific rather than assumed.

    Before a contract is negotiated, ask whether the supplier needs the requested data at all. Could a task be performed with fewer fields, synthetic examples for testing, or data kept within a controlled environment? If identifiable information is necessary, which elements and for how long? In our fictional case, a vendor asks for an entire historical referral dataset to improve a summarization service. The organization should ask for a written explanation of each requested field and the purpose it serves. The contract then records the narrow decision. Broad words such as use data to improve services can hide model training or redistribution that the hospital never intended.

    The playbook highlights several AI-specific terms worth examining: permitted and prohibited use, whether training or fine-tuning is allowed, restrictions on re-identification and dataset linkage, minimum necessary access, security safeguards, audit or evidence rights, incident handling, subprocessors, consequences for noncompliance, and return or destruction at termination. It also separates a permission to provide the service from rights in derivative data or model improvements. These are issues for qualified legal and technical review. We are not supplying contract language or claiming every clause is enforceable in every market.

    Suppose the assistant creates embeddings from local notes. Returning the original file does not necessarily answer what happened to embeddings, cached prompts, logs or a model adjusted using that material. The parties need to identify which artifacts exist, whether they contain or reveal patient-level information, who may use them, and how deletion can be verified where feasible. A contract is useful when it matches the real technical flow and when someone can monitor it. If the flow changes, the agreement and the data register need review.

    Desidentificación sin falsa seguridad

    Control four point three point three concerns written de-identification policies in the source's HIPAA setting. The playbook describes two HIPAA pathways, Safe Harbor and Expert Determination. Safe Harbor removes listed identifiers; Expert Determination uses qualified statistical or scientific judgment to establish very small identification risk and document the method. The right path depends on the proposed use and recipient. Not every AI use requires de-identification, and removing names alone does not mean data is anonymous. Outside the United States, the organization needs its own legal analysis; here we are learning the conceptual risk questions.

    Free text and medical images make the issue harder. A note can contain a recognizable combination of events even after names are removed. An imaging file can contain patient or institution details in embedded metadata. A text embedding or a fine-tuning input may preserve information in ways that ordinary field removal will not reveal. The source advises treating derived text artifacts with caution. It also warns that linking two datasets can raise re-identification risk even when each one was evaluated separately. Oversight must continue after the initial transformation.

    Return to the fictional assistant. Suppose a team wants to test performance using old referral summaries. It removes names, then shares the notes with a vendor. Before calling the extract de-identified, the team needs to consider dates, rare conditions, small locations, free-text clues, image headers if present, linkage with other available records, and who assessed the method. If the vendor also holds another dataset, its ability to link records changes the exposure. The result may require a different technical method, narrower data, a different agreement, or abandoning that test design. The exercise is about examining risk, not applying a one-size-fits-all recipe.

    Synthetic data may help some development tasks, but the word synthetic is not a guarantee of privacy or representativeness. A generated dataset may still reveal patterns from source records, and it may distort the very cases the model needs to handle. Its suitability must be evaluated for its purpose. Ask what the synthetic material preserves, what it loses, and whether it could be linked back to people. The broader lesson is that privacy status is a supported, documented judgment tied to data, method, recipient and use.

    Calidad, sesgos y responsables

    Control four point three point four asks for a named owner and recurring evaluation of data quality and bias. A dataset is not simply good or bad in isolation. It may be adequate for one task and misleading for another. Missingness, outdated codes, different documentation practices, inconsistent units, and incomplete representation can affect results. Healthcare records reflect access to care and choices made during care, not a neutral snapshot of everyone's health. A model may look accurate overall while performing worse for people whose records or circumstances differ from the majority.

    The playbook discusses representation bias, label bias, temporal bias, selection effects and measurement problems. Consider a system trained to predict need from historical spending. Cost can reflect who previously had access to services rather than actual need. Or a referral assistant trained on complete records from one location may omit important details when used at a site with different workflows. Meaningful subgroups can include language, age, disability or service location, and may also be technical, such as the type of imaging device. The right comparisons depend on the use case. Do not assume a single demographic breakdown captures every relevant difference.

    Recurring evaluation requires a decision loop. Who checks data completeness and provenance? Who defines comparison groups? How are limitations disclosed to users and the governance body? What happens when the population, coding practice or source system changes? A quality report that identifies a gap but leads to no change is weak governance. The team might correct data collection, limit the use, add review for affected cases, retest the system or suspend it. It should also distinguish a dataset's known limitations from evidence about the full AI workflow.

    In our fictional case, imagine the assistant summarizes referrals well for one specialty but leaves out context in another where notes use different abbreviations. The response is not simply to label the model biased. Investigate whether the source data were incomplete, the retrieval process missed documents, the prompt favored one format, or human reviewers applied different standards. The owner needs a way to trace the issue, measure its scope and decide whether the intended use remains justified. This is why quality and bias evaluation connects back to the register, local testing and monitoring.

    Preparación reproducible para modelos clásicos

    Control four point three point five calls for a standard operating procedure for AI data preparation. The playbook notes that preparation affects reproducibility and reliability. In conventional machine learning, teams must document how they clean inconsistent records, handle missing values and outliers, encode categories and clinical codes, normalize numerical fields, and partition data for training, validation and testing. The goal is to make a result traceable and to avoid subtle leakage that makes evaluation look better than the real future task.

    For example, suppose two records from the same person appear in different parts of a dataset. If one goes into training and the other into a test set, the model may have effectively seen that person before. A random row split can overstate generalization. A patient-level separation avoids this particular leakage. Time matters too: a test set drawn from a later period better resembles future deployment than mixing dates indiscriminately. Normalization parameters such as averages must be learned from training data only, then applied to validation and test data. Computing them from all records allows information from the test set to seep into training.

    A documented procedure should say how conflicting values across systems are resolved, how codes and units are mapped, how exclusions are justified, who approves changes, and which version produced a result. These choices cannot be inferred reliably from a final performance number. They may change subgroup representation or remove rare cases. Reviewers need to understand whether preparation made the test artificially easy. When an external vendor supplies a model, the local organization may not control the vendor's training pipeline, but it can ask for documentation and examine its own input preparation and local evaluation.

    The procedure is not limited to teams building models. A hospital that only buys AI still prepares data for vendor transfer, fine-tuning, retrospective evaluation or routine input. Our referral assistant depends on which notes are selected, whether duplicate encounters are removed, and whether its directory of locations is current. Each choice can alter output. A consistent process with owners and change records helps explain both success and failure.

    Preparación para IA generativa y agentes

    For generative AI, preparation extends beyond training tables. The source discusses prompt and context management, retrieval corpus preparation, fine-tuning data where used, and control over the sources accessible to an agent. Our fictional assistant may retrieve a current referral policy, a local directory and patient notes. If a policy document is obsolete, a technically capable model can generate an incorrect summary from wrong context. If retrieval includes material from the wrong service or person, the output can be fluent and still unsafe. Governing the source corpus, permissions and update process is part of data preparation.

    Ask who approves documents before they enter the retrieval collection. How are version, source and effective date stored? What happens when a document is replaced? Can the assistant cite or show the source that supported a statement? Does the agent have read-only access, or can it modify records or send messages? An agentic service may access data dynamically through tools. Its authorized scope belongs in the register; logs should reveal actual access where feasible. A changed permission or integration may matter even if the underlying model did not change.

    Data minimization still applies as a design question. Sending an entire record to a model because it is easy is different from sending the fields needed for a narrowly defined summary. An organization should consider the effect of truncation, context windows, and missing source material. If information is excluded, what clinically or operationally important facts could disappear? If too much is included, what unnecessary exposure follows? These are competing considerations that require local testing and appropriately qualified oversight, not a blanket rule that more context is always safer.

    A useful board-level request is: show me the authorized data sources, the contract that governs each vendor flow, the quality review, and the record of what this service actually used when a concern was raised. The request links the five controls without requiring a director to become a data engineer. It also reveals where the organization lacks evidence. A trustworthy answer may include a known limitation and a funded plan to close it.

    Repaso de los cinco controles

    Let us make the chapter easy to recall. One: the data register identifies origin, purpose, structure, owner, authorized use, transformations and limitations. Two: data agreements define what a supplier may and may not do, including training, redistribution, subcontracting and disposition. Three: de-identification is a method and risk judgment, not the mere deletion of names. Four: quality and bias require a recurring owner, evaluation and action. Five: preparation rules make training, testing, retrieval and input choices reproducible. The five controls reinforce each other across the AI lifecycle.

    Pause and answer without reading. Can you name four points at which an AI service may use data? Why is live inference data harder to inventory than a one-time development extract? What is the difference between a register and an access log? Why should a vendor justify each data element it requests before negotiations? What could remain after the original records are returned? How can two apparently de-identified datasets become more identifying when linked? Why is a random row split potentially misleading when a person has multiple records? What changes in data preparation when an agent can reach other tools?

    The playbook's terms protected health information, limited data set, business associate agreement, data use agreement and HIPAA are specific to its United States setting. We have named them to explain the source faithfully. They do not tell a hospital elsewhere which law applies or what form its contracts must take. The applicable local rules, professional advice and real technical architecture must be established separately. The study value here is a disciplined sequence of questions and evidence, not a portable legal conclusion.

    This is independent commentary and original educational explanation by Roberto Echeverría, with a fictional example and review questions. It is not a CHAI course or endorsement. The full linked Coalition for Health AI document contains more detail, references and limitations, and should be read directly. The next chapter moves from data to the organization that supplies the AI: what the vendor reveals, what the contract can enforce, and which safeguards remain the hospital's own responsibility.

    Capítulo 07 · Gobierno de IA

    Proveedores de IA: contratos y responsabilidad

    Escuchar el capítulo

    17 min 11 sDescargar para escuchar sin conexión

    Cómo convertir la información del proveedor en responsabilidades, cláusulas y salvaguardas operativas. Incluye IA incorporada en plataformas existentes, seguimiento de cambios y plan de salida.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español. La primera vez que salte por minutos, el navegador cargará el capítulo completo (aproximadamente 13 MB).

    Resumen del capítulo

    1. Tratar al proveedor, su modelo y sus dependencias como partes del sistema operativo.
    2. Conectar admisión y evidencia, evaluación de riesgo, contrato y controles propios.
    3. Exigir divulgación continua de limitaciones, cambios, subprocesadores e incidentes.
    4. Asignar por escrito validación, formación, seguimiento, reporte, soporte y salida.
    5. Supervisar IA incrustada en plataformas y prever fallas o cierre del proveedor.

    Preguntas para repasar

    1. ¿Qué evidencia y limitaciones del proveedor afectan este uso exacto?
    2. ¿Quién responde por cada tarea antes y después del despliegue?
    3. ¿Qué puede hacer el hospital si el proveedor cambia, incumple o desaparece?
    Leer la transcripción en inglés

    Un proveedor también es parte del sistema

    Welcome to chapter seven of Roberto Echeverría's independent audio study library. The Coalition for Health AI playbook for subdomain four point four addresses third-party management. Its single baseline control is broad: ask vendors to disclose known model limitations and risks, define responsibilities for the AI solution and those risks, and use contractual plus operational protections. The guide connects supplier oversight to intake, risk assessment, contracting and continuing operations. A hospital cannot transfer all responsibility to a supplier merely by signing a purchase order.

    Imagine a fictional vendor whose assistant drafts referral coordination summaries. It runs on a hosted language model, retrieves information from local systems, and displays drafts inside an existing enterprise platform. The hospital's users, interface, data, supplier infrastructure, underlying model provider and review workflow all shape what happens. If an output is wrong, the relevant question is not only who built the model. Who tested the intended use? Who trained reviewers? Who sees performance signals? Who announces updates? Who handles an incident, pauses the feature, returns data or helps the organization exit? These answers may cross several agreements and teams.

    The source names two common entry paths for third-party AI: a vendor-developed or co-developed solution, and an AI feature added to an existing health technology system. The second path can be especially easy to overlook. A platform update may enable a capability without a new contract or procurement event. The playbook therefore urges recurring discovery of embedded AI features, named platform owners, review of AI-specific data terms, and risk triage for features that already arrived. Where the platform permits, defaulting new AI functions off until review is presented as a practical option, not a universal command.

    This document comes from a United States healthcare context and mentions HIPAA agreements, FDA-regulated software and other U.S. mechanisms. We will explain those references as source context, not as requirements for every hospital. Our independent case is fictional. The aim is to learn how to make a supplier relationship governable over the whole lifecycle. A supplier brochure can start a conversation. A hospital needs evidence, a decision, enforceable expectations where possible, and operational safeguards that keep working after launch.

    Ingreso y evidencia antes del contrato

    The playbook describes four interacting phases. First is AI intake: gather vendor attestations, documentation and evidence using consistent questions. Second is a risk assessment against the organization's tolerance. Third is contracting, which turns the agreed expectations into obligations. Fourth is the local operational controls that address risks a contract cannot remove. These phases can loop backward when the vendor updates the model, the use case expands or monitoring reveals a concern. The order may vary, but the findings from intake and risk review should shape the final agreement or a later amendment.

    For the fictional assistant, intake should identify intended uses and excluded uses; what model or upstream providers are involved; training, validation and local testing evidence; known failure conditions; data flows; subcontractors; user controls; accessibility; security; performance reporting; and update practices. Ask what the supplier has actually measured and in which population or workflow. A statement that the system is accurate on a benchmark should be matched to the proposed local task. Where evidence is absent, note the gap. A model card or technical sheet can help, but it should not be read as an independent guarantee of hospital performance.

    Risk assessment then asks what the solution could do in the organization's real environment. Which people and processes rely on it? What happens if the vendor's upstream model is unavailable? Can a human verify the summary against source information? What risks remain even if the vendor's product behaves as designed? The risk category and the organization’s appetite help determine the depth of diligence and the contract terms worth negotiating. The important test is whether intake findings visibly affect the eventual decision. If a limitation is discovered and the contract says nothing about notice, scope or monitoring, the review has not reached the operational relationship.

    Contracts sometimes must be signed before a complete governance review, especially with a platform already in use. The source recommends documenting that situation, a defined completion timeline, and a route for amendment. An institution should not treat signature as proof that its use case was approved. Conversely, review teams should understand which protections are realistically negotiable and which must be implemented locally. This is where procurement, legal, privacy, safety, clinical and technical owners need a shared view of the same service.

    Qué debe quedar explícito entre las partes

    The playbook's control calls for a clear allocation of responsibility. It offers examples across the lifecycle: who validates before deployment, monitors after go-live, trains users, identifies performance concerns, reports incidents, manages updates, and helps decommission a service. Operational roles include integration, support, version tracking and change requests. In the U.S. source, some regulatory questions involve FDA Software as a Medical Device and associated reporting. A hospital elsewhere must determine its own applicable rules with qualified counsel. The method is to name the parties and their duties before an event exposes a gap.

    Imagine that a summary omits an important referral detail. The hospital may need to document and respond to the immediate event. The vendor may need to investigate whether an upstream software change altered behavior. Someone must preserve version and log evidence, decide whether use continues, notify appropriate people and test the correction. A vague contract stating that both parties collaborate does not explain who starts each action or by when. A useful responsibility map separates what the vendor can know from what the hospital can observe inside the workflow, then defines how they exchange information.

    An AI addendum to a wider agreement can cover definitions of AI, notice or approval before AI use, data restrictions, rights in outputs and derivatives, warranties, monitoring, incident reporting, change management, subcontractors, audit information, disclosure of limitations and exit. The playbook presents examples, not a single mandatory template. Its point is that AI-specific obligations may be missing from an older master agreement. Order of precedence matters: an addendum is weaker if another clause silently overrides it. In the United States, an AI appendix may be attached to an existing business associate agreement for protected health information; that example should not be copied mechanically into another legal system.

    Ask a director to point to a single responsibility table for a live AI service. Could they identify who is accountable for local performance, the supplier relationship, incident escalation and termination? Can they see what the vendor promised, what the institution has to do itself, and what remains unresolved? That table is often more revealing than a general statement that the supplier has accepted liability.

    Limitaciones, modelos externos y agentes

    Disclosure of known model limitations and risks is another core part of control four point four point one. The guide discusses performance characteristics, variability across groups, behavior outside the settings tested, conditions where the model should not be used, and known safety concerns. Disclosure should be ongoing. A vendor update, retraining event, newly found limitation or meaningful change in regulatory status should trigger communication, not wait until the next renewal. The format may be a model card, technical report or schedule of disclosures, but the hospital must be able to use it in its own risk and training decisions.

    The apparent vendor may depend on another foundation model provider, open-source components, a cloud region or external services. At intake, the source suggests asking who those providers are, what licenses or data restrictions apply, what safeguards the vendor added for healthcare, and how upstream changes are monitored and disclosed. If the upstream model changes, the hospital can experience different behavior even if its direct vendor has not issued a new product name. A dependency map therefore matters for quality, privacy, continuity and accountability. Lack of documentation is itself information for risk assessment.

    Agentic systems add questions beyond generated text. What actions may the agent take without confirmation? Which tools can it read, write to or invoke? Which actions are hard to reverse? What event stops it or sends it to a person? Does it retain memory across sessions? Does it coordinate with other agents? Are logs detailed enough to reconstruct a harmful sequence? The playbook treats these as emerging disclosure needs. Our fictional assistant may only draft today but gain a feature that sends referrals tomorrow. That one permission change can alter the risk, responsibilities and contract terms even if the vendor markets it as a minor update.

    Good disclosure is not equivalent to safe deployment. A vendor can honestly report poor performance on a subgroup, and the hospital may still choose a narrower use or stronger local validation. Alternatively, a missing subgroup study may mean the organization has insufficient evidence to deploy for its population. The decision belongs to the organization’s governance process. The value of the supplier's information is that it allows a specific, documented choice rather than a guess hidden inside a broad sales claim.

    Supervisión que no termina con la firma

    A contract should make postdeployment monitoring concrete. The source asks what metrics the vendor will track, how often reports arrive, what happens when performance degrades, whether the hospital can request underlying information, and what remedy follows missed reporting. These details are different from a generic uptime promise. A system can be technically available while producing worse outputs after a model change. A credible monitoring plan connects quality and safety indicators to reporting cadence, decision rights and action thresholds. The hospital also needs its own observation of workflow outcomes and incidents.

    Service level agreements may need recovery objectives, manual fallback procedures, tested disaster recovery, an upstream dependency map, and notice of outages beyond the direct vendor's control. If staff have come to depend on the referral assistant, what happens when the hosted model fails during a busy day? Who switches to a manual process? Can unfinished tasks be found? The answers are operational and should be rehearsed, not inferred from an uptime percentage. Contractual commitments matter because they allow accountability, but the local team must maintain a workable fallback.

    The playbook also describes regular performance reviews with defined indicators and remedies, separate from contract renewal. A multi-year deal should not mean that everyone waits years to discuss declining quality. Evidence from the term should inform renewal. If a supplier repeatedly misses obligations, a tiered response may begin with notice and cure, continue to a remedial plan, restrict new features or data access, and ultimately permit termination with transition support. These are negotiating concepts, not automatic outcomes. The local legal team must define any actual rights and timelines.

    Think of the director's question: what would we learn next month that might change our decision? A useful answer names the indicators, report owner, hospital reviewer, frequency, escalation and available actions. If the response is simply the vendor promised to monitor, ask what the hospital will receive and what it can do with it. Governance must survive the period after the implementation team moves on.

    Controles propios, cambios y salida

    The fourth phase is operational controls owned by the hospital. Some risks cannot be negotiated away. The organization may restrict who can use the assistant, require source checking, limit data access, audit outputs, train staff or choose not to deploy in certain settings. A supplier may not be able to guarantee that every generated sentence is correct. The hospital needs a workflow that detects and handles error before it can cause harm, proportional to the use. The actual safeguards should be tested under realistic conditions; writing them into a procedure does not prove they work.

    Embedded AI in an existing platform deserves a recurring inventory. A platform owner can examine release notes and administrative settings, identify new functions, assign each a risk category, review AI-specific data processing terms and add it to an AI vendor register. Older features enabled before the governance program began may need retrospective review. Where a platform allows it, newly released AI could remain off until its use is understood. If the institution cannot disable a feature, that limitation should be visible in its risk decision and mitigation plan.

    Supplier failure requires planning beyond a normal missed service level. What if the vendor is acquired, insolvent, stops supporting the product, or shuts it down? The source discusses notice, data return or destruction, transition assistance, access to documentation and, for critical uses, possible escrow arrangements. These are options to evaluate, not universal requirements. Our fictional case should be able to revert to human drafting and preserve essential records if the supplier disappears. Ending access to a cloud account is not the same as safely unwinding dependence in a hospital workflow.

    After a material update, loop back to intake and risk assessment. Did the model provider change? Did the assistant gain a new tool? Did the hospital expand the user group? Did the vendor alter its data terms? Who tests again and communicates changes to staff? The agreement should create notice and review hooks, while the operational owner ensures they are used. The supplier relationship is a living part of the AI lifecycle.

    Negociar con evidencia, recordar el criterio

    Consider a compact vendor meeting. The hospital says: we intend to use your assistant only to draft referral coordination summaries for review by staff. Please show evidence relevant to that use, the populations and settings tested, known limitations, upstream dependencies and data flows. Tell us how you disclose changes and incidents. Then let us agree who owns local validation, training, monitoring, support, patient communication when relevant, and exit. This is a stronger conversation than asking whether the product is AI compliant, because it calls for concrete artifacts and assignments.

    The answer may expose limited bargaining power. A large incumbent platform may resist bespoke terms. The playbook recognizes that reality and describes blanket procedures, documented controls, shared templates and risk prioritization as ways to focus effort. It does not imply that every hospital can obtain every clause. Where a contract leaves a gap, the organization should identify the gap and choose a local control or narrow the use. Concealing the gap behind a signature makes later oversight harder. A competitive evaluation may strengthen negotiation when several credible vendors exist, but it also costs time and resources.

    For active recall, name the four phases of third-party management. Why can embedded AI escape a traditional procurement gate? What evidence should an intake questionnaire seek? Which responsibilities must be allocated across vendor and hospital? Why should known limitations be disclosed after launch as well as before? What can an agent do that makes action boundaries and audit logs more important? How does a performance report differ from an uptime report? What should the hospital plan for if the vendor ceases operations?

    This audio is original independent study commentary by Roberto Echeverría, with a fictional case and questions for review. It is not a CHAI course, endorsement or legal template. Please consult the linked CHAI playbook for its complete guidance, examples and limitations. Next we will examine the people who use, experience and report on AI systems: staff training, patient information, feedback, incidents and safe channels for speaking up.

    Capítulo 08 · Gobierno de IA

    Formar, informar y escuchar sobre IA

    Escuchar el capítulo

    19 min 29 sDescargar para escuchar sin conexión

    Formación por roles, comunicación comprensible a pacientes, incidentes y canales seguros de reporte. La referencia legal del original es estadounidense y se presenta como tal.

    Índice minuto a minuto

    Toque un minuto para continuar desde ese punto. El tema indica la sección que está escuchando. Audio en inglés, con guía de estudio en español. La primera vez que salte por minutos, el navegador cargará el capítulo completo (aproximadamente 13 MB).

    Resumen del capítulo

    1. Formar a usuarios, nuevos colaboradores, líderes y equipos de respuesta según rol y riesgo.
    2. Explicar con claridad el uso de IA y los datos a las personas afectadas.
    3. Diseñar transparencia y consentimiento conforme al caso y a la normativa aplicable.
    4. Integrar incidentes de IA en los sistemas existentes y cerrar el ciclo con quienes reportan.
    5. Proteger a denunciantes internos y externos con canales claros y políticas reales.

    Preguntas para repasar

    1. ¿Qué sabe hacer un usuario después de la formación, además de completar un curso?
    2. ¿Cómo llega un incidente a quien puede actuar y cómo se informa el resultado?
    3. ¿El canal promete anonimato, confidencialidad o ambas, y puede cumplirlo?
    Leer la transcripción en inglés

    Personas preparadas para convivir con IA

    Welcome to chapter eight of Roberto Echeverría's independent audio study library. Our reference is the Coalition for Health AI playbook on education, training and feedback, subdomain four point five. The playbook asks how staff learn to use an AI system responsibly, how patients are informed, and how concerns or incidents reach people who can act. It contains six baseline controls. This chapter uses original explanation and a fictional case to make their relationships easier to remember. The source is written for the United States and discusses HIPAA and state and federal law; those references are context, not universal legal instructions.

    Imagine the fictional referral summary assistant from earlier chapters is now available to a small staff team. Its technical evaluation looks acceptable for that narrow use. Yet a staff member may over-trust a polished draft, a new hire may not know the checking procedure, a patient may question a statement, and a vendor update may change behavior. Education and feedback are therefore not optional decorations around a model. They are parts of the operating system that can prevent an error, surface a limitation and trigger a new decision.

    The source distinguishes several training audiences: general AI literacy for relevant staff, instruction on a particular use and workflow, onboarding for new hires, strategic oversight education for leaders, vendor-provided training, scenario-based incident response, and education for patients and communities. Each has a different purpose. A general lecture cannot tell a referral coordinator which fields to verify. A vendor demo may teach buttons without addressing the hospital's local responsibilities. A director needs to know the risk and governance decision, not every user-interface shortcut.

    Feedback also moves in several directions: staff to hospital, hospital to supplier, supplier to hospital, staff to patients, patients to hospital, peer institutions to one another, and hospital to its community. Treating feedback as one generic inbox loses who must send what, how quickly, and why. For study, ask where a concern can originate, who receives it, how the source is protected, and how the outcome changes the service. Those questions connect this chapter to lifecycle, risk, data and vendor management.

    Formación por función, riesgo y momento

    Control four point five point one asks organizations to ensure relevant staff receive training on AI solutions, their purpose and limitations, with recurring reinforcement. The guide recommends a structured program differentiated by role and risk. At or before go-live, direct users need to understand intended use, excluded use, what the output can and cannot establish, how to verify it, when to override it, and how to report a concern. New hires should not wait for the next annual session before encountering an active tool. When a model or workflow changes materially, training needs to change with it.

    For our fictional assistant, the referral coordinator should practice comparing the draft with source records, noticing missing or unsupported statements, correcting them, and escalating repeated problems. The manager should know how to review patterns and pause the feature. An IT owner should understand version, access and logging. Governance leaders should understand the evidence behind authorization and the signals that may reopen it. A vendor can supply product training, but the hospital remains responsible for making its local workflow clear. The playbook notes that vendor training support varies; the organization should know what is available before it relies on it.

    Training should be more than proof that somebody clicked complete. A higher-risk use may justify a practical competency check or observed exercise. Can the person identify an uncertain output? Do they know where to find the original record? Can they report a near miss without waiting for harm? Scenario practice can reveal whether instructions work under normal time pressure. Refresher intervals and completion requirements should follow the role and risk tier. General awareness may be recurring, while a major product update can trigger immediate focused instruction.

    Patient and community education has a separate goal. A plain-language explanation can help people understand where AI participates, what it does not decide, how to ask a question, and how to give feedback. Advisory groups or listening sessions may contribute to design and review, especially for consequential uses. Education should not be a one-way effort to persuade people to accept a system. It should make informed participation possible. The source offers several possible channels; the appropriate selection depends on the people affected and the actual use.

    Información de privacidad en el contexto de origen

    Control four point five point two is specific to the playbook's United States legal setting. It calls for patients to receive a comprehensive Notice of Privacy Practices no later than the first date of service and for that notice to address how protected health information may be used by AI solutions under HIPAA. This chapter names that control faithfully. It does not assert that a Notice of Privacy Practices or HIPAA applies in the same way to every hospital in Latin America. A real organization must identify its applicable privacy law and required patient communications with qualified advisers.

    The underlying governance question is broader: does the institution accurately explain data use involving AI to the people whose information is involved? A general privacy page written before AI was adopted may not answer whether a vendor processes information, whether data are used for model improvement, or which service uses them. The organization should align its public explanation, agreements, inventory and technical reality. If a new tool changes the data flow, the communication may need review. A polished notice that contradicts the actual data path undermines trust and makes questions harder to answer.

    In the fictional referral case, imagine a patient asks whether their information was used to improve the vendor's model. The staff member should not guess. The answer depends on the data use agreement, system configuration and authorized purpose. The organization should have a reliable route to answer and correct its materials if they are incomplete. The content should be understandable and accessible to the patient, not only to lawyers or technology teams. The source's legal control and the practical communication task should be kept distinct, since their exact forms vary by jurisdiction.

    For active recall, separate three questions: what does the source's U.S. control require, what does the hospital's own law require, and what information would a person reasonably need to understand this particular AI use? The first comes from the linked playbook. The second requires local legal assessment. The third demands honest knowledge of the system. Blending them produces confident but potentially false advice.

    Transparencia y consentimiento según el uso

    Control four point five point three addresses patient transparency and, where appropriate, consent for relevant AI solutions. The playbook does not say every AI function requires the same consent process. It asks organizations to identify where people encounter AI in their care journey, communicate plainly, provide ways to ask questions, and handle choices such as opt-out when available. A system used to manage inventory may call for a different conversation from one that directly interacts with a patient or informs a clinical decision.

    In our fictional case, a patient might never see the draft referral summary but may receive a message based on it. What should they know? At minimum, the organization should understand when the output influences what is communicated, who verifies it, and how a patient can correct a mistake. If an opt-out is offered for that use, the request must be recorded and honored consistently. Some functions may not allow opt-out, and the institution should be transparent about that fact and the reason. The source treats this as a design and communication process rather than a decorative label on a screen.

    Patient portals, admission materials, staff conversations, signs and service-specific explanations are possible channels, but no single channel reaches everyone. Materials should be reviewed when a tool is introduced or materially updated, and people with disabilities or limited AI literacy need accessible formats. A patient and family advisory body can help test whether explanations are understandable and whether they address real concerns. Staff should know how to answer questions without claiming that AI made a decision it did not make or that a human checked something that no one checked.

    Ask a director: can a patient learn, in ordinary language, the role of AI in a relevant service, whom to ask, and what choices they have? Can the team show that the explanation matches actual practice? If a legal consent is required, the applicable local rules determine its form. This independent study chapter does not supply that legal determination. The lesson from CHAI is that transparency has to be tied to the actual point of contact and refreshed as the AI system changes.

    Incidentes: registrar, escalar y cerrar el ciclo

    Control four point five point four calls for a process to document, escalate and notify relevant parties about AI incidents. The source stresses shared reporting responsibility. Anyone involved in an incident should understand their duty to report; responsibility does not reside only with the most senior person present. Many healthcare organizations already have patient-safety and quality reporting systems. The playbook suggests extending them with AI-related categories or fields rather than necessarily building a separate platform. This keeps AI concerns inside the organization's wider safety work.

    The playbook discusses people, data and AI as different contributors to incidents. A person may over-rely on an output or misunderstand its limits. Data may be missing, shifted or unrepresentative. The model or surrounding software may drift, fail or behave unexpectedly after an update. A real event may involve several categories at once. In the fictional assistant, an incorrect summary might combine incomplete source notes, an interface that hides provenance, and a reviewer who has been trained to move quickly. The investigation should trace the chain, not look for a single convenient person to blame.

    A useful report records what happened, the service and version, when and where it occurred, how AI contributed, severity or potential severity, the data vintage if relevant, immediate action, and the person to contact for follow-up. Routing then depends on the situation: service owner, department head, patient-safety team, AI governance group, legal or compliance, vendor, and affected patients when appropriate. The source gives illustrative time targets, but actual mandatory notification obligations and timelines depend on law and event type. This audio does not prescribe one timetable.

    Closing the loop matters. A reporter who never learns that anyone reviewed a concern may stop reporting. The organization should tell staff what was found and what changed, within privacy and legal limits. Near misses deserve attention as well as confirmed harm, because they can expose a weak safeguard before someone is injured. A documented escalation chain should include what happens if a usual owner is unavailable and who can pause use while an issue is assessed.

    Comunicar incidentes con resguardo

    Control four point five point five asks that information in AI incident communications be handled under relevant legal protections. The source discusses U.S. federal and state privacy rules and, for certain devices, FDA reporting. It gives state examples to show that requirements vary. The transferable method is to have legal and compliance owners review the categories of data captured in reports, what may be shared internally or externally, and what obligations are triggered by a real event. Do not assume a model-generated output is harmless to circulate because it looks like text.

    An incident record may contain patient identifiers, clinical details, model outputs, prompts, system logs and staff observations. Those elements may have different access and retention requirements. Our fictional assistant's failed summary could include a patient's referral history. The vendor may need technical evidence, but not necessarily every personal detail. A patient may need a clear explanation of what affected their service, without receiving a raw technical log. The governance committee may need a pattern across many events, not names. Good communication matches audience and purpose while preserving an accurate account.

    Staff need instructions for what they may document and share, especially during urgent response. A technically complete investigation can still create a privacy problem if files are copied broadly. Conversely, excessive fear of disclosure can prevent timely safety action. The organization should establish a path before incidents occur, with templates reviewed by the appropriate specialists and a way to update them when requirements change. The source advises integrating this into existing compliance cycles where possible. This is a process lesson, not legal advice or a claim about obligations outside the source's jurisdiction.

    For study, imagine a vendor asks for the entire prompt and output history after a suspected defect. Who decides which information is necessary? Which agreement governs access? How will the record be transferred and retained? Who documents the decision? The answers connect incident reporting back to data governance and supplier management. The point is not to delay investigation indefinitely. It is to make the investigation both effective and appropriately controlled.

    Canales seguros para hablar sin represalias

    Control four point five point six concerns protection for internal and external people who report AI-related concerns. The source names anonymity, confidentiality, non-retaliation assurances and clear disclosure of data retention. These are distinct. An anonymous channel does not collect or reveal identity. A confidential channel may know the identity but restricts who can see it. A non-retaliation policy addresses adverse action if identity becomes known. A retention notice explains what is collected, who can access it, how long it remains and how it is disposed of. A program should not promise anonymity if its login or metadata can identify a reporter.

    The hospital may be able to extend an existing patient-safety platform, hotline or compliance channel with an AI category. It should be accessible to staff, patients and other relevant parties. A report should reach someone with authority to investigate and act, with a route for urgent safety concerns. The playbook gives illustrative urgency tiers and response windows. Those are examples, not a legal standard or guaranteed service level. A practical system makes clear how a person submits a concern, how a case can be followed up without exposing identity unnecessarily, and what happens when the normal owner is implicated or unavailable.

    Consider a staff member who notices that the fictional assistant repeatedly omits information in one referral category. They may worry that raising a concern will be seen as resisting innovation. A protected channel increases the chance that the pattern becomes visible. The institution should investigate the data, model, workflow and training, then communicate an outcome. The policy needs to protect good-faith reporting even when the initial suspicion turns out to be wrong. Otherwise staff may wait for conclusive proof while a risk continues.

    A patient or vendor employee may also see something the hospital's monitoring misses. The source explicitly considers external reporters. Their path should be discoverable, usable and respectful of privacy. Protection is more than a reassuring phrase on a website. It requires channel design, access limits, response ownership and a record that corrective action occurred. A director should be able to ask how many concerns led to investigation and how the organization learned from them, without exposing the people who reported them.

    Repaso final de la biblioteca

    Review the six controls of this playbook. One: train relevant staff on the purpose, limits and safe use of AI, adapted by role and refreshed when needed. Two: in the source's U.S. setting, provide a Notice of Privacy Practices that addresses relevant AI use of protected health information. Three: create patient transparency and consent processes where appropriate to the solution and governing rules. Four: document and escalate AI incidents through a defined reporting chain. Five: handle incident information under applicable legal protections. Six: protect people who report concerns through honest anonymity or confidentiality, non-retaliation and clear retention practices.

    Try these questions aloud. What must a direct user know that a general AI literacy session cannot teach? Why does vendor training not replace local workflow training? How could a patient learn whether AI influenced a service and whom to ask? Why should several people involved in an event be able to report independently? Give one possible people, data and model contribution to an incorrect output. What should happen after a near miss is reported? What is the difference between anonymous and confidential reporting? What evidence would tell a director that feedback reaches decisions rather than sitting in an inbox?

    Across eight chapters, the library has moved from policy and governance roles to resources, lifecycle, risk, data, suppliers and human learning. These subjects work together. A data issue can change a risk assessment. A vendor update can invalidate training. A patient complaint can expose a limitation that monitoring missed. A policy means little if nobody owns the decision to pause a service. The most useful executive conversation asks for the specific use, evidence, responsible people, affected stakeholders, safeguards, feedback, and next decision point. Those questions help turn broad AI ambition into accountable practice.

    This recording is independent study commentary by Roberto Echeverría. It uses original explanation, a fictional case and review questions. It is not a CHAI course, endorsement or certification. The linked Coalition for Health AI playbook remains the original source and should be consulted for its full guidance, limitations and references. These audios are complementary learning material, not a promise about passing an exam or a substitute for the professional judgment needed in a real hospital.