Compliance6 min read
Governing AI scribes in behavioral health: a working framework for 2026
In late 2026, federal transparency rules for clinical AI are getting lighter while state rules for mental health AI keep growing. Agencies now carry more of the governance work themselves. This post covers the rules that apply and an eight-part program a compliance lead can run.
Margent policy desk · Clinical policy and compliance
Not legal advice. Several items below changed in the last month and others are in litigation. Confirm current status with counsel.
For two years, many behavioral health agencies assumed AI governance would be handed to them. Federal certification rules would make vendors disclose how their models work, and accreditors would set the standard. As of October 2026 that is not happening. The federal floor is getting lower, the state rules are getting stricter, and the agency that deploys an AI scribe is answerable for how it is used.
What changed at the federal level
HTI-1 created transparency duties, and HTI-5 removes most of them. ONC's HTI-1 final rule (published January 2024) replaced the old clinical decision support certification criterion with a "decision support interventions" (DSI) criterion. Certified health IT that supported predictive DSIs had to expose 31 source attributes, covering intended use, training data, external validation and performance measures. In practice, this was a mandatory model card.
ONC proposed HTI-5 in December 2025 as a deregulatory rule, and the comment period closed on February 27, 2026. According to Holland & Knight's October 28, 2026 summary, ONC published the HTI-5 final rule on October 26, 2026. It narrows the DSI criterion to fully remove the model card requirements for source attributes, along with the related transparency, documentation and annual review duties from HTI-1. ONC's stated reason was that it had found "no publicly available evidence" that the transparency requirements had improved patient care. Different provisions take effect on different dates, and we have not confirmed which date applies to the DSI changes.
The practical effect is simple. If you want a vendor's model card, you now have to ask for it in the contract. Certification will no longer require one.
Section 1557 still applies to decision support tools. HHS's 2024 Section 1557 rule added 45 CFR §92.210. It prohibits discrimination through "patient care decision support tools", a category broad enough to include anything from a flowchart to a machine-learning model. Covered entities must make reasonable efforts to identify tools that use race, color, national origin, sex, age or disability as inputs, and to reduce the risk of discrimination from each one. The identification and mitigation duties took effect May 1, 2025. The section remains in the CFR, but federal enforcement priorities have shifted since then, so ask counsel how much weight to give it.
A scribe that only transcribes and drafts is arguably not a decision support tool. Many products now do more than that: they suggest diagnoses, flag risk, propose CPT codes or recommend a level of care. Each of those features influences a clinical decision, and we recommend governing them as if §92.210 applies.
What states have added
State law is where the specific obligations for behavioral health are. The laws we track most closely (our consent guide covers recording consent in more depth):
| State | Law | What it asks of a provider |
|---|---|---|
| Illinois | Wellness and Oversight for Psychological Resources Act, signed Aug. 4, 2025 | AI may support administrative and supplementary tasks such as notes and records. Only licensed professionals make therapeutic decisions. Recording or transcribing a session with AI requires the client's informed consent. IDFPR enforces, with fines of up to $10,000 per violation. |
| Utah | HB 452, signed Mar. 25, 2025 | Regulates mental health chatbots: required disclosures, limits on use of personal information and on advertising. Applies to client-facing tools, not documentation alone. |
| California | AB 3030 (2024); AB 489 (effective Jan. 1, 2026) | Generative-AI clinical messages to patients need a disclaimer unless a licensed provider reviews them first. AI tools may not imply that they hold a health care license. |
| Texas | SB 1188, effective Sept. 1, 2025 | Practitioners who use AI for diagnostic purposes must disclose that use to patients and review AI-created records under medical-records standards. |
| Colorado | SB 24-205 (Colorado AI Act) | Rules on algorithmic discrimination in high-stakes decisions, including health care. The effective date was pushed to June 30, 2026, and a federal magistrate stayed enforcement on April 27, 2026. Status uncertain. |
There is also a federal complication. A December 11, 2025 executive order directed the Attorney General to set up an AI Litigation Task Force to challenge state AI laws. We have not found a court decision that strikes down any of the laws above. Until one exists, assume they apply.
The accreditor view
On September 17, 2025, The Joint Commission and the Coalition for Health AI released voluntary guidance on the responsible use of AI in health care. It is organized around seven elements: governance structures, privacy and transparency, data security, ongoing quality monitoring, voluntary reporting of AI safety events, risk and bias assessment, and education. The guidance is not an accreditation standard yet. The Joint Commission has said it plans a voluntary AI certification, so the seven elements are a reasonable preview of what surveyors will ask about.
An eight-part governance program
Below is the program we would run at a multi-program agency. Most of it can be assigned to people who already exist: the compliance officer, the medical director, the privacy officer and an IT lead.
- 1. Inventory
- List every AI feature in use: scribe drafting, code suggestion, risk flags, client messaging and intake triage. For each one, record what it influences and which law or policy applies. Something not on the list cannot be governed.
- 2. Consent
- Capture consent before recording, per client and per setting, in the language the state requires. Store it as structured data with a date and version, not as a scanned PDF.
- 3. Human review
- The clinician reads and signs every note. Do not allow bulk-signing of AI drafts. Supervisors co-sign for pre-licensed staff, as they would without AI.
- 4. Audit trail
- For each signed note, keep the draft the model produced, the clinician's edits, the model and version, the consent record and who signed. When an auditor or licensing board asks what the AI wrote and what the clinician wrote, you need an exact answer.
- 5. Quality and bias monitoring
- Sample notes every month. Track omissions, statements the transcript does not support, and edit rates. Break the results down by session language, client age group and program. A model that does worse with accented speech or with children shows up here first.
- 6. Incident reporting
- Treat AI errors that reach a signed note like other safety events: report them, review them and record what changed.
- 7. Vendor terms
- Since HTI-5 removes the certification requirement, put transparency in the contract: model documentation, validation data for behavioral health, data retention, no training on your PHI, and notice before material model changes.
- 8. Training
- Clinicians should be able to say what the tool does, what it gets wrong, and how to explain it to a client who asks.
Where agencies get stuck
- Consent captured once at intake and never refreshed when the setting changes, for example from individual to family sessions.
- No record of what the AI drafted versus what the clinician changed, so an omission can't be traced.
- Code suggestions and risk flags governed like the transcription feature, even though they influence decisions.
- Bias reviews done once at procurement and never repeated after the vendor updates the model.
- Client-facing chat or text features launched under the documentation policy, which doesn't cover them.
How Margent is built for this
Margent keeps the governance record as part of normal use. Margent links every sentence in a draft to the moment in the session it came from, and consent is captured per program and per client before recording starts. The draft, the clinician's edits and the signature are stored together. Nothing is submitted without a clinician's signature. Note checks test consent and co-signature rules before signing. Our security page lists data handling, retention and the model-training commitment so you can put them in a contract.
Sources
- 01ONC, HTI-1 final rule, 89 FR 1192 (Jan. 9, 2024), decision support interventions criterion (opens in a new tab)
- 02ASTP/ONC, HTI-5 proposed rule and proposed rule chart (Dec. 2025; comments closed Feb. 27, 2026) (opens in a new tab)
- 03Holland & Knight, "HTI-5 Promotes Deregulatory Certification Actions" (Oct. 28, 2026) (opens in a new tab)
- 04HHS, Nondiscrimination in Health Programs and Activities final rule, 89 FR 37522 (May 6, 2024), 45 CFR §92.210 (opens in a new tab)
- 05Orrick, "Illinois Enacts Law Regulating AI with Sweeping Implications for Behavioral Health Delivery" (Aug. 2025) (opens in a new tab)
- 06Utah HB 452, Artificial Intelligence Amendments (2025) (opens in a new tab)
- 07Texas Medical Association, "New Law Requires Texas Physicians to Disclose AI" (SB 1188, 2025) (opens in a new tab)
- 08Squire Patton Boggs, "The Colorado AI Act Hits a Wall" (May 2026) (opens in a new tab)
- 09Executive Order, "Ensuring a National Policy Framework for Artificial Intelligence" (Dec. 11, 2025), summarized by Kilpatrick Townsend (opens in a new tab)
- 10The Joint Commission and CHAI, Guidance on the Responsible Use of AI in Healthcare (Sept. 17, 2025), summarized by Duane Morris (opens in a new tab)