Orrick, Herrington & Sutcliffe LLP The health care industry has utilized artificial intelligence for decades, but the recent expansion of AI’s capabilities into generative AI models is raising questions about how and to what extent to regulate the technology.
AI is generally used for analysis and prediction. Generative AI, however, is capable – in theory – of making clinical decisions, such as diagnosing conditions, identifying health risks and developing patient-specific treatment options.
A few states have recently taken measures specifically to regulate generative AI in health care – and more may follow suit. In tackling the issue, states must balance embracing innovative and potentially life-saving technologies while protecting patients from generative AI’s limitations. A Focus on Disclosure
One trend we are seeing relates to disclosures to patients when communication related to their care involves generative AI.
California Gov. Gavin Newsom recently signed into law a bill regarding AI that can “generate derived synthetic content, including images, videos, audio, text, and other digital content.”
The law applies to health care facilities, clinics, physician’s offices and group practice offices that use generative AI to create written or verbal patient communications pertaining to “patient clinical information.” It requires them to: Provide a disclaimer to patients when generative AI creates a given communication.
Instruct patients on how to contact a human provider, employee or other person.
The disclaimers must: Appear prominently at the beginning of each written communication involving physical and digital media, such as letters and emails.
Be prominently displayed throughout the interaction for continuous written online communications, including chat messaging. Be provided verbally at the start and end of audio communications. Be prominently displayed throughout video interactions. A Similar Approach The new California law is similar to a 2024 Utah law addressing generative AI disclosures.That law applies to AI that is trained on data, interacts with a person by text, audio or visual communication and “generates non-scripted outputs similar to outputs created by a human, with limited or no human oversight.”It in part requires providers of regulated occupations – physicians, for example – to “prominently disclose” when a patient interacts with generative AI.The […]
U.S. States Begin Regulating Generative Artificial Intelligence in Health Care