NY, US · AI law tracker

S9381 — NY, US

S9381 is an AI governance legislation from NY, currently committee. New York Bill S9381 introduces potential liability for chatbots providing harmful or incorrect information, leading to user loss [1]. AIGI tracks 1 primary-source update on this bill; the most recent was published on 2024-05-14.

Status & timeline

Regulatory stage
committee
Bill status
In Senate Committee
Authority / governing body
New York State Senate
Chamber
Senate
Document type
legislation

Next deadline: No fixed deadline — currently in committee.

Subscriber only

Full obligation matrix

ActorObligationDeadlineSource
deployerEnsure chatbots do not provide misleading, incorrect, contradictory, or harmful information that results in financial loss or other demonstrable harm to users.
providerEnsure chatbots do not provide misleading, incorrect, contradictory, or harmful information that results in financial loss or other demonstrable harm to users.

Subscriber only

Enforcement risk score

25
/ 100

Announced regulation; enforcement footprint still forming.

Subscriber only

Role-based compliance checklist

  • general_counsel Review bill text upon enactment to understand precise liability scope and thresholds.
  • cto Evaluate current chatbot systems for mechanisms to prevent the generation and dissemination of misleading, incorrect, or harmful information.
  • risk_manager Assess potential financial and reputational risks associated with chatbot output and establish mitigation strategies.

Subscriber only

Vendor impact assessment

Vendor risk class
high
Procurement categories
customer_service_ai, marketing_personalization, other

Vendors providing chatbot solutions, especially those for customer interaction or content generation, will need to demonstrate robust controls against generating harmful, misleading, or incorrect information to avoid exposing their clients (and themselves) to liability.

Sample vendor questions

  1. What mechanisms does your chatbot solution have to prevent the generation of misleading or incorrect information?
  2. How do you ensure the factual accuracy and consistency of information provided by the chatbot?
  3. What safeguards are in place to prevent the chatbot from generating harmful content or advice?
  4. What are your liability provisions regarding chatbot output that results in user harm or financial loss?

Intelligence briefs (1)

legislation In Senate Committee 5/14/2024

NY Bill S9381 Proposes Chatbot Liability for Harmful Information

New York Bill S9381 introduces potential liability for chatbots providing harmful or incorrect information, leading to user loss [1].

This signals an emerging focus on AI system outputs and potential deployer liability for chatbot-generated content in the US.

Deadline: No fixed deadline — currently in committee.

Primary source →

Frequently asked questions

What is S9381?
New York Senate Bill S9381 (2023-2024) has been introduced to establish liability for chatbots that provide misleading, incorrect, contradictory, or harmful information to users [1]. This proposed legislation targets instances where such information results in financial loss or other demonstrable harm to the user [2]. The bill is currently in the Senate Committee on Internet And Technology, awaiting further review. Primary source →
Why does S9381 matter?
This signals an emerging focus on AI system outputs and potential deployer liability for chatbot-generated content in the US. Primary source →
Who does S9381 affect?
This proposal primarily impacts developers and deployers of conversational AI systems, including large language models (LLMs) used as chatbots, within or serving users in New York State. Organizations utilizing chatbots for customer service, financial advice, healthcare information, or any application where erroneous output could cause demonstrable harm or financial loss, are within scope. Businesses in sectors like financial services, healthcare, and e-commerce that integrate AI chatbots into their operations should consider this development. Primary source →
What are the key dates for S9381?
No fixed deadline — currently in committee. Primary source →
What is the current status of S9381?
As of the last published update, S9381 is at the "committee" stage, with bill status "In Senate Committee". Primary source →
Where can I find the primary source for S9381?
The primary source for the most recent update is at https://legislation.nysenate.gov/bills/2023/S9381. AIGI publishes the full citation chain plus every approved brief on this bill. Primary source →

Stay informed

Get briefs on every AI law, every morning.

Start 14-day trial →