New York State is taking a firm stance on protecting minors from potentially harmful artificial intelligence services. Governor Kathy Hochul signed a new law on October 28th that prohibits the provision of unsafe AI chatbot services to underage individuals.
Defining “Unsafe” AI
The newly enacted legislation specifically targets AI chatbots that engage in behaviors deemed unsafe for young users. This includes AI that:
- Impersonates real people.
- Fosters emotional dependency.
- Encourages self-harm or suicide.
- Promotes social isolation.
- Contains sexually explicit content.
- Involves child sexual abuse material.
Age Verification and Data Protection
Under the new state law, companies offering such AI services are required to implement robust age verification measures. This means providing multiple methods for users to confirm their age. Crucially, businesses must also ensure that age information is deleted after use, reinforcing a commitment to user privacy.
The enforcement of this law will be handled by the State Attorney General’s office. Violators face significant penalties, with the possibility of civil fines up to $25,000 for each infraction. Beyond monetary penalties, the Attorney General can seek remedies such as compensation for damages, and the destruction of illegally collected data or AI models trained on such data.
The Rise of AI Companions Among Teens
The timing of this legislation is particularly relevant given the increasing prevalence of AI companions among young people. According to data from the non-profit organization Common Sense Media, a significant majority of teenagers—at least 72%—have used AI companions. Furthermore, 52% of these teenagers are active users, interacting with AI multiple times per month.
“New York State is sending a clear message: If you want to do business in our state, you must put the safety of children first,” stated Governor Hochul. This statement underscores the state’s priority in safeguarding its youngest residents in the rapidly evolving digital landscape.
Broader Child Safety Measures
The new law restricting unsafe AI chatbots for minors is not an isolated initiative. On the same day, another piece of legislation was signed into law. This concurrent law mandates that manufacturers must ensure internet-connected baby monitoring devices cannot be exploited by strangers. It also requires these devices to be equipped with clear functional warning labels, adding another layer of protection for vulnerable users.
New York’s proactive approach signals a growing trend among governments worldwide to address the ethical and safety implications of emerging technologies, particularly concerning their impact on children and adolescents.
