Privacy vs. Innovation: California's Proposed Regulations on AI and Automated Decision-Making
Privacy vs. Innovation: California's Proposed Regulations on AI and Automated Decision-Making

The California Privacy Protection Agency (“CPPA”) has unveiled draft regulations regarding AI and automated decision-making technologies.  AI and automated decision-making encompasses systems leveraging machine learning, statistics, and data processing to evaluate personal information.  Such technologies not only aid in human decision-making, they also involve individual profiling capabilities, which triggers a potential need to safeguard privacy rights.  The draft regulations include, among other things, provisions for providing notice of AI technology use, delineating the scenarios and mechanisms for opting out from such use, and ensuring consumer access to information utilized by AI technologies.  As always, the profiling of children under 16 and defining how consumer information can be employed in training these systems is of utmost concern.

The CPPA argues that the draft regulations encourage responsible automated decision-making while ensuring privacy safeguards -- particularly for employees and children.  Similar to the laws and regulations associated with the California Consumer Privacy Act (“CCPA”), these proposed AI regulations would require that businesses using personal information in automated decision-making systems to transparently outline and disclose the information's use and provide opt-out avenues for California consumers.  If initial notice proves to be inadequate, businesses need to also furnish supplementary information through hyperlinks, highlighting how consumer data is used by their AI systems.  Additionally, disclosures must include evaluations of technology reliability and fairness. 

Just like the CCPA regulations, the new automated decision-making regulations have exemptions that may apply to certain businesses using automated decision-making for security, fraud detection, consumer safety, and core service provision.  However, businesses leveraging such systems for behavioral advertising must, similar to the CCPA, provide opt-out mechanisms to consumers, which underscores that ever-expanding importance of consumer choice and privacy as technologies evolve and become more powerful.

The draft regulations also emphasize various scenarios where consumers have the right to opt out, including in connection with legal determinations, student or employment evaluations, and instances in public places.  Notably, workplace monitoring tools for productivity tracking and public venue technologies like Wi-Fi or facial recognition fall within this purview.  An essential point of contention applies to the handling of children’s information, which like the CCPA mandates parental consent mechanisms for monitoring individuals under 13 and informing those between 13 and 16 of their opt-out rights.  Moreover, consumers once again would continue to possess rights to inquire about the usage of AI-based automated decision-making technology affecting them, demanding insights into system logic, decision-making processes, and human influence on outcomes.  Once again, verifiable identity validation is a prerequisite for making such requests, with limited exceptions for cases involving consumer safety, security, or fraud prevention.

The CPPA's initiative is pivotal amid global discussions on regulating AI, echoing similar calls for regulation at the federal level in the U.S. President Biden's executive order on AI and the EU's proposed AI Act underline the urgency for state-based AI governance.  As always, under these circumstances, California's proactive stance in enacting these regulations aligns with ongoing discussions on AI regulation, setting precedents for other states and potentially shaping future federal legislation.  These draft CPPA regulations signal a significant stride in balancing the ethical use of AI with safeguarding individual privacy rights.  As California spearheads these groundbreaking AI-oriented regulations, the world looks on hoping for insights into a reasonable and balanced benchmark for responsible AI governance.


This publication is published by the law firm of Ervin Cohen & Jessup LLP. The publication is intended to present an overview of current legal trends; no article should be construed as representing advice on specific, individual legal matters. Articles may be reprinted with permission and acknowledgment. ECJ is a registered service mark of Ervin Cohen & Jessup LLP. All rights reserved.

Subscribe

Recent Posts

Blogs

Contributors

Archives

Jump to PageX

Ervin Cohen & Jessup LLP Cookie Preference Center

Your Privacy

When you visit our website, we use cookies on your browser to collect information. The information collected might relate to you, your preferences, or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. For more information about how we use Cookies, please see our Privacy Policy.

Strictly Necessary Cookies

Always Active

Necessary cookies enable core functionality such as security, network management, and accessibility. These cookies may only be disabled by changing your browser settings, but this may affect how the website functions.

Functional Cookies

Always Active

Some functions of the site require remembering user choices, for example your cookie preference, or keyword search highlighting. These do not store any personal information.

Form Submissions

Always Active

When submitting your data, for example on a contact form or event registration, a cookie might be used to monitor the state of your submission across pages.

Performance Cookies

Performance cookies help us improve our website by collecting and reporting information on its usage. We access and process information from these cookies at an aggregate level.

Powered by Firmseek