<?xml version="1.0" ?>
<ns0:MeasureDoc xmlns:html="http://www.w3.org/1999/xhtml" xmlns:ns0="http://lc.ca.gov/legalservices/schemas/caml.1#" xmlns:ns3="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="1.0" xsi:schemaLocation="http://lc.ca.gov/legalservices/schemas/caml.1# xca.1.xsd">
	


	<ns0:Description>
		<ns0:Id>20250SB__083396AMD</ns0:Id>
		<ns0:VersionNum>96</ns0:VersionNum>
		<ns0:History>
			<ns0:Action>
				<ns0:ActionText>INTRODUCED</ns0:ActionText>
				<ns0:ActionDate>2025-02-21</ns0:ActionDate>
			</ns0:Action>
			<ns0:Action>
				<ns0:ActionText>AMENDED_SENATE</ns0:ActionText>
				<ns0:ActionDate>2025-03-26</ns0:ActionDate>
			</ns0:Action>
			<ns0:Action>
				<ns0:ActionText>AMENDED_ASSEMBLY</ns0:ActionText>
				<ns0:ActionDate>2025-07-07</ns0:ActionDate>
			</ns0:Action>
			<ns0:Action>
				<ns0:ActionText>AMENDED_ASSEMBLY</ns0:ActionText>
				<ns0:ActionDate>2025-07-17</ns0:ActionDate>
			</ns0:Action>
		</ns0:History>
		<ns0:LegislativeInfo>
			<ns0:SessionYear>2025</ns0:SessionYear>
			<ns0:SessionNum>0</ns0:SessionNum>
			<ns0:MeasureType>SB</ns0:MeasureType>
			<ns0:MeasureNum>833</ns0:MeasureNum>
			<ns0:MeasureState>AMD</ns0:MeasureState>
		</ns0:LegislativeInfo>
		<ns0:AuthorText authorType="LEAD_AUTHOR">Introduced by Senator McNerney</ns0:AuthorText>
		<ns0:Authors>
			<ns0:Legislator>
				<ns0:Contribution>LEAD_AUTHOR</ns0:Contribution>
				<ns0:House>SENATE</ns0:House>
				<ns0:Name>McNerney</ns0:Name>
			</ns0:Legislator>
		</ns0:Authors>
		<ns0:Title>An act to add Article 6.6 (commencing with Section 8954.50) to Chapter 7 of Division 1 of Title 2 of the Government Code, relating to state government.</ns0:Title>
		<ns0:RelatingClause>state government</ns0:RelatingClause>
		<ns0:GeneralSubject>
			<ns0:Subject> Critical infrastructure: artificial intelligence systems: human oversight.</ns0:Subject>
		</ns0:GeneralSubject>
		<ns0:DigestText>
			<html:p>Existing law, the California Emergency Services Act, establishes the California Cybersecurity Integration Center within the Office of Emergency Services to serve as the central organizing hub of state government’s cybersecurity activities and to coordinate information sharing with various entities. Existing law also requires the Technology Recovery Plan element of the State Administrative Manual to ensure the inclusion of cybersecurity strategy incident response standards for each state agency to secure its critical infrastructure controls and information, as prescribed.</html:p>
			<html:p>This bill would require, on or before July 1, 2026, an operator, defined as a
			 state agency responsible for operating, managing, overseeing, or controlling access to critical infrastructure, that deploys a covered artificial intelligence (AI) system, as defined, to establish a human oversight mechanism that ensures a human monitors the system’s operations in real time and
			 reviews and
			 approves any plan or action proposed by the covered AI system before execution, except as provided. The bill would require the Department of Technology to develop specialized training in AI safety protocols and risk management techniques to oversight personnel. The bill would require
			 oversight personnel for an operator to conduct an annual assessment of its covered AI systems, as specified, and to submit a summary of the findings to the department. The bill would make findings and declarations related to its provisions.</html:p>
			<html:p>The bill would preclude disclosure of specified information by the office.</html:p>
			<html:p>Existing constitutional provisions require that a statute that limits the right of access to the meetings of public bodies or the writings of public officials and agencies be adopted with findings demonstrating the interest protected by the limitation and the need for protecting that interest.</html:p>
			<html:p>This bill would make legislative findings to that effect.</html:p>
		</ns0:DigestText>
		<ns0:DigestKey>
			<ns0:VoteRequired>MAJORITY</ns0:VoteRequired>
			<ns0:Appropriation>NO</ns0:Appropriation>
			<ns0:FiscalCommittee>YES</ns0:FiscalCommittee>
			<ns0:LocalProgram>NO</ns0:LocalProgram>
		</ns0:DigestKey>
		<ns0:MeasureIndicators>
			<ns0:ImmediateEffect>NO</ns0:ImmediateEffect>
			<ns0:ImmediateEffectFlags>
				<ns0:Urgency>NO</ns0:Urgency>
				<ns0:TaxLevy>NO</ns0:TaxLevy>
				<ns0:Election>NO</ns0:Election>
				<ns0:UsualCurrentExpenses>NO</ns0:UsualCurrentExpenses>
				<ns0:BudgetBill>NO</ns0:BudgetBill>
				<ns0:Prop25TrailerBill>NO</ns0:Prop25TrailerBill>
			</ns0:ImmediateEffectFlags>
		</ns0:MeasureIndicators>
	</ns0:Description>
	<ns0:Bill id="bill">
		<ns0:Preamble>The people of the State of California do enact as follows:</ns0:Preamble>
		<ns0:BillSection id="id_E45F9E5A-F08E-4175-AA21-6AC3C792D447">
			<ns0:Num>SECTION 1.</ns0:Num>
			<ns0:Content>
				<html:p>The Legislature finds and declares all of the following:</html:p>
				<html:p>
					(a)
					<html:span class="EnSpace"/>
					In response to the rapid advancement of generative artificial intelligence (GenAI) and its growing integration across public and private sectors, the Governor issued Executive Order No. N-12-23, which established a comprehensive policy framework to responsibly explore and govern the deployment of GenAI systems within the state.
				</html:p>
				<html:p>
					(b)
					<html:span class="EnSpace"/>
					The Governor convened the Joint California Policy Working Group on AI Frontier Models to evaluate the potential risks and governance needs associated with the deployment of powerful artificial
				intelligence models.
				</html:p>
				<html:p>
					(c)
					<html:span class="EnSpace"/>
					The Governor’s executive order also emphasized the urgent need for workforce development and training to ensure that public sector employees have the technical expertise and practical tools necessary to oversee and manage artificial intelligence systems safely and effectively.
				</html:p>
			</ns0:Content>
		</ns0:BillSection>
		<ns0:BillSection id="id_46C377D9-8C63-4FE1-A359-3C0F231A0D65">
			<ns0:Num>SEC. 2.</ns0:Num>
			<ns0:ActionLine action="IS_ADDED" ns3:href="urn:caml:codes:GOV:caml#xpointer(%2Fcaml%3ALawDoc%2Fcaml%3ACode%2Fcaml%3ALawHeading%5B%40type%3D'TITLE'%20and%20caml%3ANum%3D'2.'%5D%2Fcaml%3ALawHeading%5B%40type%3D'DIVISION'%20and%20caml%3ANum%3D'1.'%5D%2Fcaml%3ALawHeading%5B%40type%3D'CHAPTER'%20and%20caml%3ANum%3D'7.'%5D%2Fcaml%3ALawHeading%5B%40type%3D'ARTICLE'%20and%20caml%3ANum%3D'6.6.'%5D)" ns3:label="fractionType: LAW_SPREAD||commencingWith: 8954.50" ns3:type="locator">
				Article 6.6 (commencing with Section 8954.50) is added to Chapter 7 of Division 1 of Title 2 of the 
				<ns0:DocName>Government Code</ns0:DocName>
				, to read:
			</ns0:ActionLine>
			<ns0:Fragment>
				<ns0:LawHeading id="id_940DC96D-F9E3-4D78-90C4-473466D3476C" type="ARTICLE">
					<ns0:Num>6.6.</ns0:Num>
					<ns0:LawHeadingVersion id="id_AE507E5F-347A-489F-91E1-26AE7B1A5C10">
						<ns0:LawHeadingText>Artificial Intelligence and Critical Infrastructure</ns0:LawHeadingText>
					</ns0:LawHeadingVersion>
					<ns0:LawSection id="id_EFE23E0C-A38C-49BF-8BCB-62A87E6D8E9A">
						<ns0:Num>8954.50.</ns0:Num>
						<ns0:LawSectionVersion id="id_8F87B605-8ED4-4CDA-A8D6-601839425EA8">
							<ns0:Content>
								<html:p>For purposes of this section, the following definitions apply:</html:p>
								<html:p>
									(a)
									<html:span class="EnSpace"/>
									“Artificial intelligence” (“AI”) means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.
								</html:p>
								<html:p>
									(b)
									<html:span class="EnSpace"/>
									“Automated decision system” means a computational process derived from machine learning, statistical modeling, data analytics, or artificial intelligence that issues simplified output, including a score, classification, or recommendation, that is used to assist or replace human discretionary decisionmaking and materially impacts natural persons. “Automated
						  decision system” does not include a spam email filter, firewall, antivirus software, identity and access management tools, or a calculator.
								</html:p>
								<html:p>
									(c)
									<html:span class="EnSpace"/>
									“Covered AI system” means an AI system or automated decision system that an operator uses to operate, manage, oversee, or control access to critical infrastructure.
								</html:p>
								<html:p>
									(d)
									<html:span class="EnSpace"/>
									“Critical infrastructure” means systems or assets so vital to the state that the incapacity or destruction of those networks, systems, or assets would have a debilitating impact on public health, safety, economic security, or any combination thereof, but not unintended use, including, but not limited to, the following sectors: chemical, commercial facilities, communications, critical manufacturing, dams, defense industrial base, emergency services, energy, financial services, food and agriculture, government facilities, health care and public health, information technology,
						  nuclear reactors, materials, and waste, transportation systems, and water and wastewater systems.
								</html:p>
								<html:p>
									(e)
									<html:span class="EnSpace"/>
									“Department” means the Department of Technology.
								</html:p>
								<html:p>
									(f)
									<html:span class="EnSpace"/>
									“Office” means the Office of Emergency Services.
								</html:p>
								<html:p>
									(g)
									<html:span class="EnSpace"/>
									“Operator” means a state agency responsible for operating, managing, overseeing, or controlling access to critical infrastructure.
								</html:p>
								<html:p>
									(h)
									<html:span class="EnSpace"/>
									“State agency” has the same meaning set forth in Section 11000.
								</html:p>
							</ns0:Content>
						</ns0:LawSectionVersion>
					</ns0:LawSection>
					<ns0:LawSection id="id_912D3620-C8CF-4A03-AD4A-0057F6F8D766">
						<ns0:Num>8954.51.</ns0:Num>
						<ns0:LawSectionVersion id="id_7E7E3D04-37A8-4675-BDF4-DD60D099791D">
							<ns0:Content>
								<html:p>
									(a)
									<html:span class="EnSpace"/>
									On or before July 1, 2026, an oversight personnel for an operator that deploys a covered AI system shall establish a human oversight mechanism that ensures a human does both of the following:
								</html:p>
								<html:p>
									(1)
									<html:span class="EnSpace"/>
									Monitors the artificial intelligence system’s operations in real time.
								</html:p>
								<html:p>
									(2)
									<html:span class="EnSpace"/>
									(A)
									<html:span class="EnSpace"/>
									Except as provided in subparagraph (B), reviews and approves any plan or action proposed by an artificial intelligence system before execution.
								</html:p>
								<html:p>
									(B)
									<html:span class="EnSpace"/>
									If oversight personnel determine that prior review and approval under subparagraph (A) is substantially disruptive to the operation of the covered AI system, the
						  operator shall instead implement a process for periodically reviewing the actions of the covered AI system to ensure accuracy and reliability.
								</html:p>
								<html:p>
									(b)
									<html:span class="EnSpace"/>
									(1)
									<html:span class="EnSpace"/>
									The department shall develop specialized training in AI safety protocols and risk management techniques to be given annually to oversight personnel.
								</html:p>
								<html:p>
									(2)
									<html:span class="EnSpace"/>
									An operator shall designate at least one employee to serve as oversight personnel who is responsible for administering the human oversight mechanism. The oversight personnel shall complete the annual training under paragraph (1).
								</html:p>
								<html:p>
									(c)
									<html:span class="EnSpace"/>
									(1)
									<html:span class="EnSpace"/>
									Oversight personnel for an operator that deploys a covered AI system shall conduct an annual assessment of its covered AI systems that does all of the following:
								</html:p>
								<html:p>
									(A)
									<html:span class="EnSpace"/>
									Evaluates
						  the operator’s compliance with this section.
								</html:p>
								<html:p>
									(B)
									<html:span class="EnSpace"/>
									Evaluates covered AI system performance and safety.
								</html:p>
								<html:p>
									(C)
									<html:span class="EnSpace"/>
									Identifies and evaluates potential risks and vulnerabilities associated with the operation of the covered AI system, including those that could lead to mass casualty events or property damage in excess of five hundred thousand dollars ($500,000).
								</html:p>
								<html:p>
									(D)
									<html:span class="EnSpace"/>
									Identifies any necessary updates to the human oversight mechanism used by the operator.
								</html:p>
								<html:p>
									(2)
									<html:span class="EnSpace"/>
									Oversight personnel for an operator that deploys a covered AI system shall submit a summary of the assessment findings to the department.
								</html:p>
							</ns0:Content>
						</ns0:LawSectionVersion>
					</ns0:LawSection>
					<ns0:LawSection id="id_401619DC-7775-4F78-9887-FCDA91646885">
						<ns0:Num>8954.52</ns0:Num>
						<ns0:LawSectionVersion id="id_B156DD8A-9B81-43CA-89D8-B3E859C1BBEF">
							<ns0:Content>
								<html:p>The office shall not disclose any record or information within a record of the office related to this article that is privileged, protected by copyright, or otherwise prohibited by law from being disclosed that is exempt from disclosure to the public under express provisions of the California Public Records Act (Division 10 (commencing with Section 7920.000) of Title 1) or in which, based on the facts of the particular case, the public interest served by not disclosing the record clearly outweighs the public interest served by disclosure of the record.</html:p>
							</ns0:Content>
						</ns0:LawSectionVersion>
					</ns0:LawSection>
				</ns0:LawHeading>
			</ns0:Fragment>
		</ns0:BillSection>
		<ns0:BillSection id="id_33E74502-34D5-4B88-A477-BED87C1DB842">
			<ns0:Num>SEC. 3.</ns0:Num>
			<ns0:Content>
				<html:p>The Legislature finds and declares that Section 2 of this act, which adds Section 8954.52 to the Government Code, imposes a limitation on the public’s right of access to the meetings of public bodies or the writings of public officials and agencies within the meaning of Section 3 of Article I of the California Constitution. Pursuant to that constitutional provision, the Legislature makes the following findings to demonstrate the interest protected by this limitation and the need for
				protecting that interest:</html:p>
				<html:p>To protect the sensitive information related to operating, managing, overseeing, or controlling access to critical infrastructure, it is necessary to limit the public’s right of access to these records.</html:p>
			</ns0:Content>
		</ns0:BillSection>
	</ns0:Bill>
</ns0:MeasureDoc>