Bill Full Text
Home
-
Bills
-
Bill
-
Authors
-
Dates
-
Locations
-
Analyses
-
Organizations
<?xml version="1.0" ?>
<ns0:MeasureDoc xmlns:html="http://www.w3.org/1999/xhtml" xmlns:ns0="http://lc.ca.gov/legalservices/schemas/caml.1#" xmlns:ns3="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="1.0" xsi:schemaLocation="http://lc.ca.gov/legalservices/schemas/caml.1# xca.1.xsd">
<ns0:Description>
<ns0:Id>20250SB__081396AMD</ns0:Id>
<ns0:VersionNum>96</ns0:VersionNum>
<ns0:History>
<ns0:Action>
<ns0:ActionText>INTRODUCED</ns0:ActionText>
<ns0:ActionDate>2025-02-21</ns0:ActionDate>
</ns0:Action>
<ns0:Action>
<ns0:ActionText>AMENDED_SENATE</ns0:ActionText>
<ns0:ActionDate>2025-03-26</ns0:ActionDate>
</ns0:Action>
<ns0:Action>
<ns0:ActionText>AMENDED_SENATE</ns0:ActionText>
<ns0:ActionDate>2025-05-01</ns0:ActionDate>
</ns0:Action>
<ns0:Action>
<ns0:ActionText>AMENDED_SENATE</ns0:ActionText>
<ns0:ActionDate>2026-01-05</ns0:ActionDate>
</ns0:Action>
</ns0:History>
<ns0:LegislativeInfo>
<ns0:SessionYear>2025</ns0:SessionYear>
<ns0:SessionNum>0</ns0:SessionNum>
<ns0:MeasureType>SB</ns0:MeasureType>
<ns0:MeasureNum>813</ns0:MeasureNum>
<ns0:MeasureState>AMD</ns0:MeasureState>
</ns0:LegislativeInfo>
<ns0:AuthorText authorType="LEAD_AUTHOR">Introduced by Senator McNerney</ns0:AuthorText>
<ns0:Authors>
<ns0:Legislator>
<ns0:Contribution>LEAD_AUTHOR</ns0:Contribution>
<ns0:House>SENATE</ns0:House>
<ns0:Name>McNerney</ns0:Name>
</ns0:Legislator>
</ns0:Authors>
<ns0:Title>An act to add Chapter 14 (commencing with Section 8898) to Division 1 of Title 2 of the Government Code, relating to artificial intelligence.</ns0:Title>
<ns0:RelatingClause>artificial intelligence</ns0:RelatingClause>
<ns0:GeneralSubject>
<ns0:Subject>California AI Standards and Safety Commission: independent verification organizations.</ns0:Subject>
</ns0:GeneralSubject>
<ns0:DigestText>
<html:p>Existing law requires, on or before September 1, 2024, the Department of Technology, within the Government Operations Agency, to conduct, in coordination with other interagency bodies as it deems appropriate, a comprehensive inventory of all high-risk automated decision systems that have been proposed for use, development, or procurement by, or are being used, developed, or procured by, any state agency.
Existing law requires the department to annually submit a report of that comprehensive inventory to the Assembly Committee on Privacy and Consumer Protection and the Senate Committee on Governmental Organization.</html:p>
<html:p>Existing law, the Transparency in Frontier Artificial Intelligence Act, among other things related to ensuring the safety of certain artificial intelligence models, requires a large frontier developer to write, implement, and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer’s frontier models and describes how the large frontier developer approaches, among other things, incorporating national standards, international standards, and industry-consensus best practices into its frontier AI framework.</html:p>
<html:p>This bill would
require the agency to
establish
the California AI Standards and Safety Commission and would provide for its membership, as specified.</html:p>
<html:p>This bill would require the commission to take certain actions related to the safety of artificial intelligence, including maintaining formal
liaison relationships with state agencies deploying or procuring artificial intelligence, providing artificial intelligence technical expertise and artificial intelligence risk assessment, and designating one or more entities as independent verification organizations (IVOs), as specified.</html:p>
<html:p>This bill would require an IVO to take certain actions, including to implement the plan for artificial intelligence risk mitigation that it submitted to the commission when it applied for designation as an IVO and submit to the Legislature and to the commission an annual report that addresses, among other things, the adequacy of existing evaluation resources and mitigation measures to mitigate observed and potential risks.</html:p>
<html:p>This bill would authorize the
commission to establish a fee structure for charging fees to applicants and designated IVOs to offset the reasonable costs incurred by the commission in carrying out its duties pursuant to the bill and adopt regulations necessary to administer the bill.</html:p>
</ns0:DigestText>
<ns0:DigestKey>
<ns0:VoteRequired>MAJORITY</ns0:VoteRequired>
<ns0:Appropriation>NO</ns0:Appropriation>
<ns0:FiscalCommittee>YES</ns0:FiscalCommittee>
<ns0:LocalProgram>NO</ns0:LocalProgram>
</ns0:DigestKey>
<ns0:MeasureIndicators>
<ns0:ImmediateEffect>NO</ns0:ImmediateEffect>
<ns0:ImmediateEffectFlags>
<ns0:Urgency>NO</ns0:Urgency>
<ns0:TaxLevy>NO</ns0:TaxLevy>
<ns0:Election>NO</ns0:Election>
<ns0:UsualCurrentExpenses>NO</ns0:UsualCurrentExpenses>
<ns0:BudgetBill>NO</ns0:BudgetBill>
<ns0:Prop25TrailerBill>NO</ns0:Prop25TrailerBill>
</ns0:ImmediateEffectFlags>
</ns0:MeasureIndicators>
</ns0:Description>
<ns0:Bill id="bill">
<ns0:Preamble>The people of the State of California do enact as follows:</ns0:Preamble>
<ns0:BillSection id="id_07A3220D-125C-495B-84DD-2958EAE76AA4">
<ns0:Num>SECTION 1.</ns0:Num>
<ns0:ActionLine action="IS_ADDED" ns3:href="urn:caml:codes:GOV:caml#xpointer(%2Fcaml%3ALawDoc%2Fcaml%3ACode%2Fcaml%3ALawHeading%5B%40type%3D'TITLE'%20and%20caml%3ANum%3D'2.'%5D%2Fcaml%3ALawHeading%5B%40type%3D'DIVISION'%20and%20caml%3ANum%3D'1.'%5D%2Fcaml%3ALawHeading%5B%40type%3D'CHAPTER'%20and%20caml%3ANum%3D'14.'%5D)" ns3:label="fractionType: LAW_SPREAD||commencingWith: 8898" ns3:type="locator">
Chapter 14 (commencing with Section 8898) is added to Division 1 of Title 2 of the
<ns0:DocName>Government Code</ns0:DocName>
, to read:
</ns0:ActionLine>
<ns0:Fragment>
<ns0:LawHeading id="id_60650189-14A7-4741-B257-98DE799BD1C7" type="CHAPTER">
<ns0:Num>14.</ns0:Num>
<ns0:LawHeadingVersion id="id_AB30FC73-189E-43F8-A466-D8EAB2BF9B0E">
<ns0:LawHeadingText>California AI Standards and Safety Commission</ns0:LawHeadingText>
</ns0:LawHeadingVersion>
<ns0:LawSection id="id_DC196E0A-D2E8-401D-BDD0-22D98D5502AE">
<ns0:Num>8898.</ns0:Num>
<ns0:LawSectionVersion id="id_ADFB974C-34BF-4E50-B41A-DC8071C87E57">
<ns0:Content>
<html:p>As used in this chapter:</html:p>
<html:p>
(a)
<html:span class="EnSpace"/>
“Artificial intelligence application” means a software program or system that uses artificial intelligence models to perform tasks that typically require human intelligence.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
“Artificial intelligence model” means an engineered or machine-based system that varies in its level of autonomy and that
can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
“Commission” means the California AI Standards and Safety Commission established pursuant to Section 8898.1.
</html:p>
<html:p>
(d)
<html:span class="EnSpace"/>
“Deployer” means a person or entity that implements, integrates, or makes operational an artificial intelligence model or artificial intelligence application within the state, including a person or entity that makes an artificial intelligence model or artificial intelligence application available for use by others within the state, whether directly or as part of a product or service.
</html:p>
<html:p>
(e)
<html:span class="EnSpace"/>
“Developer” means a person who develops an artificial intelligence model or artificial intelligence application that is deployed in the state.
</html:p>
<html:p>
(f)
<html:span class="EnSpace"/>
“Independent verification organization (IVO)” means a private entity, nonprofit organization, academic consortium, or multistakeholder partnership designated as an IVO by the commission pursuant to this chapter.
</html:p>
<html:p>
(g)
<html:span class="EnSpace"/>
“Plan” means a plan submitted pursuant to Section 8898.2.
</html:p>
<html:p>
(h)
<html:span class="EnSpace"/>
“Security vendor” means a third-party entity engaged by an
IVO or developer to evaluate the safety and security of an artificial intelligence model or application through processes that include red teaming, risk detection, and risk mitigation.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_9AA041A9-51A2-4DCE-A299-E0E2D1E9BD82">
<ns0:Num>8898.1.</ns0:Num>
<ns0:LawSectionVersion id="id_BF2810C6-ECE5-4516-AD2D-BD4D1A9EAF20">
<ns0:Content>
<html:p>
(a)
<html:span class="EnSpace"/>
The Government Operations Agency shall establish the California AI Standards and Safety Commission.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
The commission shall consist of the following members:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The following members appointed by the Governor:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
An individual who the Governor determines has a comprehensive understanding of artificial intelligence models or applications that employ fewer than 100 employees.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
An individual who the Governor determines has a comprehensive understanding of frontier artificial intelligence models or artificial intelligence applications.
</html:p>
<html:p>
(C)
<html:span class="EnSpace"/>
An individual who the Governor determines represents the interests of civil society, including, but not limited to, nongovernmental organizations, public policy institutes, or consumer advocacy organizations.
</html:p>
<html:p>
(D)
<html:span class="EnSpace"/>
An individual who the Governor determines represents the legal and economic interests of workers in relation to artificial intelligence applications and artificial intelligence models.
</html:p>
<html:p>
(E)
<html:span class="EnSpace"/>
An individual who the Governor determines represents educational and research institutions.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The following ex officio members:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
The Attorney General or that person’s designee.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
The Director of Emergency Services or that
person’s designee.
</html:p>
<html:p>
(C)
<html:span class="EnSpace"/>
An individual appointed by the Governor who has expertise in technological or anthropological ethics.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
A member of the commission shall meet all of the following criteria:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The member shall have qualifications, experience, and skills in particular in the areas of artificial intelligence technology or policy required to perform the duties of the commission and exercise its powers, including both of the following:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
Evaluating whether an IVO applicant’s plan ensures acceptable mitigation of risk from any IVO-verified artificial intelligence model or artificial intelligence application.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
Determining standards for evaluating IVO applicants’ plans.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The member shall remain free from undue influence from the artificial intelligence industry.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
The member shall refrain from any action incompatible with the member’s duties or from engaging in any incompatible occupation, whether gainful or not, during the member’s term, including, but not limited to, employment by a developer or deployer of an artificial intelligence model or artificial intelligence application.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
The member shall not own or acquire an equity, directly or indirectly, except through a mutual fund or exchange-traded fund, in any company whose business consists in significant part of developing artificial intelligence models or artificial intelligence applications.
</html:p>
<html:p>
(d)
<html:span class="EnSpace"/>
A member of the commission shall have a right of access to all
information made available to the commission by an applicant for voluntary IVO designation under this chapter.
</html:p>
<html:p>
(e)
<html:span class="EnSpace"/>
A member of the commission shall not, for a period of one year after leaving the commission, accept employment from an entity designated as an IVO or seek voluntary IVO designation under this chapter.
</html:p>
<html:p>
(f)
<html:span class="EnSpace"/>
(1)
<html:span class="EnSpace"/>
(A)
<html:span class="EnSpace"/>
Subject to subparagraph (B), a member of the commission shall be appointed for a term of four years.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
A member of the commission may be removed by the authority that appointed the member for inefficiency, neglect of duty, or malfeasance in office.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
A member of the commission shall not serve more than two full terms.
</html:p>
<html:p>
(g)
<html:span class="EnSpace"/>
A member of the commission shall receive a per diem of one hundred dollars ($100) for each day actually spent in the discharge of official duties and shall be reimbursed for traveling and other expenses necessarily incurred in the performance of official duties.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_DF65BA1C-9B8A-484A-8C46-5F6A12CB3C04">
<ns0:Num>8898.2.</ns0:Num>
<ns0:LawSectionVersion id="id_B8F94740-3B86-40F5-B072-8DE482408C3F">
<ns0:Content>
<html:p>The commission shall do all of the following:</html:p>
<html:p>
(a)
<html:span class="EnSpace"/>
Analyze, review, and compare standards, best practices, testing methodologies, and certification frameworks developed by IVOs or other private and public entities and identify areas that need standards development.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
Provide written recommendations, guidance, and advice to the Governor, the Legislature, and state agencies and departments that procure, deploy, or regulate artificial intelligence informed by standards developed through an IVO, by academia, or by artificial intelligence deployers.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
Maintain formal liaison relationships with state agencies deploying or procuring
artificial intelligence to do all of the following:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
Provide artificial intelligence technical expertise and artificial intelligence risk assessment.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
Support agencies in understanding IVO standards and in making recommendations from agencies to IVO operators on how to improve their standards.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
Make recommendations for state procurement requirements for artificial intelligence that would protect public health and safety and promote responsible deployment of artificial intelligence by developers.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Make recommendations or provide comment to state agencies on artificial intelligence guidelines developed at state agencies, including recommendations on the appropriateness of standard setting at the state level to protect human health and
safety.
</html:p>
<html:p>
(d)
<html:span class="EnSpace"/>
Submit every two years to the Legislature, pursuant to Section 9795, a report that includes all of the following:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
Summaries of IVOs and their standards.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
Analyses of those standards.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
Identified gaps or emerging risks relevant to public sector decisionmaking.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Recommendations for legislation, state procurement standards, or regulation.
</html:p>
<html:p>
(5)
<html:span class="EnSpace"/>
An assessment of the state’s artificial intelligence risk landscape.
</html:p>
<html:p>
(e)
<html:span class="EnSpace"/>
Maintain a publicly accessible registry listing IVO organizations and any standards or updates they report to the
commission.
</html:p>
<html:p>
(f)
<html:span class="EnSpace"/>
Publish findings on the commission’s internet website and facilitate comment from researchers, civil society, industry, and government stakeholders.
</html:p>
<html:p>
(g)
<html:span class="EnSpace"/>
Designate IVOs pursuant to Section 8898.3.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_B363CEAB-A798-429E-BCE8-11CABE1ECBA7">
<ns0:Num>8898.3.</ns0:Num>
<ns0:LawSectionVersion id="id_99FB9BD3-DA7E-4F4F-BD7F-8D261E131B28">
<ns0:Content>
<html:p>
(a)
<html:span class="EnSpace"/>
The commission shall designate one or more IVOs pursuant to this chapter.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
The commission shall determine whether an applicant IVO’s plan ensures acceptable mitigation of risk from any IVO-verified artificial intelligence model and artificial intelligence application by considering all of the following:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The applicant’s personnel and the qualifications of those personnel.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The quality of the applicant’s plan with respect to ensuring that artificial intelligence model and artificial intelligence application developers and deployers exercise heightened care and comply with best practice-based
standards for the prevention of personal injury and reasonably foreseeable risk of harm and property damage, considering factors including, but not limited to, the following:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
The viability and rigor of the applicant’s evaluation methods, technologies, and administrative procedures.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
The adequacy of the applicant’s plan to develop measurable standards for evaluating artificial intelligence developers’ and deployers’ mitigation of risks in the development and deployment of an artificial intelligence model or artificial intelligence application.
</html:p>
<html:p>
(C)
<html:span class="EnSpace"/>
The adequacy of the applicant’s procedures for ongoing supervision of artificial intelligence models or artificial intelligence applications following certification, including, but not limited to, all of the following:
</html:p>
<html:p>
(i)
<html:span class="EnSpace"/>
Monitoring for identification of risks resulting from fine-tuning or modifying an artificial intelligence model or artificial intelligence application after certification.
</html:p>
<html:p>
(ii)
<html:span class="EnSpace"/>
Evaluation of adherence to existing mitigation measures.
</html:p>
<html:p>
(iii)
<html:span class="EnSpace"/>
The prescription and oversight of corrective action if the mitigation measures implemented by a verified artificial intelligence model or artificial intelligence application are determined to fail to address identified risks.
</html:p>
<html:p>
(iv)
<html:span class="EnSpace"/>
Procedures for revoking certification of an artificial intelligence model or artificial intelligence application if the developer or deployer fails to undertake mandated corrective action within a timely manner.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
The
applicant’s independence from the artificial intelligence industry.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Whether the applicant serves a particular existing or potential artificial intelligence industry segment.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
A designation as an IVO by the commission pursuant to this section shall expire after three years, and the IVO may apply for a new designation.
</html:p>
<html:p>
(d)
<html:span class="EnSpace"/>
The commission may revoke a designation if any of the following is true:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The IVO’s plan is materially misleading or inaccurate.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The IVO systematically fails to adhere to its plan.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
A material change compromises the IVO’s independence from the artificial intelligence industry.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Evolution of technology renders the IVO’s methods obsolete for ensuring acceptable levels of risk of personal injury, reasonable risk of foreseeable harm, and property damage.
</html:p>
<html:p>
(5)
<html:span class="EnSpace"/>
An artificial intelligence model or artificial intelligence application verified by the IVO causes a material harm of the type the IVO is designated by the state to verify.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_3D37BBD4-E47C-4131-8C5F-F3FBFBCDDB1D">
<ns0:Num>8898.4.</ns0:Num>
<ns0:LawSectionVersion id="id_B6A301AC-DD2D-4E36-963F-E24741F22D0F">
<ns0:Content>
<html:p>
(a)
<html:span class="EnSpace"/>
An applicant to the commission for designation as an IVO shall submit with its application a plan that contains all of the following elements:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The applicant’s approach to auditing of artificial intelligence models and artificial intelligence applications to verify that an artificial intelligence developer or deployer has exercised heightened care and adhered to predeployment and postdeployment best practices and procedures to prevent personal injury, reasonably foreseeable harm, or property damage caused by the artificial intelligence model or artificial intelligence application.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The applicant’s approach to mitigating risks specific to the expertise of the
verifying IVO.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
An approach to ensuring disclosure by developers and deployers to the IVO of risks detected, material changes to risk profiles, including risks detected before verification and risks resulting from fine-tuning or modifying an artificial intelligence model or artificial intelligence application after verification, incident reports, and risk mitigation efforts for a particular artificial intelligence model or artificial intelligence application.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
All of the following with respect to any risk the applicant intends to verify that artificial intelligence models or artificial intelligence applications implement mitigation measures sufficient to achieve acceptable levels of risk:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
A proposed definition of acceptable levels of risk.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
Metrics that are measurable and can be used to determine whether the acceptable level of risk defined by the IVO produces beneficial outcomes.
</html:p>
<html:p>
(C)
<html:span class="EnSpace"/>
Target levels for the metrics, including data sources those levels are based on and methods for measurement.
</html:p>
<html:p>
(D)
<html:span class="EnSpace"/>
A description of the evaluation and reporting protocol to determine whether verified models of applications meet the outcome metrics on an ongoing basis.
</html:p>
<html:p>
(5)
<html:span class="EnSpace"/>
An approach to specifying the scope and duration of certification of an artificial intelligence model or artificial intelligence application, including technical thresholds for updates requiring renewed certification.
</html:p>
<html:p>
(6)
<html:span class="EnSpace"/>
An approach to data collection for public reporting from audited developers, deployers, and vendors that
addresses all of the following:
</html:p>
<html:p>
(A)
<html:span class="EnSpace"/>
Aggregating and tracking evaluation data from certified labs.
</html:p>
<html:p>
(B)
<html:span class="EnSpace"/>
Categories of metadata to be aggregated and tracked.
</html:p>
<html:p>
(C)
<html:span class="EnSpace"/>
Measures to protect trade secrets and mitigate antitrust risk from information sharing.
</html:p>
<html:p>
(7)
<html:span class="EnSpace"/>
The applicant’s intended use, if any, of security vendors to evaluate artificial intelligence developers, deployers, models, or applications, including a method of certifying and training vendors to accurately evaluate an artificial intelligence model, developer, or deployer exercising heightened care and complying with best practices.
</html:p>
<html:p>
(8)
<html:span class="EnSpace"/>
Implementation and enforcement of whistleblower protections among certified developers and deployers.
</html:p>
<html:p>
(9)
<html:span class="EnSpace"/>
Remediation of postcertification noncompliance.
</html:p>
<html:p>
(10)
<html:span class="EnSpace"/>
An approach to reporting of societal risks and benefits identified through auditing.
</html:p>
<html:p>
(11)
<html:span class="EnSpace"/>
An approach to communicating effectively with federal authorities and authorities from other states.
</html:p>
<html:p>
(12)
<html:span class="EnSpace"/>
The sources the applicant is relying on in developing standards against which to assess adherence to best practices and procedures.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
A plan submitted pursuant to this section may be tailored to a particular artificial intelligence market segment.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
The commission shall not modify a plan submitted pursuant to this section.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_8BB995E3-5364-40E6-A3AA-63F50214E6FE">
<ns0:Num>8898.5.</ns0:Num>
<ns0:LawSectionVersion id="id_8CFF1DE1-A3C8-40F9-A450-AE1D108C5C66">
<ns0:Content>
<html:p>An IVO designated pursuant to this chapter shall do all of the following:</html:p>
<html:p>
(a)
<html:span class="EnSpace"/>
Ensure developers’, deployers’, and security vendors’ exercise of heightened
care and compliance with best practices for the prevention of personal injury and property damage and certify qualified artificial intelligence models or artificial intelligence applications that meet the requirements prescribed by the IVO.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
Implement the plan submitted pursuant to Section 8898.2.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
Decertify an artificial intelligence model or artificial intelligence application that does not meet the requirements prescribed by the IVO.
</html:p>
<html:p>
(d)
<html:span class="EnSpace"/>
Submit to the Legislature, pursuant to Section 9795, and to the
commission an annual report that addresses all of the
following:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
Aggregated information on capabilities of artificial intelligence models, the observed societal risks and benefits associated with those capabilities, and the potential societal risks and benefits associated with those capabilities.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The adequacy of existing evaluation resources and mitigation measures to mitigate observed and potential risks.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
Developer, deployer, and security vendor certifications.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Aggregated results of certification
assessments.
</html:p>
<html:p>
(5)
<html:span class="EnSpace"/>
Remedial measures prescribed by the IVO and whether the developer, deployer, or security vendor complied with those measures.
</html:p>
<html:p>
(6)
<html:span class="EnSpace"/>
Identified additional risks outside personal injury or property damage and the adequacy of existing mitigation measures to address those risks.
</html:p>
<html:p>
(e)
<html:span class="EnSpace"/>
An
IVO shall annually audit all of the following to ensure independence from the artificial intelligence industry and report the findings of its audit to the commission:
</html:p>
<html:p>
(1)
<html:span class="EnSpace"/>
The applicant’s board composition.
</html:p>
<html:p>
(2)
<html:span class="EnSpace"/>
The availability of resources to implement the applicant’s plan.
</html:p>
<html:p>
(3)
<html:span class="EnSpace"/>
The applicant’s funding sources.
</html:p>
<html:p>
(4)
<html:span class="EnSpace"/>
Representation of civil society representatives in evaluation and reporting functions.
</html:p>
<html:p>
(f)
<html:span class="EnSpace"/>
Retain for 10 years a document that is related to the
IVO’s activities under this chapter.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
<ns0:LawSection id="id_995D0000-966C-40FC-8ECB-80CCDFDE83E9">
<ns0:Num>8898.6.</ns0:Num>
<ns0:LawSectionVersion id="id_61044654-024B-468E-9D32-35BB4DB15619">
<ns0:Content>
<html:p>The commission may adopt regulations necessary to administer this chapter, including regarding all of the following:</html:p>
<html:p>
(a)
<html:span class="EnSpace"/>
Minimum requirements for plans required to be submitted pursuant to Section 8898.4.
</html:p>
<html:p>
(b)
<html:span class="EnSpace"/>
Conflict of interest rules for IVOs that include, but are not limited to, reporting requirements on boards of directors and donors funding the IVO to ensure adequate independence from the artificial intelligence industry and transparency on revenues streaming from certification services.
</html:p>
<html:p>
(c)
<html:span class="EnSpace"/>
A reasonable structure for fees charged to applicants and designated IVOs to offset the reasonable costs incurred by the commission in
carrying out its duties under this chapter.
</html:p>
</ns0:Content>
</ns0:LawSectionVersion>
</ns0:LawSection>
</ns0:LawHeading>
</ns0:Fragment>
</ns0:BillSection>
</ns0:Bill>
</ns0:MeasureDoc>