CHAPTER
7. Defending Democracy from Deepfake Deception Act of 2024
20510.
This chapter shall be known and may be cited as the Defending Democracy from Deepfake Deception Act of 2024.20511.
The Legislature finds and declares all of the following:(a) California is entering its first-ever generative artificial intelligence (AI) election, in which disinformation powered by generative AI will pollute our information ecosystems like never before. Voters will not know what images, audio, or video they can trust.
(b) In a few clicks, using current technology, bad actors now have the power to create a false image of a candidate accepting a bribe or a fake video of an elections official “caught on tape” saying that voting machines are not secure, or to generate the Governor’s voice telling millions of Californians their
voting site has changed.
(c) In the lead-up to the 2024 presidential elections, candidates and parties are already creating and distributing deepfake images and audio and video content. These fake images or files can spread to millions of Californians in seconds and skew election results or undermine trust in the ballot counting process.
(d) The labeling information required by this bill is narrowly tailored to provide consumers with factual information about the inauthenticity of particular images, audio, video, or text content in order to prevent consumer deception.
(e) In order to ensure California elections are free and fair, California must, for a limited time before and after elections, prevent the use of
deepfakes and disinformation meant to prevent voters from voting and to deceive voters based on fraudulent content. Accordingly, the provisions of this chapter are narrowly tailored to support California's compelling interest in protecting its free and fair elections.
20512.
For purposes of this chapter, the following terms have the following meanings:(a) “Advertisement” means any general or public communication that is authorized or paid for with the purpose of supporting or opposing a candidate for elective office.
(b)“Artificial intelligence” means an engineered or machine-based
system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.
(b) “Deepfake” means audio or visual media that is digitally created or modified such that it would falsely appear to a reasonable person to be an authentic record of the actual speech or conduct of the individual depicted in the media.
(c) “Election communication” means a general or public communication that is not an “advertisement” and that concerns any of the following:
(1) A candidate for elective office.
(2) Voting or refraining from voting in an election.
(3) The canvass of the vote.
(4) Voting machines, ballots, voting sites, or other property or equipment related to an election.
(5) Proceedings or processes of redistricting or the electoral college.
(d) (1) “Elections official” means any of the following persons, but only in their capacity as a person charged with holding or conducting an election, conducting a canvass, assisting with the holding or conducting of an election or a canvas, or performing another duty related to administering the provisions of this code:
(A) An elections official as defined in Section 320.
(B) The Secretary of State and their staff.
(C) A temporary worker, poll worker, or member of a precinct board.
(D) Any other person charged with holding or conducting an election, conducting a canvass, assisting with the holding or conducting of an election or a canvas, or performing another duty related to administering the provisions of this code.
(2) The requirements of this chapter relating to content portraying an elections official apply only if the large online platform knows or should know that the person is an elections official.
(e)(1)“Materially deceptive and digitally modified or created content” means an image or an audio or video recording or other digital content, including a chatbot, that has been intentionally manipulated such that all of the following conditions are met:
(A)(i)The digital content is the product of digital manipulation, including, but not limited to, artificial intelligence, such that it so closely resembles authentic content that a reasonable person would not be able to readily distinguish the digitally manipulated or created content from the authentic content.
(ii)For purposes of this subdivision, “false portrayal” means the content would cause a reasonable person to have a fundamentally different understanding or impression of the content than the person would have if they were hearing or seeing
an authentic version of the content.
(B)The person or entity who attempted to post or send, or who did post or send, the content did so knowing the portrayal was false, or did so with reckless disregard for whether the portrayal was false. If the content is intentionally manipulated and contains a false portrayal as specified in subparagraph (A), there shall be a rebuttable presumption that the person or entity knew the portrayal was false or that they acted with reckless disregard for whether the portrayal was false.
(e) (1) “Materially deceptive content” means
audio or visual media that is digitally created or modified, and that includes, but is not limited to, deepfakes and chatbots, such that it would falsely appear to a reasonable person to be an authentic record of the content depicted in the media.
(2) “Materially deceptive and digitally modified or created content” does not include any image or audio or video recording visual media that contains only minor modifications that do not lead to significant changes to
significantly change the perceived contents or meaning of the content. Minor changes include changes to the brightness or contrast of images, removal of background noise in audio, and other minor changes that do not impact the content of the image or audio or video recording. visual media.
(f) “Large online platform” means a public-facing internet website, web application, or digital application, including a social network, video sharing platform, advertising network, or search engine that had at least 1,000,000 California users during the preceding 12 months.
20513.
(a) Any large online platform, using state-of-the-art, best available tools to detect digitally modified or created materially deceptive content, shall develop and implement procedures for blocking and preventing, and shall, if the large online platform knows or should know that the digitally modified or created materially deceptive content meets the requirements of this section, block and
prevent, the posting or sending of any materially deceptive and digitally modified or created content, during the applicable time period or periods set forth in subdivision (c), of any of the following: content, if all of the following conditions are met:(1) The content is posted or sent during the applicable time period or periods set forth in subdivision (c).
(2) The materially deceptive content is any of the following:
(1)
(A) A candidate for elective office portrayed as doing or saying something that the candidate did not do or say.
say and that is reasonably likely to harm the reputation or electoral prospects of a candidate.
(2)
(B) An elections official portrayed as doing or saying something in connection with the performance of their elections-related duties that the elections official did not do or say.
say and that is reasonably likely to falsely undermine confidence in the outcome of one or more election contests.
(3)
(C) An elected official portrayed as doing or saying something that influences the election that the elected official did not do or say.
say and that is reasonably likely to falsely undermine confidence in the outcome of one or more election contests.
(4)A voting machine, ballot, voting site, or other property or equipment related to an election that is portrayed in a materially false way.
(3) The person or entity who created the materially deceptive content did so knowing it was false or with reckless disregard for the truth. There shall be a rebuttable presumption that the person or entity knew the materially deceptive content was false or acted with reckless disregard for the truth if the content
would cause a reasonable person to have a fundamentally different understanding or impression of the content than the person would have if hearing or seeing an authentic version of the content.
(b) (1) Notwithstanding paragraph (1) of subdivision (a), a large online platform shall not prevent a candidate for elective office, during the time period set forth in subdivision (c), from portraying themself as doing or saying something that the candidate did not do or say, but only if the digital content includes a disclosure stating the following: “This _____ has been manipulated.” The blank in this disclosure shall be filled in with whichever of the following terms most accurately describes the media:
(A) Image.
(B) Audio.
(C) Video.
(2) (A) For visual media, the text of the disclosure shall appear in a size that is easily readable by the average viewer and no smaller than the largest font size of other text appearing in the visual media. If the visual media does not include any other text, the disclosure shall appear in a size that is easily readable by the average viewer. For visual media that is video, the disclosure shall appear for the duration of the video.
(B) If the media consists of audio only, the disclosure shall be read in a clearly spoken manner and in a pitch that can be easily heard by the average listener, at the beginning of the audio, at the end of the audio, and, if the audio
is greater than two minutes in length, interspersed within the audio at intervals of not greater than two minutes each.
(c) (1) Except as provided in paragraph (2), any large online platform shall block and prevent the content described in subdivision (a), and any candidate for elective office shall include the disclosure required by subdivision (b), during a period beginning 120 days before the election and through the day of the election.
(2) If the content described in subdivision (a) depicts or pertains to elections officials, or depicts or pertains to a voting machine, ballot, voting site, or other property or equipment related to an election, a
any
large online platform shall block and prevent the content during a period beginning 120 days before the election and ending on the 60th day after the election.
20514.
(a) (1) This section applies to any Any large online platform, using state-of-the-art, best available tools to detect materially deceptive and digitally modified or created content that satisfies either of the following requirements:
content shall develop and implement procedures for labeling such content as inauthentic, fake, or false if all of the following conditions are met:(A) The materially deceptive content is either of the following:
(A)The content is included within
(i) Included within paragraphs (1) to (4), inclusive, of subdivision (a) of Section 20513, but the content
is posted or sent outside the applicable time period described in subdivision (c) of Section 20513.
(B)The content is, or appears within,
(ii) Appears within an advertisement or election communication that and is not subject to Section 20513.
(2)With respect to any content described in paragraph (1), a large online platform, using state-of-the-art, best available tools to detect digitally modified or created content, shall develop and implement procedures for labeling such content as inauthentic, fake, or false, and shall, if the large online platform knows or should know that the digitally modified or created content meets the requirements of this section, label such content in this manner, during the applicable time period or periods set forth in subdivision (c).
(B) The person or entity who created the materially deceptive content did so knowing it was false or with reckless disregard for the truth. There shall be a rebuttable presumption that the person or entity knew the materially deceptive content was false or acted with reckless disregard for the truth if the content would cause a reasonable person to have a fundamentally different understanding or impression of the content than the person would have if hearing or seeing an authentic version of the content.
(C) The large online platform knows or should know that the materially deceptive content meets the requirements of this section.
(b) The label required by subdivision (a) shall
permit users to click or tap on it and to inspect all available provenance data about the digitally modified or created materially deceptive content in an easy-to-understand format.
(c) The labeling requirement set forth in subdivision (a) applies during any of the following time periods, to the extent applicable:
(1) The period beginning one year before the election and through the day of the election.
(2) The period beginning one year before the
election and ending on the 60th day after the election, if the content depicts or pertains to elections officials, the electoral college process, a voting machine, ballot, voting site, or other property or equipment related to an election, or the canvass of the vote.
(3) During a governmental process related to redistricting that is required or authorized by state or local law.
20515.
(a) A large online platform shall provide an easily accessible way for California residents to report to that platform content subject to Section 20513 or 20514 that was not blocked or labeled as required. The online platform shall respond to the person who made the report, within 36 hours of the report, describing any action taken or not taken by the online platform with respect to the content.(b) A candidate for elective office, elected official, or elections official who has made a report to a large online platform under subdivision (a) and who either has not received a response within 36 hours or disagrees with the response, may seek injunctive or other
equitable relief against the online platform to compel compliance with this chapter. The plaintiff shall bear the burden of establishing the violation through clear and convincing evidence. The court shall award a prevailing plaintiff reasonable attorney’s fees and costs. An action under this subdivision shall be entitled to precedence in accordance with Section 35 of the Code of Civil Procedure.
20516.
The Attorney General or any district attorney or city attorney may seek injunctive or other equitable relief against any large online platform to compel compliance with this chapter. The plaintiff shall bear the burden of establishing the violation through clear and convincing evidence. The court shall award a prevailing plaintiff reasonable attorney’s fees and costs. An action under this section shall be entitled to precedence in accordance with Section 35 of the Code of Civil Procedure.20517.
This chapter applies to materially deceptive and digitally modified or created content, regardless of the language used in the content. If the language used is not English, the disclosure required by subdivision (b) of Section 20513 and the label required by Section 20514 must appear in the language used as well as in English.20518.
A large online platform that blocks or labels any materially deceptive and digitally modified or created content shall maintain a copy of the digital content for a period of not less than five years from the election and shall make such digital content available to the Secretary of State, the Fair Political Practices Commission, and researchers, if requested.20519.
(a) This chapter does not preclude a large online platform from blocking or labeling any materially deceptive and digitally modified or created content outside of the time periods specified in Sections 20513 and 20514.(b) This chapter does not preclude any online platform not subject to this chapter from blocking or labeling any materially deceptive and digitally modified or created content.
20520.
This chapter does not apply to either of the following:(a) A regularly published online newspaper, magazine, or other periodical of general circulation that routinely carries news and commentary of general interest, and that publishes any materially deceptive and digitally altered or digitally created image, audio, or video recording content that an online platform is required to block or label based on this chapter, if the publication contains a clear disclosure that the materially deceptive and digitally altered or digitally created image or audio or video recording
content does not accurately represent any actual event, occurrence, appearance, speech, or expressive conduct.
(b) Materially deceptive and digitally altered or digitally created content that constitutes satire or parody.
20521.
The provisions of this chapter are severable. If any provision of this chapter or its application is held invalid, that invalidity shall not affect other provisions or applications that can be given effect without the invalid provision or application.