PrivaSearch

Rules

Deepfakes and the law: what the AI Act and GDPR do about them

What a deepfake is, which rules apply now, which prohibition is coming and how organisations tackle fraud using a fabricated voice or video.

In brief

  • A deepfake is AI-generated or manipulated image, audio or video content resembling an existing person or event and falsely appearing authentic.
  • Since 2 August 2026, anyone creating and distributing a deepfake professionally must disclose that the material is artificial.
  • On 2 December 2026, a prohibition takes effect on AI systems creating sexual imagery of recognisable people without consent.
  • A recognisable face in a deepfake is personal data: outside a personal circle the GDPR applies, and the depicted person may request erasure.
  • Against fraud using a fabricated voice, no law helps as much as a fixed rule: call back on a known number before transferring money.

What is a deepfake, and is creating one prohibited?

A deepfake is image, audio or video content created or manipulated with AI that falsely appears authentic. Creating one is not automatically prohibited. It depends on the content, who makes it and what happens to it. A sexual deepfake without consent is a criminal offence. Other deepfakes are subject to rules on transparency, personal data and portraits.

That is the position on 13 October 2026. Four kinds of rules overlap: the EU AI Act, GDPR, portrait rights and criminal law. This article is an explanation, not legal advice.

What is a deepfake according to the law?

The AI Act definition

The AI Act provides a definition in Article 3. A deepfake is AI-generated or manipulated image, audio or video content resembling existing persons, objects, places, organisations or events that would falsely appear authentic or truthful to someone. Three points stand out.

How the supervisory authority explains it

On its deepfakes page, the Autoriteit Persoonsgegevens (AP), the Dutch data protection authority, describes a deepfake as a video or audio fragment manipulated by an algorithm, making it appear someone said or did something that never happened. Improved lighting or a clearly drawn character is excluded: the boundary is whether someone takes it for real.

What does the AI Act say about deepfakes?

The AI Act does not prohibit deepfakes generally. It opts for transparency, with one prohibition added in December 2026.

The disclosure duty

Article 50 has applied since 2 August 2026. Paragraph 4 says deployers of an AI system generating or manipulating a deepfake must disclose that the material was artificially generated or manipulated. The information must be clear and given no later than first exposure to the material.

On 10 June 2026, the European Commission published a code of practice on marking and labelling AI-generated content. Its second part covers labelling deepfakes, with icons usable as labels. Participation is voluntary; the Article 50 duty is not.

Marking by the provider

Paragraph 2 targets developers of generative AI systems. They mark output in a machine-readable form as artificially generated or manipulated insofar as technically feasible. Systems already on the market before 2 August 2026 have until 2 December 2026. What such marking does and does not solve is in our article about the AI detector.

The new prohibition from 2 December 2026

The digital omnibus on AI extended Article 5's list of prohibited practices. The adopted text contains two new points.

The text limits the prohibition. Offering a system is prohibited only if such creation is its intended purpose or a reasonably foreseeable outcome against which the system lacks adequate safeguards. Use is prohibited only if the user employs it for that purpose. Under amended Article 113, these points apply from 2 December 2026. See the AI Act in autumn 2026.

The fines

Article 99 provides fines up to €35 million or 7% of worldwide annual turnover for breaching Article 5 prohibitions, and up to €15 million or 3% for breaching Article 50 transparency duties. The implementing legislation determines who imposes fines in the Netherlands. As far as we could establish, this had not yet become law on 13 October 2026.

What does the GDPR have to do with a deepfake?

A face and voice are personal data

The GDPR defines personal data as all information about an identified or identifiable person, including identification through physical identity characteristics. This is in Article 4 GDPR. The AP says that if your face or body is recognisable in a deepfake, its creator processes your personal data. For a voice identifiable as one person's, the same follows from the definition.

A photograph or recording is not thereby special category data. Recital 51 GDPR says photographs count as biometric data only if processed with particular technical means to identify someone uniquely. When that is the case is explained in our article on special category data.

When the GDPR applies

What you can do as the depicted person

The AP gives four steps. Ask the creator to delete the deepfake; the AP says they are usually obliged to because a deepfake can be regarded as inaccurate personal data. If you do not know the creator, ask the platform. If refused, you may complain to the AP. If you suffer damage, you can go to court. The same rules apply to well-known people, but a court balances their interests against the creator's, including satire.

What do portrait rights and criminal law regulate?

Portrait rights

Portrait rights are in Articles 19 to 21 of the Dutch Copyright Act. For a portrait not commissioned by its subject, Article 21 says publication is not permitted insofar as that person's reasonable interest opposes it. The AP notes portrait rights can play a part in deepfakes. The statutory text refers to a portrait. We could not establish from the law whether this also covers a fabricated voice; ask a lawyer.

A private member's bill giving everyone their own right over deepfakes of their voice and appearance, the Act on neighbouring rights in deepfakes of persons, was consulted on from 30 October to 31 December 2025. On 13 October 2026, we found no source showing it had been submitted to the Dutch House of Representatives. It is not law in force.

Criminal law

The Dutch Criminal Code has no article using the word deepfake. Existing articles may apply.

The public prosecution service and courts assess whether a specific case is criminal. Victims should report it to police.

How does deepfake fraud work in businesses?

CEO fraud with a fabricated voice

In CEO fraud, a finance employee receives an instruction apparently from the director: transfer a large amount quickly. The Fraudehelpdesk lists recurring features: emphasis on authority, confidentiality and time pressure. It says smaller businesses, foundations and associations are affected too.

The deepfake makes the instruction more credible. In 2019, the Fraudehelpdesk saw the first reports using an imitated director's voice in a spoken message. This appears in its overview of fraud over the past decade.

What the police say

In a November 2023 interview at the National Cyber Security Centre, a police specialist describes a failed attempt at a Dutch bank: an employee was asked in a video call by the supposed chief executive to transfer money and called the real chief executive back. She says detection tools lag behind developments and behaviour solves this: calling back or asking a verification question must be normal.

We did not find figures on the scale of deepfake fraud in the Netherlands in a primary source.

What should your organisation do against deepfakes?

Seven rules

  1. Document a payment procedure. A new or changed account and an urgent payment never proceed on one message, phone call or video call alone.
  2. Call back on a known number. Not the number in the message, but one you already had.
  3. Require two authorisations. A second person approves payments above a threshold.
  4. Normalise doubt. An employee asking a director for confirmation is doing their job well.
  5. Train on the request, not the image. Time pressure, secrecy and an unusual route are better signals than a faltering mouth in a video.
  6. Agree where to report it. Internally to one contact point, to the bank once money has been transferred, and to police.
  7. Remember the GDPR. If deception caused personal data such as a staff list to be disclosed, it may be a data breach. See What is a data breach?.

If you create a deepfake yourself

An organisation can also be the creator: an instructional video with a digital colleague or a voiceover using a cloned voice. You then need a lawful basis to use face and voice, document purpose and duration, and disclose that the material is artificial. Consent is a difficult lawful basis in employment because employees do not always feel free to say no. Include synthetic voice and image use in your AI policy.

Situations compared

The table is an aid. The statutory text and circumstances determine what applies.

What PrivaSearch does here

PrivaSearch does not detect deepfakes or prevent fraud. It works with documents, not images or audio you want to authenticate.

It does address the underlying point: data about people should not enter an AI service unchecked. PrivaSearch sits between your documents and the AI model. Personal data is detected and replaced with pseudonyms, and a colleague approves the result before a document becomes searchable. The steps are on How PrivaSearch works. What happens when such documents go straight into a chat window is on the page about AI chatbots and the GDPR.

Employees also complete short AI literacy training, repeated periodically. Without valid training, the workspace does not open. It does not replace fraud training for your finance department.

Two limits apply. Detection is never complete, so human review is mandatory. And pseudonymised data remains personal data for your organisation. How the measures relate to the rules is on the page about GDPR and the AI Act. To see how it works, book a demo.

Frequently asked questions

Is creating a deepfake a criminal offence?

Not always. The Dutch Criminal Code does not mention the word deepfake. Creating a sexual image of someone without consent is an offence, and using a deepfake to obtain someone's money may be fraud. Outside your personal circle, the GDPR and portrait rights also apply. The public prosecution service and courts assess whether a specific case is criminal.

What does the AI Act say about deepfakes?

The AI Act does not generally prohibit deepfakes. Since 2 August 2026, anyone professionally creating or manipulating a deepfake must disclose that the material is artificial. Generative AI providers must mark output in machine-readable form. On 2 December 2026, an additional prohibition takes effect on AI systems creating sexual imagery of recognisable people without consent and systems creating child sexual abuse material.

Must you disclose that a video is a deepfake?

Yes, if your organisation or a professional creates and distributes it. This follows from Article 50 AI Act. Disclosure must be clear and given no later than first exposure to the material. For clearly artistic, satirical or fictional work, a limited disclosure suffices.

What can you do if a deepfake of you is circulating?

Ask the creator to delete it. According to the Autoriteit Persoonsgegevens, the creator is usually obliged to do so. If you do not know who created it, ask the platform hosting it. If refused, you may complain to the Autoriteit Persoonsgegevens. A sexual deepfake may be reported to police.

How do you recognise a deepfake of your director?

Do not rely on your eyes and ears or a detection tool. Focus on the request: urgency, secrecy, an unknown account and a route differing from normal procedure. Call back on a number you already had and have a second person approve payment.

Is a voice personal data?

A voice identifiable as one person's is information about an identifiable person and therefore falls within the GDPR's personal data definition. An organisation recording, cloning or using someone's voice needs a lawful basis and must inform them. A recording is not automatically special category data. It becomes that only through technical processing to identify someone uniquely.

Read more

  1. The AI Act in autumn 2026: what applies now and what has been postponed?

    The AI Act timeline after the digital omnibus: what applies already, what has moved to 2027 and 2028, and what AI chatbot users need to arrange now.

  2. The Algorithm Register and IAMA: what public bodies must record about their AI

    What the Dutch Algorithm Register and IAMA are, what is mandatory and what is not, and what a municipality arranges when staff use AI chatbots.

  3. DPIA for AI tools: when is it mandatory and how do you approach it?

    When you must conduct a DPIA for an AI chatbot or AI search feature, what it needs to contain and how to approach the assessment in seven steps.

See in twenty minutes what happens to your documents.

We show it with fictitious client files from your sector: upload, detection, review, search and the connection with your AI assistant. Afterwards you'll know exactly what your team can use safely.

Book a demo →