Lecture 05 — Faces that never existed

Deepfakes, voice cloning, and two real fraud cases that changed how the field takes the threat

22 March 2027

In early 2024, a finance employee at Arup — the British engineering firm behind buildings like the Sydney Opera House — joined a video call at the firm’s Hong Kong office with several senior colleagues, including the CFO, and was instructed to transfer roughly USD 25 million. Every person on that call except the employee was a synthetic reconstruction; Arup later confirmed the incident to CNN. Later that year, a deepfake video impersonating a well-known entrepreneur was used to promote a cryptocurrency scheme that persuaded an elderly retiree to invest his life savings. Neither case needed a research-grade model — commodity tools were enough, which is the actual headline.

This lecture covers how synthetic video and cloned audio are made well enough to survive a live call, what a forensic review of a recording can and can’t recover after the fact, and why “just look closely” stopped being useful advice for anyone outside a research lab.

Outline#

• the two cases, and what made each of them work
• synthesis versus reenactment: different techniques, different tells
• what a post-hoc forensic review can check, and what it can’t

Further reading#

CNN’s original report on the Arup case has the Hong Kong police briefing in full, including the detail this lecture leans on hardest: the employee’s own account of realising, mid-call, that “everyone was fake.”