The video, posted to Facebook-owned Instagram over the weekend, falsely portrays Zuckerberg as saying, “Imagine this for a second: One man, with total control of billions of people’s stolen data, all their secrets, their lives, their futures.”
The video was made by taking 2017 footage of Zuckerberg and using artificial intelligence technology, known as deepfake technology, to manipulate Zuckerberg’s face to make it appear he said something he didn’t. Zuckerberg’s voice is replaced by an actor’s.
Asked whether a doctored video of Zuckerberg would get the same treatment as the manipulated Pelosi video, Neil Potts, Facebook’s director of public policy, told a parliamentary hearing in Canada last month, “If it was the same video, inserting Mr. Zuckerberg for Speaker Pelosi, it would get the same treatment.”
The Pelosi video was not a deepfake like the new Zuckerberg clip, but was manipulated using traditional video editing techniques. CNN Business has asked Facebook if it has any specific rules for deepfakes.
The video had less than 5,000 views before first being reported by news media, but how Facebook treats it could set a precedent for its handling of future deepfake videos.
Until recently, video hoaxes were relatively rare since they are harder to pull off than fakes of still images, but this is changing rapidly thanks to the rise of GANs, or generative adversarial networks. GANs can use data to produce new things. The technique is also used for making deepfakes.
In this case, Ben-Ami said, Canny AI chose a scene of less than a minute in length of Zuckerberg speaking, and used a computer to meld it with an actor’s voice and appropriate facial movements. It took about a day to make an initial version of the video with one of the artists’ voices standing in for a voice actor’s Zuckerberg impression and facial movements, he said. It took another two to three hours to make the final version.
CNN Business reached out to the artists behind Spectre but did not immediately receive a response.
Ben-Ami, whose company focuses on dubbing speech in videos from one language to another, is concerned about the video and others Canny AI made spreading without the context that they were created as art. But he said he also wants to raise questions about the creation of such media.
“People need to know it’s possible to do it,” he said.
An Instagram spokesperson told CNN Business that the site will treat the video “the same way we treat all misinformation on Instagram.” If it’s marked as false by third-party fact checkers, the spokesperson said, the site’s algorithms won’t recommend people view it.