Difference between revisions of "Deepfake"

From SI410
Jump to: navigation, search
Line 17: Line 17:
 
=== Pornographic Uses ===
 
=== Pornographic Uses ===
 
A large majority of the deepfakes that are currently on the internet are those of pornographic nature. As of September 2019, of the 15,000 deepfake videos on the internet, 96% were pornographic and 99% of those mapped faces of celebrities onto porn stars.<ref name="cite1">Sample, I. (2020, January 13). What are deepfakes – and how can you spot them? Retrieved from https://www.theguardian.com/technology/2020/jan/13/what-are-deepfakes-and-how-can-you-spot-them</ref> With the development of applications such as FakeApp, Faceswap, and DeepFaceLab, which grant anyone the ability to create convincing deepfakes, people have unfortunately began to create fake porn videos of people they know in real life, for example friends, casual acquaintances, exes, and classmates, without their permission. Obviously this a massive ethical issue, as these fake yet seemingly authentic videos can have a drastic effect on the lives of those who are portrayed in them. Especially for normal, everyday people, these types of videos can ruin their reputation, stature in the community, and ultimately their lives.
 
A large majority of the deepfakes that are currently on the internet are those of pornographic nature. As of September 2019, of the 15,000 deepfake videos on the internet, 96% were pornographic and 99% of those mapped faces of celebrities onto porn stars.<ref name="cite1">Sample, I. (2020, January 13). What are deepfakes – and how can you spot them? Retrieved from https://www.theguardian.com/technology/2020/jan/13/what-are-deepfakes-and-how-can-you-spot-them</ref> With the development of applications such as FakeApp, Faceswap, and DeepFaceLab, which grant anyone the ability to create convincing deepfakes, people have unfortunately began to create fake porn videos of people they know in real life, for example friends, casual acquaintances, exes, and classmates, without their permission. Obviously this a massive ethical issue, as these fake yet seemingly authentic videos can have a drastic effect on the lives of those who are portrayed in them. Especially for normal, everyday people, these types of videos can ruin their reputation, stature in the community, and ultimately their lives.
 +
 +
[[File:Bill-hader-deepfakes.jpg|thumbnail|Bill Hader depicted as (from left to right): Arnold Schwarzenegger, Tom Cruise, and Al Pacino]]
  
 
=== Fraudulent Uses ===
 
=== Fraudulent Uses ===

Revision as of 19:23, 13 March 2020

What a deepfake can look like

Deepfakes are artificially produced media which use a form of artificial intelligence called deep learning to make images or audio of fake events. While the action of faking media content has been seen in the past through agents such as photoshop, the machine learning techniques used by deepfakes make them particularly deceiving. The use of deepfakes to create deceptive fake news, pornographic content, and financial fraud has led to responses to make them more easily detectable and to limit their use. Although deepfakes are most widely known for these adverse applications, they can also be used in more positive ways, such as film dubbing and in educational applications.

Development

Overview

The development of deepfake technology began with the progress within the fields of machine learning and computer vision. Computer vision enables computers to see, identify and process images in the same way that human vision does, and then provide appropriate output. Machine learning provides systems the ability to automatically learn and improve from experience without being explicitly programmed. The computer vision aspect of deepfakes allow the computer to detect a human face and then reanimate it to appear as somebody else. The machine learning aspect then helps the computer learn from its own mistakes, which means that it will create ever more convincing deepfakes going forward. As the technology has developed, these two aspects have combined to create the deepfakes that we have now, which can be extremely convincing and sometimes impossible to tell whether they are real or fake.

Key People and Programs

The first software to fully use facial reanimation was the Video Rewrite program, which was published in 1997. The program used machine learning techniques to make connections between the sounds produced by a video's subject and the shape of the subject's face.[1] This was a groundbreaking advancement at the time, as no program up to that point had been able to successfully implement facial reanimation in this way.

Although this technology was first established in 1997, the term deepfake wasn't coined until 2017. The term arose from a Reddit user name "deepfakes", who was well known on the site for creating and sharing many of these edited videos. While he made many humorous videos, such as editing the face of Nicolas Cage onto other actors and actresses, he also created a significant amount of videos were the faces of celebrities were swapped onto the actresses in pornographic videos.[2]

Since 2017, multiple different applications have been created and shared to the general public. These applications, such as FakeApp, Faceswap, and DeepFaceLab allow anyone to create Deepfakes of whoever they choose. This can be done because these apps simply take in a gallery of photos that the user provides and use these images to create a deepfake. This means that the user does not need to have any experience in computer development or computer vision in order to create these deepfakes, they simply need to provide enough photos to the application. This simplicity and ease of use means an increase in the number of deepfakes that are created, which further the impacts of deepfakes, both positive and negative.

Ethical Issues

Pornographic Uses

A large majority of the deepfakes that are currently on the internet are those of pornographic nature. As of September 2019, of the 15,000 deepfake videos on the internet, 96% were pornographic and 99% of those mapped faces of celebrities onto porn stars.[3] With the development of applications such as FakeApp, Faceswap, and DeepFaceLab, which grant anyone the ability to create convincing deepfakes, people have unfortunately began to create fake porn videos of people they know in real life, for example friends, casual acquaintances, exes, and classmates, without their permission. Obviously this a massive ethical issue, as these fake yet seemingly authentic videos can have a drastic effect on the lives of those who are portrayed in them. Especially for normal, everyday people, these types of videos can ruin their reputation, stature in the community, and ultimately their lives.

Bill Hader depicted as (from left to right): Arnold Schwarzenegger, Tom Cruise, and Al Pacino

Fraudulent Uses

Financial fraud schemes have been carried out through the use of audio deepfakes, which allow scammers to mimic the voices of trusted individuals. In March of 2019, the chief of a UK subsidiary of a German energy firm paid nearly £200,000 into a Hungarian bank account after being phoned by a fraudster who mimicked the German CEO’s voice[3] In another case, cybersecurity firm Symantec says it has come across at least three cases of deepfake voice fraud used to trick companies into sending money to a fraudulent account, one of which resulted in millions of dollars in loses. [4] Without better audio deepfake detection, this will likely be an ethical problem that continues into the future.

Fake News

Deepfakes are also commonplace in the creation of fake news. In June of 2019, a deepfake video was posted which falsely portrays Zuckerberg as saying, "Imagine this for a second: One man, with total control of billions of people's stolen data, all their secrets, their lives, their futures."[5] The video resulted in widespread questioning of the control that Facebook has over their data, despite the fact that the video was false. Videos like this are just the tip of the iceberg, and in the future they will result in much more drastic results. For example, a fake video depicting an Israeli official saying or doing something inflammatory could undermine American efforts to build bridges between the Jewish state and its members or a well-timed forgery could completely tip an election.[6]

Positive Uses

For others to complete

Efforts to Detect Deepfakes

For others to complete

References

  1. Bregler, Christoph; Covell, Michele; Slaney, Malcolm (1997). "Video Rewrite: Driving Visual Speech with Audio". Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. 24: 353–360
  2. Cole, S. (2018, January 24). We Are Truly Fucked: Everyone Is Making AI-Generated Fake Porn Now. Retrieved from https://www.vice.com/en_us/article/bjye8a/reddit-fake-porn-app-daisy-ridley
  3. 3.0 3.1 Sample, I. (2020, January 13). What are deepfakes – and how can you spot them? Retrieved from https://www.theguardian.com/technology/2020/jan/13/what-are-deepfakes-and-how-can-you-spot-them
  4. Statt, N. (2019, September 5). Thieves are now using AI deepfakes to trick companies into sending them money. Retrieved from https://www.theverge.com/2019/9/5/20851248/deepfakes-ai-fake-audio-phone-calls-thieves-trick-companies-stealing-money
  5. Metz, R., & O'Sullivan, D. (2019, June 12). A deepfake video of Mark Zuckerberg presents a new challenge for Facebook. Retrieved from https://www.cnn.com/2019/06/11/tech/zuckerberg-deepfake/index.html
  6. Galston, W. A. (2020, January 10). Is seeing still believing? The deepfake challenge to truth in politics. Retrieved from https://www.brookings.edu/research/is-seeing-still-believing-the-deepfake-challenge-to-truth-in-politics/