Difference between revisions of "Deepfake Detectors"
(→Deepfakes in Democratic Processes) |
(→Advantages of deepfakes) |
||
Line 4: | Line 4: | ||
== Advantages of deepfakes == | == Advantages of deepfakes == | ||
− | Although deep fakes are known for having harmful and negative impacts, researcher [https://users.ece.cmu.edu/~dbrumley/| David Brumley] has justified several beneficial attributes of deepfakes. He discovered that they can be used in language learning programs to generate sample sentences to help users learn different languages. <ref> Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60. </ref> It is believed that they could be used in advertising to construct narratives and produce certain positive agenda without using real people. <ref> Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60. </ref> Even though the advertisement would be fake it would be perceived as real and be effective to its viewers. | + | [[File:star wars deep fake.png|300px|thumbnail|right|https://www.cnet.com/news/incredible-new-deepfake-recasts-luke-skywalker-in-star-wars/ Star Wars character Luke Skywalker played by Mark Hamill without deppfake and Sebastian Stan with a deepfake.]] Although deep fakes are known for having harmful and negative impacts, researcher [https://users.ece.cmu.edu/~dbrumley/| David Brumley] has justified several beneficial attributes of deepfakes. He discovered that they can be used in language learning programs to generate sample sentences to help users learn different languages. <ref> Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60. </ref> It is believed that they could be used in advertising to construct narratives and produce certain positive agenda without using real people. <ref> Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60. </ref> Even though the advertisement would be fake it would be perceived as real and be effective to its viewers. |
Deepfakes have been creating exciting artistic and innovative advantages in the video game, robotics, and virtual reality industries, but it has also been really helpful to the movie indsutry. Deepfake technology has helped the moive editors keep certain actors in their character roles for a cohesive storyline when they are not available. <ref>Howard, Karen. “Deconstructing Deepfakes-How Do They Work and What Are the Risks?” WatchBlog: Official Blog of the U.S. Government Accountability Office, WordPress, 13 Oct. 2020, blog.gao.gov/2020/10/20/deconstructing-deepfakes-how-do-they-work-and-what-are-the-risks/. </ref> Deepfakes have been used in blockbuster film series like Star Wars and Fast and Furious, and it’s effects are being more creatively applied everyday in this industry. | Deepfakes have been creating exciting artistic and innovative advantages in the video game, robotics, and virtual reality industries, but it has also been really helpful to the movie indsutry. Deepfake technology has helped the moive editors keep certain actors in their character roles for a cohesive storyline when they are not available. <ref>Howard, Karen. “Deconstructing Deepfakes-How Do They Work and What Are the Risks?” WatchBlog: Official Blog of the U.S. Government Accountability Office, WordPress, 13 Oct. 2020, blog.gao.gov/2020/10/20/deconstructing-deepfakes-how-do-they-work-and-what-are-the-risks/. </ref> Deepfakes have been used in blockbuster film series like Star Wars and Fast and Furious, and it’s effects are being more creatively applied everyday in this industry. |
Revision as of 13:23, 9 April 2021
A deepfake is a false piece of media that has been altered or generated by deep learning algorithms.[1] Deepfake technology has existed since the late 1990's and has been used with varying intentions in a plethora of disciplines and contexts.[1] These include, but are not limited to, film, audio, pornography, and politics.[1] For about twenty years after the inception of deepfake technology, it was almost exclusively used in academic contexts to learn about artificial intelligence and machine learning.[1]
After the coining of the term "deepfake" in 2017[2], deepfake media became highly popularized and found itself a regular part of mainstream media.[1] With so much attention, many began to worry about the applications of deepfake technology and looked for ways to prevent malicious uses.[3] Many ask for technology to detect these deepfakes, but technology for detecting deepfakes has been slow to catch up with the rapidly increasing production of deepfake media.[3]
Contents
Advantages of deepfakes
![](/images/thumb/2/2e/Star_wars_deep_fake.png/300px-Star_wars_deep_fake.png)
Deepfakes have been creating exciting artistic and innovative advantages in the video game, robotics, and virtual reality industries, but it has also been really helpful to the movie indsutry. Deepfake technology has helped the moive editors keep certain actors in their character roles for a cohesive storyline when they are not available. [6] Deepfakes have been used in blockbuster film series like Star Wars and Fast and Furious, and it’s effects are being more creatively applied everyday in this industry.
The Rising Threat of Deepfakes
![](/images/thumb/0/03/Deepfake-1.png/375px-Deepfake-1.png)
How do they work?
Before the threats of deepfakes are unpacked, it is important to briefly go over how they work. Deepfake videos commonly manipulate facial expressions and or swap faces. During facial manipulation, the expressions are imitated from the filmed footage into the previously existing footage, but in face swapping the face is simply transformed and morphed onto another body from previously existing footage. [7] The technology mobilizes machine learning techniques and then gives the computer real data about the image or video so it can create the fake version of it. [8] The algorithms that feed image data into a computer use spatial and material information to learn how to map facial movements from on person or image to another. [9]
Rising Threats
Deepfakes started becoming easier to create for more people. While it is unclear the original reason deepfakes were invented, one of its first uses was in overdubbing video to lip-sync with a speaker.[1] People began making fake pornography of celebrities and notable personalities.[needs citation(s)] Politicians were made to make politically incorrect comments, and they began to worry about their campaigns and credibility.[needs citation(s)] In response to these worries, many companies, such as Facebook and Twitter, banned and made an effort to remove deepfakes from their platforms.[10] Deepfakes are still relatively uncommon[needs citation], but as they become more abundant, deepfake detection will become increasingly important.
As deepfakes become more prevalent, there is worry that the deepfake detectors won't help the people who need protection the most.[needs citation] LGBTQ+ individuals are at a larger risk for hate crimes from deepfakes.[needs citation] Scientists say that the most worrisome risk is not that large celebrities will be targeted or elections swayed, but rather that private citizens will be targeted and won't have the funds or resources to clear their name.[11] By imitating a CEO asking employees to send money, corporate scams also pose a threat.[12] Identity theft using deepfake technology can be used to commit financial fraud and other crimes.[13]
Deepfakes in Democratic Processes
For instance, deepfakes are used to deter voters from voting by means of a threat to release deepfaked pornographic images. Even if it was unclear how many people had been deterred, once voters become aware of the tactic, trust in the integrity of election results may be eroded[16]. Another scenario is when a deepfake is used to instill mistrust by falsely suggesting that a candidate cheated in a public debate, thereby calling into question the legitimacy of the political process. Overall, reputational harm and misattribution distort how voters perceive and understand candidates and, even if an individual viewer is aware of the manipulations, he or she may believe that others are not, which could further degrade their trust in the ability of others to make well-informed voting decisions[17]. With new uncertainties injected into the question of whether voters think their peers are well-informed, trust in democratic processes is undermined.
Deepfake Detectors
As deepfakes started becoming more prominent and more people started to be able to make them, it became increasingly important to figure out a way to detect a deepfake video or image. It quickly became a race between tech companies to make the first accurate deepfake detector. Facebook, Microsoft, and Google were quick to jump into research. Researchers from the USC Information Sciences Institute developed a new tool that focuses on subtle face and head movements to detect a deepfake video with 96% accuracy. [18] Microsoft starting using a video authenticator technology that finds things like greyscale pixels at the boundaries of where the deepfaked face was pasted onto the original face. Microsoft ran a lot of data (including some from a Facebook face-swap database) to create the video authenticator. [19]Some technologies use what researchers call a soft biometric signature [20], which is basically the mannerisms and speech patterns of a certain person, to show that a video is not actually that person. It is really hard to mimic the mannerisms and facial expressions of a person digitally so using the soft biometric signature is very accurate right now with a detection rate of about 92%.[21] Deepfake detection is still fairly new and as deepfakes rise in popularity the need for accurate deepfake detectors will rise as well.
Shortcomings in Deepfake Detection
While there has been tremendous advancement in detecting deepfake media, this detection technology remains far behind the technology used to create the deepfakes.[22] Recognizing this, some companies that produce deepfake technology have issued ethics statements in order to be more transparent about the potential for misuse of their technology.[22] In one of these ethics statements, deepfake technology company Descript admits that "the quality of generative media could increase at a rate that outpaces technology designed to detect it."[22] This would present a deficit for deepfake detection technology. Along those lines, Descript admits that despite all the research underway to help detect deepfake media, it remains unclear how this issue will be resolved.[22]
In order to minimize the dissemination and impact of deepfake media on society and individuals, consumers are urged to be critical of every piece of media they consume and to verify any information they find with other reliable sources before sharing with others.[3][22]
References
- ↑ 1.0 1.1 1.2 1.3 1.4 1.5 Arnold. (2020, November 25). Deepfake History: When Was Deepfake Technology Invented?. Deepfake Now. Retrieved April 1, 2021.
- ↑ Somers, M. (2020, July 21). "Deepfakes, explained". MIT Sloan School of Management. Retrieved April 2, 2021.
- ↑ 3.0 3.1 3.2 Matt. (2020, December). "Detect DeepFakes: How to counteract misinformation created by AI". MIT Media Lab. Retrieved April 2, 2021.
- ↑ Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60.
- ↑ Johnson, A., & Grumbling, E. (2019). In Implications of artificial intelligence for cybersecurity: proceedings of a workshop (pp. 54–60). essay, the National Academies Press. https://www.nap.edu/read/25488/chapter/7#60.
- ↑ Howard, Karen. “Deconstructing Deepfakes-How Do They Work and What Are the Risks?” WatchBlog: Official Blog of the U.S. Government Accountability Office, WordPress, 13 Oct. 2020, blog.gao.gov/2020/10/20/deconstructing-deepfakes-how-do-they-work-and-what-are-the-risks/.
- ↑ Howard, Karen. “Deconstructing Deepfakes-How Do They Work and What Are the Risks?” WatchBlog: Official Blog of the U.S. Government Accountability Office, WordPress, 13 Oct. 2020, blog.gao.gov/2020/10/20/deconstructing-deepfakes-how-do-they-work-and-what-are-the-risks/.
- ↑ NBCNews, director. Deep Fakes: How They're Made And How They Can Be Detected | Mach | NBC News. YouTube, YouTube, 26 Oct. 2018, www.youtube.com/watch?v=C8FO0P2a3dA.
- ↑ NBCNews, director. Deep Fakes: How They're Made And How They Can Be Detected | Mach | NBC News. YouTube, YouTube, 26 Oct. 2018, www.youtube.com/watch?v=C8FO0P2a3dA.
- ↑ Banerjee, P. (2020, February 5). "After Facebook, Twitter moves to ban deepfakes on its platform". mint. Retrieved April 2, 2021.
- ↑ Angela Chen (2019) Three Threats Posed by Deepfakes that Technology won't Solve, MIT Technology Review
- ↑ Damiani, J. (2019, September 3). "A Voice Deepfake Was Used To Scam A CEO Out Of $243,000". Forbes. Retrieved April 2, 2021.
- ↑ Alison Grace Johansen (2020), Deepfakes: What they are and why they’re threatening, NortonLifeLock
- ↑ Hasen RL (2019) Deep Fakes, Bots, and Siloed Justices: American Election Law in a Post-Truth World. St. Louis University Law Review.
- ↑ Marshall WP (2004) False Campaign Speech and the First Amendment. U. Pennsylvania Law Review 153.
- ↑ Daniels GR (2009) Voter Deception. Indiana Law Review 43.
- ↑ Chesney R and Citron DK (2019) Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security. California Law Review 107.
- ↑ Shruti Agarwal and Hany Farid (2019) Protecting World Leaders Against Deep Fakes, The Computer Vision Foundation
- ↑ Leo Kelion(2020) Deepfake Detector Tool unveiled by Microsoft
- ↑ Will Knight (2019), A New Deepfake Detection Tool, MIT Technology Review
- ↑ Manke, K. (2019, June 20). "New technology helps media detect 'deepfakes'". University of California. Retrieved April 2, 2021.
- ↑ 22.0 22.1 22.2 22.3 22.4 Descript. (2021). "Descript Ethics Statement". Descript. Retrieved April 2, 2021.