Difference between revisions of "Virtual Assistants"

Revision as of 12:43, 18 April 2019

History of Voice Assistants by Voicebot.ai

Voice Assistants are artificial intelligence systems that perform human-like tasks for users, similar to a personal assistant ^[1] Some of the popular voice assistants include Apple's Siri, Amazon Alexa, Microsoft's Cortana, and Google Home. Many virtual assistants can carry out a number of tasks following a voice command, such as giving the weather, playing music, or controlling smart home devices.

History of Voice Assistant

The first Voice Assistant can be traced back to the 1960's, when IBM introduced the Shoebox, which demonstrated speech recognition and served as a voice activated calculator ^[2]. IBM continue to work on voice recognition tools, and in 2011 integrated intelligence with voice recognition to have their machine IBM Watson win Jeopardy. Following IBM Watson's win, voice recognition software turned to address the needs of the user when Apple and Google integrated smart assistants capable of natural language processing into everyday devices like the iPhone and Google Pixel. Shortly after, Amazon entered the voice assistant market by introducing Alexa and the Amazon Echo. Since voice assistants have entered the consumer market, the line of products and devices smart assistants like Alexa, Google, and Siri are available on has expanded.

Popular Voice Assistants

Amazon Alexa

Often known as Alexa, the Alexa Voice System is a virtual assistant created by Amazon. It works on many different Amazon devices, such as Amazon Echo, the Echo Dot, and Amazon Tap, among other Alexa smart home devices. Upon saying the wake word, which is "Alexa" by default, the user can give a command to which the assistant will carry out.

Some of the many tasks Amazon Alexa can do are answering questions, reading headlines from your favorite news outlets, set timers and alarms, control certain smart home devices, stream music, and relay weather or traffic information. ^[3] Alexa can also perform the task of placing orders on amazon.com via voice control. Ethical concerns arise from this because there is no "validation" step that usually exists before someone makes a purchase. There are, however, ways to disable the ordering function altogether on your Alexa, or to require conformation codes before placing an order.

Some of the tasks that the Alexa Voice System cannot preform are distinguishing between different voices, sending audio messages, and saying swear words. ^[4]

In addition to the built in functionality of Alexa, is the Smart Home Skill API which allows third-party developers to create apps called skills. Through Alexa Skills Kit, an assortment of tools for Alexa Skill Developers, individuals are able to create a variety of Alexa Skills. By February 2017 there were 10,000 skills created for Alexa. ^[5] A majority of these skills are related to games, news, and education, but many that have low, if any, ratings.^[5]

Apple's Siri

Smart Home Voice Assistants; pictured left to right: Google Home, Amazon Echo, Apple HomePod

Siri can be used on the iPhone, iPad, iPod touch, and some of the new versions of the MacBook. To use Siri and ask it a question, you can either hit the home button on your device or say "Hey Siri" followed by your question or command. ^[6] Apple's website boasts that "Siri does [things for you] even before you ask",^[7] which indicates many ethical implications of this technology. Entering the smart speaker market late, Apple introduced the HomePod in 2018 but focused on the quality of the sound rather than the functionality of Siri ^[8].

Google Home

Google Home is a device run from Google Assistant that can answer questions, follow commands, and control smart devices. Google can also distinguish voices and can therefore support multiple users for more personalization.^[9] Google Assistant is available on a variety of devices other than just the Google Home, such as the Google Pixel, Google Home Mini, Google Home Hub, Google Home Max, and other third party devices. In the Spring of 2018, Google unveiled improvements to their speech recognition and natural language processing in the form of Google Duplex, a smart AI assistant capable of communicating and completing tasks with other humans in a humanistic manner ^[10].

Third Party Partnerships

Part of what makes Google Home and Amazon's Alexa so appealing is it's compatibility with other devices other than their corporate owners. These partnerships, referred to as Third Party Partnerships, allow companies who do not have the resources or means to enter the smart home market to leverage the software for Google Assistant and Alexa and integrate it into their products. For example, a Google Home is compatible with smart home device Nest, which allows users to change the temperature of their house by speaking to their Nest product through their Google Home ^[11]. For companies that may not have a physical product to incorporate Google Assistant or Alexa with, by partnering with Alexa they are able to create "skills", which allows them to provide their users with alternative interactions other than just web based. For example, StubHub, created their own Alexa Skill which allows users to find tickets or verify dates for concerts through their Alexa smart device ^[12].

Performance

In a 2016 Brian X. Chen, a technology writer for The New York Times, put together a test of 16 tasks and compared Google, Siri, Cortana, and Alexa on how well the tasks were carried out. ^[13] Google scored the highest, followed by Siri, Cortana, and lastly, Alexa. Chen found that Alexa was the best at tasks related to music and Siri was best at calendar and email tasks. ^[13] Chen also found small differences amongst the four virtual assistants as Siri could read aloud email messages, compose emails, and create calendar events, while Google could not read email aloud and Alexa was unable to create calendar events or compose emails. ^[13]

Ethical Implications

Google Duplex Deceptive Misrepresentation

In the spring of 2018, Google introduced "Duplex", a technology featured aimed to help Google Assistant sound more human when interacting with users ^[14]. While this technology displayed a new innovative form of communication unlike what the world has seen so far, it also raised a bunch of questions surrounding ethics. Immediately following the demo of Google Duplex, critics were quick to point out that there was no indication from Google Duplex's end that they were a bot -- however, the conversational and realistic aspect of this phone call is what made this interaction so special. Whether or not Google was responsible for letting the person on the other end know that they were talking to a bot was something debated after the conference. Researcher Dr Thomas King calls question the ethics of Google Duplex by looking at the intent behind this new technology. While the ultimate goal of Google's Duplex is to create a better user experience, King questions whether or not you need to be deceitful and appear to be human for a "better" user experience. In Harry Frankfurt's article he addresses the amount of bullshit prevalent in our lives today, and notes that the success of lies is dependent on the actors ability to deceive us ^[15]. The main issue with Google's Duplex is the deceptive misrepresentation, which is what Frankfurt specifically points out to as a contribution to creating bullshit. Regardless of whether or not Google Duplex's intentions were to deceive, the way the technology is designed is in a way that is inherently deceptive as the application is meant to mimic humanlike conversations. In an age where information is easily manipulated and falsified the truth becomes increasingly more important, especially in the new frontier of human and AI interactions.

Designing Voice Assistants

As our technology advances, the computers we rely on become more dependent and autonomous. This autonomy they possess is steps away from them to become moral agents. However, in order for a computer to become autonomous, a designer must come in to design the behavior of this agent. As the creator dictating the behavior of artificial agents, the designer bears an enormous amount of responsibility of how artificial agents act morally ^[16]. The trouble with artificial autonomous agents that are capable of learning and adapting to their environment, is that designer's cannot predict every action and response of these agents to ensure that they are acting appropriately. Large companies like Amazon and Google who hold the majority of the Voice Assistant market have design documentation online to help designers navigate the ambiguity of predicting the actions of autonomous agents like Alexa and Google. By have default responses created to steering conversations away from sensitive topics like politics, religion, and sexual content, Amazon and Google help designers take a step in the right direction for designing ethical and morally responsible interactions between artificial agents and end users ^[17].

Privacy

With voice assistants, there have been multiple concerns regarding privacy. For technology like voice assistants which relies on listening to voice commands, critics have raised concerns on their smart devices listening in to their conversations. Floridi points out the pervasiveness of information flows as it slowly infiltrates our lives, and the privacy of our personal information risks being compromised ^[18]. Devices like voice assistants who have taken place in the homes of users and act as personal assistants, creep this line of intrusion and providing help. Regarding smart assistants, there has been speculations made over Alexa constantly listening in to personal conversations -- which leads to a bigger question of what is Amazon and Google doing with all of this data? In a report published by Bloomberg, Amazon has been advancing their algorithms through "supervised learning", which basically allows for humans to monitor and annotate the commands given by users to improve the natural language processing of Alexa ^[19]. However, Amazon is not the only company to use this technique to improve the functionality their voice assistants -- Google, Apple, and Facebook are also on the list of companies that listen-in to the interactions between the user and their smart devices ^[20]

References

1. ↑ Gray, Phil. "The Rise of Intelligent Virtual Assistants" (1 June 2016. 24 April 2017).
2. ↑ https://www.theverge.com/ad/17855294/a-brief-history-of-voice-assistants
3. ↑ Crist, Ry. "Amazon Alexa: Device compatibility, how-tos and much more"CNET (8 August 2016. Retrieved 24 April 2017).
4. ↑ Martin, Taylor. "9 things Alexa can't do yet" CNET (10 January 2017. Retrieved 24 April 2017).
5. ↑ ^{5.0 5.1} Crist, Ry. "Alexa just hit 10,000 skills, but does anyone care?"CNET(23 February 2017. Retrieved 24 April 2017).
6. ↑ [1](Retrieved 24 April 2017).
7. ↑ [[2]]
8. ↑ “HomePod: Apple's Smart Speaker, Now Available.” Apple, Mac, IPhone, IPad News and Rumors, 6 Apr. 2019, www.macrumors.com/roundup/homepod/.
9. ↑ [3](Retrieved 24 April 2017).
10. ↑ Leviathan, Yaniv, and Yossi Matias. “Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone.” Google AI Blog, 8 May 2018, ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html.
11. ↑ Nest. “Learn about Using the Google Assistant with Your Nest Products.” Nest, Nest Labs, Inc., nest.com/support/article/Learn-how-to-control-your-Nest-Learning-Thermostat-with-Google-Assistant-and-Google-Home.
12. ↑ Corey Badcock. “First Alexa Third-Party Skills Now Available for Amazon Echo.” Amazon, Amazon, 17 Aug. 2015, developer.amazon.com/blogs/post/TxC2VHKFEIZ9SG/First-Alexa-Third-Party-Skills-NowAvailable-for-Amazon-Echo.
13. ↑ ^{13.0 13.1 13.2} Chen, Brian."Siri, Alexa and Other Virtual Assistants Put to the Test" The New York Times (27 January 2016. Retrieved 24 April 2017).
14. ↑ Lomas, Natasha. “Duplex Shows Google Failing at Ethical and Creative AI Design.” TechCrunch, TechCrunch, 10 May 2018, techcrunch.com/2018/05/10/duplex-shows-google-failing-at-ethical-and-creative-ai-design/.
15. ↑ Kellman, Steven G. The Georgia Review, vol. 59, no. 2, 2005, pp. 431–433. JSTOR, www.jstor.org/stable/41402610.
16. ↑ Grodzinsky, Frances S., et al. “The Ethics of Designing Artificial Agents.” Ethics and Information Technology, vol. 10, no. 2-3, 2008, pp. 115–121., doi:10.1007/s10676-008-9163-9.
17. ↑ “Establish and Maintain Trust.” Amazon, Amazon, developer.amazon.com/docs/alexa-design/trustbusters.html.
18. ↑ Floridi, Luciano. The 4th Revolution How the Infosphere Is Reshaping Human Reality. Oxford University Press, 2014.
19. ↑ Day, Matt, et al. “Amazon Workers Are Listening to What You Tell Alexa.” Bloomberg.com, Bloomberg, 10 Apr. 2019, www.bloomberg.com/news/articles/2019-04-10/is-anyone-listening-to-you-on-alexa-a-global-team-reviews-audio.
20. ↑ Statt, Nick. “Amazon's Alexa Isn't Just AI - Thousands of Humans Are Listening.” The Verge, The Verge, 11 Apr. 2019, www.theverge.com/2019/4/10/18305378/amazon-alexa-ai-voice-assistant-annotation-listen-private-recordings.