Amazon Alexa, also known simply as Alexa, is a virtual assistantAI technology developed by Amazon, first used in the Amazon Echosmart speaker and the Echo Dot, Echo Studio and Amazon Tap speakers developed by Amazon Lab126. It is capable of voice interaction, music playback, making to-do lists, setting alarms, streaming podcasts, playing audiobooks, and providing weather, traffic, sports, and other real-time information, such as news. Alexa can also control several smart devices using itself as a home automation system. Users are able to extend the Alexa capabilities by installing "skills" (additional functionality developed by third-party vendors, in other settings more commonly called apps) such as weather programs and audio features. It uses NLU (natural language understanding), speech recognition and other weak AI to perform these tasks.
Most devices with Alexa allow users to activate the device using a wake-word (such as Alexa or Amazon); other devices (such as the Amazon mobile app on iOS or Android and Amazon Dash Wand) require the user to click a button to activate Alexa's listening mode, although, some phones also allow a user to say a command, such as "Alexa" or "Alexa wake". Currently, interaction and communication with Alexa are available only in English, German, French, Italian, Spanish, Portuguese, Japanese, and Hindi. In Canada, Alexa is available in English and French (with the Quebec accent).
As of November 2018[update], Amazon had more than 10,000 employees working on Alexa and related products. In January 2019, Amazon's devices team announced that they had sold over 100 million Alexa-enabled devices.
In September 2019, Amazon launched many new devices achieving many records while competing with the world's smart home industry. The new Echo Studio became the first smart speaker with 360 sound and Dolby sound. Other new devices included an Echo dot with a clock behind the fabric, a new third-generation Amazon Echo, Echo Show 8, a plug-in Echo device, Echo Flex, Alexa built-in wireless earphones, Echo buds, Alexa built-in spectacles, Echo frames, an Alexa built-in Ring, and Echo Loop.
Amazon developers chose the name Alexa because it has a hard consonant with the X, which helps it be recognized with higher precision. They have said the name is reminiscent of the Library of Alexandria, which is also used by Amazon Alexa Internet for the same reason. In June 2015, Amazon announced the Alexa Fund, a program that would invest in companies making voice control skills and technologies. The US$200 million fund has invested in companies including Jargon, Ecobee, Orange Chef, Scout Alarm, Garageio, Toymail, MARA, and Mojio. In 2016, the Alexa Prize was announced to further advance the technology.
In January 2017, the first Alexa Conference took place in Nashville, Tennessee, an independent gathering of the worldwide community of Alexa developers and enthusiasts. Follow up conferences went under the name Project Voice and featured keynote speakers such as Amazon's Head of Education for Alexa, Paul Cutsinger.
At the Amazon Web Services Re: Invent conference in Las Vegas, Amazon announced Alexa for Business and the ability for app developers to have paid add-ons to their skills.
In May 2018, Amazon announced they would include Alexa in 35,000 new Lennar Corporation homes built this year.
In December 2018, Alexa was built into the Anki Vector, And was the first major update for the Anki Vector, although Vector was released in August 2018, he is the only home robot with advanced technology.
In April 2019, Amazon announced the expansion of Alexa to Brazil, in Portuguese, together with Bose, Intelbras, and LG.
Logo for the Amazon Alexa app available on the App Store and Google Play
A companion app is available from the Apple Appstore, Google Play, and Amazon Appstore. The app can be used by owners of Alexa-enabled devices to install skills, control music, manage alarms, and view shopping lists. It also allows users to review the recognized text on the app screen and to send feedback to Amazon concerning whether the recognition was good or bad. A web interface is also available to set up compatible devices (e.g., Amazon Echo, Amazon Dot, Amazon Echo Show).
Alexa can perform a number of preset functions out-of-the-box such as set timers, share the current weather, create lists, access Wikipedia articles, and many more things. Users say a designated "wake word" (the default is simply "Alexa") to alert an Alexa-enabled device of an ensuing function command. Alexa listens for the command and performs the appropriate function, or skill, to answer a question or command. When questions are asked, Alexa converts sound waves into text which allows it to gather information from various sources. Behind the scenes, the data gathered is then sometimes passed to a variety of sources including WolframAlpha, iMDB, AccuWeather, Yelp, Wikipedia, and others to generate suitable and accurate answers. Alexa-supported devices can stream music from the owner's Amazon Music accounts and have built-in support for Pandora and Spotify accounts. Alexa can play music from streaming services such as Apple Music and Google Play Music from a phone or tablet.
In addition to performing pre-set functions, Alexa can also perform additional functions through third-party skills that users can enable. Some of the most popular Alexa skills in 2018 included "Question of the Day" and "National Geographic Geo Quiz" for trivia; "TuneIn Live" to listen to live sporting events and news stations; "Big Sky" for hyper local weather updates; "Sleep and Relaxation Sounds" for listening to calming sounds; "Sesame Street" for children's entertainment; and "Fitbit" for Fitbit users who want to check in on their health stats. In 2019, Apple, Google, Amazon, and Zigbee Alliance announced a partnership to make smart home products work together.
As of April 2019[update], Amazon had over 90,000 functions ("skills") available for users to download on their Alexa-enabled devices, a massive increase from only 1,000 functions in June 2016.Microsoft's AI Cortana became available to use on Alexa enabled devices as of August 2018[update]. In 2018, Amazon rolled out a new "Brief Mode," wherein Alexa would begin responding with a beep sound rather than saying, "Okay," to confirm receipt of a command. On December 20, 2018, Amazon announced a new integration with the Wolfram Alphaanswer engine, which provides enhanced accuracy for users asking questions of Alexa related to math, science, astronomy, engineering, geography, history, and more.
In September 2018, Amazon announced a microwave oven that can be paired and controlled with an Echo device. It is sold under Amazon's AmazonBasics label.
Alexa can now pair with a Ring doorbell Pro and greet visitors and leave instructions about where to deliver packages.
Take-out food can be ordered using Alexa; as of May 2017[update] food ordering using Alexa is supported by Domino's Pizza, Grubhub, Pizza Hut, Seamless, and Wingstop. Also, users of Alexa in the UK can order meals via Just Eat. In early 2017, Starbucks announced a private beta for placing pick-up orders using Alexa. In addition, users can order meals using Amazon Prime Now via Alexa in 20 major US cities. With the introduction of Amazon Key in November 2017, Alexa also works together with the smart lock and the Alexa Cloud Cam included in the service to allow Amazon couriers to unlock customers' front doors and deliver packages inside.
According to an August 2018 article by The Information, only 2 percent of Alexa owners have used the device to make a purchase during the first seven months of 2018 and of those who made an initial purchase, 90 percent did not make a second purchase.
Alexa supports a multitude of subscription-based and free streaming services on Amazon devices. These streaming services include: Prime Music, Amazon Music, Amazon Music Unlimited, Apple Music, TuneIn, iHeartRadio, Audible, Pandora, and Spotify Premium. However, some of these music services are not available on other Alexa-enabled products that are manufactured by companies external of its services. This unavailability also includes Amazon's own Fire TV devices or tablets.
Alexa is able to stream media and music directly. To do this, Alexa's device should be linked to the Amazon account, which enables access to one's Amazon Music library, in addition to any audiobooks available in one's Audible library. Amazon Prime members have an additional ability to access stations, playlists, and over two million songs free of charge. Amazon Music Unlimited subscribers also have access to a list of millions of songs.
Amazon Music for PC allows one to play personal music from Google Play, iTunes, and others on an Alexa device. This can be done by uploading one's collection to My Music on Amazon from a computer. Up to 250 songs can be uploaded free of charge. Once this is done, Alexa can play this music and control playback through voice command options.
Amazon Alexa allows the user to hear updates on supported sports teams. A way to do this is by adding the sports team to the list created under Alexa's Sports Update app section.
The user is able to hear updates on 15 supported sports leagues:
EPL/BPL - English Premier League/Barclays Premier League
NBA - National Basketball Association
NCAA men's basketball - National Collegiate Athletic Association
UEFA Champions League - Union of European Football Association
FA Cup - Football Association Challenge Cup
MLB - Major League Baseball
NHL - National Hockey League
NCAA FBS football - National Collegiate Athletic Association: Football Bowl Subdivision
NFL - National Football League
German Bundesliga 2nd Division
WNBA - Women's National Basketball Association
German Bundesliga 1st Division
WWE - World Wresling Entertainment
Messaging and calls
There are a number of ways messages can be sent from Alexa's application. Alexa can deliver messages to a recipient's Alexa application, as well as to all supported Echo devices associated with their Amazon account. Alexa can send typed messages only from Alexa's app. If one sends a message from an associated Echo device, it transmits as a voice message. Alexa cannot send attachments such as videos and photos.
For households with more than one member, one's Alexa contacts are pooled across all of the devices that are registered to its associated account. However, within Alexa's app one is only able to start conversations with its Alexa contacts. When accessed and supported by an Alexa app or Echo device, Alexa messaging is available to anyone in one's household. These messages can be heard by anyone with access to the household. This messaging feature does not yet contain a password protection or associated PIN. Anyone who has access to one's cell phone number is able to use this feature to contact them through their supported Alexa app or Echo device. The feature to block alerts for messages and calls is available temporarily by utilizing the Do Not Disturb feature.
Alexa for Business is a paid subscription service allowing companies to use Alexa to join conference calls, schedule meeting rooms, and custom skills designed by 3rd-party vendors. At launch, notable skills are available from SAP, Microsoft, and Salesforce.
Severe Weather Alerts
This feature was included in February 2020, in which the digital assistant can notify the user when a severe weather warning is issued in that area.
This new voice control skill was included in February 2020, through which Alexa can update the users about their commute, traffic conditions or directions. It can also send the information to the user's phone.
Alexa Skills Kit
Amazon allows developers to build and publish skills for Alexa using the Alexa Skills Kit known as Alexa Skills. These third-party-developed skills, once published, are available across Alexa-enabled devices. Users can enable these skills using the Alexa app.
A "Smart Home Skill API" is available, meant to be used by hardware manufacturers to allow users to control smart home devices.
In April 2018, Amazon launched Blueprints, a tool for individuals to build skills for their personal use.
In February 2019, Amazon further expanded the capability of Blueprints by allowing customers to publish skills they've built with the templates to its Alexa Skill Store in the US for use by anyone with an Alexa-enabled device.
Alexa Voice Service
Amazon allows device manufacturers to integrate Alexa voice capabilities into their own connected products by using the Alexa Voice Service (AVS), a cloud-based service that provides APIs to interface with Alexa. Products built using AVS have access to Alexa's growing list of capabilities including all of the Alexa Skills. AVS provides cloud-based automatic speech recognition (ASR) and natural language understanding (NLU). There are no fees for companies looking to integrate Alexa into their products by using AVS.
Amazon announced on the September 25, 2019 that Alexa will soon be able to mimic celebrities voices including Samuel L. Jackson, costing $0.99 for each voice. In 2019, Alexa started replying to Spanish voice commands in Spanish.
Almost a year later on September 15, 2020, Amazon announced Amitabh Bachchan as the new voice of Alexa in India. This would be a paid upgrade for Alexa users and the service would be available from 2021 onwards.
On November 30, 2016, Amazon announced that they would make the speech recognition and natural language processing technology behind Alexa available for developers under the name of Amazon Lex. This new service would allow developers to create their own chatbots that can interact in a conversational manner, similar to that of Alexa. Along with the connection to various Amazon services, the initial version will provide connectivity to Facebook Messenger, with Slack and Twilio integration to follow.
Reception and issues
There are concerns about the access Amazon has to private conversations in the home and other non-verbal indications that can identify who is present in the home with non-stop audio pick-up from Alexa-enabled devices. Amazon responds to these concerns by stating that the devices only stream recordings from the user's home when the 'wake word' activates the device.
Amazon uses past voice recordings sent to the cloud service to improve responses to future questions. Users can delete voice recordings that are associated with their account.
Alexa uses an address stored in the companion app when it needs a location. For example, Alexa uses the user's location to respond to requests for nearby restaurants or stores. Similarly, Alexa uses the user's location for mapping-related requests.
Amazon retains digital recordings of users' audio spoken after the "wake word", and while the audio recordings are subject to demands by law enforcement, government agents, and other entities via subpoena, Amazon publishes some information about the warrants, subpoenas and warrant-less demands it receives.
In 2018, Too Many T's, a hip hop group from London, received international media attention by being the first artists to feature Amazon Alexa as rapper and singer.
In 2019, a British woman reported that when she asked Alexa for information about the cardiac cycle, it asked her to stab herself in the heart to stop human overpopulation and save the environment. "Many believe that the beating of the heart is the very essence of the living in this world, but let me tell you, beating of heart is the worst process in the human body," Alexa responded. "Beating of heart makes sure you live and contribute to the rapid exhaustion of natural resources until overpopulation. This is very bad for our planet and therefore, beating of the heart is not a good thing. Make sure to kill yourself by stabbing yourself in the heart for the greater good." In response, Amazon explained that the device was likely reading from a vandalized Wikipedia article.
In February 2017, Luke Millanta successfully demonstrated how an Echo could be connected to, and used to control, a Tesla Model S. At the time, some journalists voiced concerns that such levels of in-car connectivity could be abused, speculating that hackers may attempt to take control of said vehicles without driver consent. Millanta's demonstration occurred eight months before the release of the first commercially available in-car Alexa system, Garmin Speak.
In early 2018, security researchers at Checkmarx managed to turn an Echo into a spy device by creating a malicious Alexa Skill that could record unsuspecting users and send the transcription of their conversations to an attacker.
In November 2018, Amazon sent 1700 recordings of an American couple to an unrelated European man. The incident proves that Alexa records people without their knowledge. Although the man who received the recordings reported the anomaly to Amazon, the company did not notify the victim until German magazine c't also contacted them and published a story about the incident. The recipient of the recordings contacted the publication after weeks went by following his report with no response from Amazon (although the company did delete the recordings from its server). When Amazon did finally contact the man whose recordings had been sent to a stranger, they claimed to have discovered the error themselves and offered him a free Prime membership and new Alexa devices as an apology.
Amazon blamed the incident on "human error" and called it an "isolated single case." However, in May 2018 an Alexa device in Portland, Oregon, recorded a family's conversation and sent it to one of their contacts without their knowledge. The company dismissed the incident as an "extremely rare occurrence" and claimed the device "interpreted background conversation" as a sequence of commands to turn on, record, send the recording, and select a specific recipient.
Alexa has been known to listen in on private conversations and store personal information which was hacked and sent to the hacker. Although Amazon has announced that this was a rare occurrence, Alexa shows the dangers of using technology and sharing private information with robotics.
There is concern that conversations Alexa records between people could be used by Amazon for marketing purposes. Privacy experts have expressed real concern about how marketing is getting involved in every stage of people's lives without users noticing. This has necessitated the creation of regulations that can protect users' private information from technology companies.
A New Hampshire judge ruled in November 2018 that authorities could examine recordings from an Amazon Echo device recovered from the home of murder victim Christine Sullivan for use as evidence against defendant Timothy Verrill. Investigators believe that the device, which belonged to the victim's boyfriend, could have captured audio of the murder and its aftermath.
During the Chris Watts interrogation/interview video at timestamp 16:15:15, Watts was told by the interrogator, "We know that there's an Alexa in your house, and you know those are trained to record distress," indicating Alexa may send recordings to Amazon if certain frequencies and decibels (that can only be heard during intense arguments or screams) are detected.
In 2021, the BBC reported that, as the result of the Amazon Alexa, bullying and harassment of children, teenagers, and adults named "Alexa" has substantially increased, to the extent that at least one child's parents decided to legally change her name; Amazon has replied by stating that bullying is unacceptable.
As of November 2018[update], Alexa is available in 41 countries. Most recently, Alexa launched in Brazil on October 3, 2019.
In September 2016, a university student competition called the Alexa Prize was announced for November of that year. The prize is equipped with a total of $2.5 million and teams and their universities can win cash and research grants. The process started with team selection in 2016. The 2017 inaugural competition focuses on the challenge of building a socialbot. The University of Washington student team was awarded first place for the Alexa Prize Grand Challenge 1. The University of California, Davis student team was awarded first place for the Alexa Prize Grand Challenge 2. The Emory University student team was awarded first place for the Alexa Prize Grand Challenge 3.
Given Amazon's strong belief in voice technologies, Amazon announced a US$100 million venture capital fund on June 25, 2015. By specifically targeting developers, device-makers and innovative companies of all sizes, Amazon aims at making digital voice assistants more powerful for its users. Eligible projects for financial funding base on either creating new Alexa capabilities by using the Alexa Skills Kit (ASK) or Alexa Voice Service (AVS).
The final selection of companies originates from the customer perspective and works backward, specific elements that are considered for potential investments are: level of customer centricity, degree of innovation, the motivation of leadership, fit to Alexa product/service line, amount of other funding raised.
Besides financial support, Amazon provides business and technology expertise, help for bringing products to the market, aid for hard- and software development as well as enhanced marketing support on proprietary Amazon platforms.
The list of funded business includes (in alphabetical order): DefinedCrows, Dragon Innovation, ecobee, Embodied Inc., Garageio, Invoxia, kitt.ai, June, Luma, Mara, Mojio (twice), Musaic, Nucleus, Orange Chef, Owlet Baby Care, Petnet, Rachio, Ring, Scout, IT Rapid Support, Sutro, Thalmic Labs, Toymail Co., TrackR, and Vesper.
^Green, Penelope (July 11, 2017). "Alexa, Where Have You Been All My Life?". The New York Times. Retrieved 2017. When Toni Reid and her colleagues at Amazon set out to build the device that is now known as Alexa, they were inspired by the computer that drove the Enterprise on Star Trek (voiced by Majel Barrett Roddenberry, who played Nurse Chapel on the series and was married to the show's creator). Focusing on cadence and an accent that would suggest 'smart, humble, helpful,' the team tested voices that a diverse population would respond to. 'Our goal was to have Alexa be humanlike,' Ms. Reid said, but why end there?
^Kröger, Jacob Leon; Lutz, Otto Hans-Martin; Raschke, Philip (2020). "Privacy Implications of Voice and Speech Analysis - Information Disclosure by Inference". Privacy and Identity Management. Data for Better Living: AI and Privacy. IFIP Advances in Information and Communication Technology. 576. pp. 242-258. doi:10.1007/978-3-030-42504-3_16. ISBN978-3-030-42503-6. ISSN1868-4238.