top of page
Always_lisning.PNG

Investigating Users' Preferences and Expectations for Always-Listening Voice Assistants

Role: Lead Research Intern | Skills: Survey Design and Deployment, Quantitative Data Analysis, Qualitative Data Analysis  | Collaborators: Tomasz KosiÅ„ski, Alisa Frik, Nathan Malkin, Primal Wijesekera, Serge Egelman, Heather Richter Lipford 

Overview

Currently, voice assistants respond when explicitly invoked by a specific wake-word---such as ``Alexa,'' ``Siri,'' or ``Ok Google''---and serve common functions such as answering questions and controlling other connected devices. However, prominent players in the industry are trying to make voice assistants even more seamless. For instance, Google Home and Alexa offer a continued conversation feature (or ``follow-up mode'') to allow users to make follow-up requests after the first command without repeating the wake-word. Alexa also has a feature called Drop In, which allows whitelisted users to begin an audio or video call without the other party manually picking up the call, effectively allowing remote parties to listen at any time. Looking forward, Amazon and Google have patented the ability of voice assistants to automatically extract keywords from ambient speech and use that to provide targeted ads to users. With advancements in natural language processing technology, we can therefore expect that the next generation of voice assistants will offer proactive assistance based on the audio signals and conversations acquired from the acoustic environment. We refer to such devices as ``always listening voice assistants'' and explore expectations around their potential use. We have performed a178-participant survey investigating the potential services people anticipate from such a device and how they feel about sharing their data for these purposes. We investigated the following research questions:

​

RQ1: What services do users expect always-listening voice assistants to provide based on their conversations?
 

RQ2: How useful are these potential services? Do people feel comfortable with them?


RQ3: How do factors such as demographics, perceived comfort, and service usefulness affect users' intentions to allow the voice assistant to access their conversations in exchange for services?

Research Method: Online Survey

Participants: 178 participants recruited on Prolific

Quantitative Data Analysis Method: Mixed model linear regression, Mixed model logistic regression 

Dependent variable: Participants willingness to share conversation recording for receiving a particular service 

Independent variables: The level of usefulness and comfort with the service, perceived sensitivity of the recording, conversation topic, service type, and demographics

Qualitative Data Analysis Method: Open Coding

Our findings reveal that participants can anticipate a wide range of services pertaining to a conversation; however, most of the services are very similar to those that existing voice assistants currently provide with explicit commands. Participants are more likely to consent to share a conversation when they do not find it sensitive, they are comfortable with the service and find it beneficial, and when they already own a stand-alone voice assistant. Based on our findings we discuss the privacy challenges in designing an always-listening voice assistant.

Publications

Madiha Tabassum, Tomasz Kosinski, Alisa Frik, Nathan Malkin, Primal Wijesekera, Serge Egelman, Heather Richter Lipford. ``Investigating Users' Preferences and Expectations for Always-Listening Voice Assistants", To appear in the proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, IMWUT (issue 4), 2019.

bottom of page