Sign up to receive 5 free days of our daily summary for tech news.


The Privacy Questions Facing AI’s Personal Assistants

When Viv co-founder Dag Kittlaus unveiled his startup’s new personal assistant earlier this week, he showed off how easy it was to send his mother flowers, order a ride and book a hotel room through voice commands. “Have you ever seen a hotel booking that was that simple before?” he asked.

It was simple not only because Viv’s software could parse complex questions, but because Viv served Mr. Kittlaus an option of just one vendor for each request—, Uber and—instead of a slew of search results.

The Takeaway
A proliferation of companies are trying to build new twists on mobile search engines by giving users “personal assistants” that will offer simple recommendations for products and services. But a key question is whether the services are transparent about how they come up with those recommendations.

That very simplicity touches on a key question facing Viv and other personal assistants under development: How will they explain how they came up with product recommendations, including whether they’re based on data collected about consumer habits or are the result of arrangements with companies? Without an explanation, consumers might not trust the recommendations and therefore be less willing to use the services.

But being transparent about the reason for recommendations will be tricky, especially on a smartphone user interface that may be no bigger than a chat box, or on a mobile device with no screen at all.

Facebook faces a similar issue with Messenger’s M, which is now being tested and is run mostly by a few dozen humans training a machine-learning algorithm. In the near future, M will link to business bots to handle transactions, Stan Chudnovsky, head of product of Messenger told The Information last month. But how M determines which business bot to contact—will it recommend a booking using an Expedia-owned or Priceline-owned merchant if someone wants a hotel?—is uncertain. Facebook officials didn’t return requests for comment.

Data on consumer preferences collected by the personal assistants is likely to be a major factor influencing recommendations. Mr. Kittlaus, for instance, noted that Viv suggested a hotel he’d stayed at before, implying it had learned that from other interactions. But that’s likely to reinforce longstanding privacy concerns about how companies like Facebook and Google rely on user data to sell advertising.

And the privacy and consumer protection challenges involved in personal assistants may be even greater because the goal of these interfaces is presenting consumers with an easier way to tap “buy.” The idea is that consumers won’t have to think as much about what company is selling a product or why it’s being recommended.

“These services are based on developing rich profiles about your preferences,” said Georgetown law professor David Vladeck, former Director of the Bureau of Consumer Protection of the Federal Trade Commission. “The question is who will have access to them, what will they be used for and will your life be curated for you in a way you don’t notice or have control over?”

Some of these new questions are getting worked out. Adam Cheyer, co-founder of Viv, told The Information earlier this year that companies building these assistants will face a “tradeoff” of protecting privacy of users versus building more robust and intelligent assistants. He said he thought Siri, which Viv’s founders created before selling it to Apple, hadn’t improved much since its launch in part because Apple chose not to leverage lots of data of users. Viv wants to harness data to give people better results but the company’s approach will be “to have a lot of transparency about what Viv knows about a user.” (Mr. Cheyer and Mr. Kittlaus didn’t return requests for comment this week.)

How M and other personal assistants decide to share data on users with third parties is also worth watching. Messenger opened up its chat platform for some businesses last month, letting companies not only handle customer service interactions but also sell goods in the app via automated “bot” responses. Facebook so far has been careful to not give a lot of data to businesses. Partners plugged into the Messenger API only get to see users’ profile pictures and names—not even email—one partner said.

“With the first generation bots, we’re starting with minimal access. When consumers develop trust, we’ll get more access, which is the right way to do it,” added Puneet Mehta, CEO of the startup, which partners with Facebook and runs artificial intelligence services for brands.

What Is The Information?

Notes bb3aa5069205d702dda37fc71dc6f1c59df2310c4379304e9f1199f052af4884

Exclusive Articles

We broke it first. Receive original reporting you won't read anywhere else from the largest newsroom in tech.

Notebook b5103017ee163370a1667c9ce59ab0ef023875a17888105d26c185cadf31bb69

Daily news analysis

Every weeknight, we'll send you our reporters’ views on the day’s top tech news—distilled into one email.

Conference calls c9e664e8b96ee347d3e92b8309938f268422b9db98cfabca5c826fbb75054b23

Conference calls

Get access to our reporters and other top executives with monthly deep-dive calls into topics like startups and autonomous vehicles.

Events 499acedd16cffc41445edd76bfd302b2836c2a27419890f17130a6b10e2aa3df

Special Events

For no extra fee, get access to more than a dozen events yearly, from intimate dinners to larger gatherings with marquee speakers.

What else is included in my subscription?

Become a contributor

Share your views and find other subscribers by completing your profile. You’ll be listed in our contributor directory.

Slack community

Discuss topics and current events with our subscriber-only Slack group and share news about your company with other subscribers.

Annual Subscriber only benefits:

Org Charts

Access the only collection of tech company org charts. Our expanding database includes companies like Amazon, Snap, and Uber.

Crypto Newsletter

Our experts investigate the latest in the crypto world to keep you in-the-know about the movements of digital currencies.

Stay up to date on Silicon Valley

Sign up for Jessica Lessin’s (The Information’s CEO & Founder) free Saturday newsletter and also receive a complimentary week of our daily afternoon tech commentary email.

Already a subscriber? Log in here

Recent Articles

Crypto Facebook Policy

Lawmakers to Grill Facebook on Libra Plans

By Jon Victor and Ashley Gold

Crypto Facebook

Facebook’s Marcus in Spotlight with Libra Hearings

By Alex Heath and Jon Victor

Crypto Facebook

The People With Power at Facebook’s Calibra

By Alex Heath

Crypto Facebook Policy

Lawmakers Grapple With How to Rein In Libra

By Jon Victor

“These services are based on developing rich profiles about your preferences. The question is who will have access to them, what will they be used for and will your life be curated for you in a way you don’t notice or have control over?”