Offer Extended: Save 50%—over $175—on a subscription with our Black Friday DealAct Now

A selfie of the author Zara Stone, overlaid with results from Perfect Corp.’s AI Personality Finder demo. Art by Clark Miller
A selfie of the author Zara Stone, overlaid with results from Perfect Corp.’s AI Personality Finder demo. Art by Clark Miller

The Secret Life of Selfies: How a Beauty Tech Startup Is Using AI to Match Faces With Products

Inside Taiwanese unicorn Perfect Corp.’s billion-dollar bet on biometric beauty tech.

A selfie of the author Zara Stone, overlaid with results from Perfect Corp.’s AI Personality Finder demo. Art by Clark Miller
Sept. 9, 2022 12:00 PM PDT

For years, Hannah Williams’ go-to selfie app has been YouCam Makeup. Before posting a self-portrait to Instagram, the 25-year-old cashier from Morgantown, W. Va., will run the shot through YouCam’s augmented reality filters to whiten her teeth, remove stray pimples and smooth her complexion. In recent months, she’s played around with the app’s cat-eye eyeliner, used its AR hair filter to reimagine herself with red and purple hair, and contoured her face for her Bumble profile.

Williams said she’s gotten a lot of value out of the app: It makes her looked “snatched,” she said. But each of Williams’ selfies offers even more value to Perfect Corp., YouCam’s Taiwan-based parent company. Backed by investors including Snap, Chanel, Goldman Sachs Asset Management and Alibaba Group Holding, Perfect Corp. offers consumers and brands sophisticated try-on tools, essentially AR filters that allow customers to virtually test beauty products from their own home. For as little as $399 a month for enterprise clients, Perfect Corp.’s artificial intelligence platform—trained on hundreds of millions of faces like Williams’—can analyze users’ skin quality, match the exact shade of their skin to a corresponding product and overlay cosmetic and fashion accessories. And pretty soon, the program may even label users’ personality traits.

It’s this last feature that presents more dystopian possibilities. Recently, Perfect Corp. launched an AI Personality Finder, which promises to read your facial features for clues about what kind of person you are—and, by extension, what kind of products you might buy. Intrigued (if a bit alarmed), I snapped a selfie and ran it through the online demo. Five seconds later it spit out a profile based purely on the arrangement of my face. According to Personality Finder’s algorithm, the distance between my nose and my mouth, combined with my rounded cheekbones, hooded eyes, and other facial attributes, identified me as an enthusiastic, action-oriented and social person. I scored 95% for extraversion, 21% for neuroticism and 63% for conscientiousness.

This data, when fed into Perfect Corp.’s recommendation engine—licensed by companies as varied as Google, Meta and Aveda—then displayed a variety of generic cosmetics. (The demo program currently doesn’t sync with specific brands.) Apparently, my personality algorithmically meshes with red lipstick, brow pencil, and Goddess and Lilac perfume. These products are placeholder suggestions for future enterprise clients, but it’s easy to imagine them replaced with real goods from existing clients like L’Oréal, Macy’s, Estée Lauder or Nars. And Perfect Corp. clearly has aspirations far beyond helping to sell lip liners and blush.

Get access to exclusive coverage
Read deeply reported stories from the largest newsroom in tech.
Latest Articles
 
Data Point google
Where Google Has Grown
Alphabet has doubled the headcount in its Google Cloud unit since early 2019, according to data obtained by The Information, outstripping Alphabet’s overall hiring growth. The rapid growth helps explain why Google Cloud’s losses continue to widen even as its revenue grows rapidly. Google’s hardware unit and YouTube also each roughly doubled headcount between the first quarter...
Latest Briefs
 
Crypto Lender BlockFi Files for Bankruptcy
Yahoo Takes 25% Stake in Taboola in Ad Partnership
U.S. Bans Sale of Telecom Equipment from Huawei, ZTE
Stay in the know
Receive a summary of the day's top tech news—distilled into one email.
Access on the go
View stories on our mobile app and tune into our weekly podcast.
Join live video Q&A’s
Deep-dive into topics like startups and autonomous vehicles with our top reporters and other executives.
Enjoy a clutter-free experience
Read without any banner ads.
Art by Clark Miller
The Big Read
‘I’m Licking My Chops. I Know It’s Going Down’: The Pissed-Off Crypto Traders Who Predicted—and Profited From—the FTX Implosion
Ishan Bhaidani had been patient for over a month, waiting for blood in the water. Now was his moment.
Sequoia Capital's Alfred Lin. Photo by Getty Images
FTX Collapse Tarnishes Sequoia’s Reputation, Prompts Apology
Sequoia Capital’s Alfred Lin made a name for himself as a loyal confidant to the tenacious, often-doubted founders of companies like DoorDash and Airbnb, a commitment that helped catapult him to the No.
Sam Bankman-Fried. Photo by Bloomberg.
The Takeaway crypto media/telecom
The Press Failure That Led to FTX
As the crypto currency contagion spreads, there is a tough truth about the press’s role in the crisis that is becoming crystal clear.
Art by Clark Miller.
Gift Hunting culture
The Information’s Top Tech-Adjacent Gifts for 2022
After the roller-coaster ride of the past month, everyone needs a little retail therapy. So, in honor of Black Friday and the upcoming holiday season, we’ve put together our annual gift guide, asking The Information’s staffers to share their favorite tech and tech-adjacent purchases of the last year.
Bob Chapek via Bloomberg
Opinion entertainment media/telecom
It’s Not Just Disney
Parqor is part of The Information’s newsletter network. To receive it in your inbox every Monday, Wednesday and Friday, sign up here .
Alfred Lin. Photo by Getty Images.
Dealmaker venture capital
The Star Sequoia Investor Behind FTX’s Collapse
Last week, Sequoia Capital partner Doug Leone compared FTX’s blowup to childbirth. “Like having a child, you forget the pain of having that child three months later, a year later,” he said on stage at a conference in Europe.