How Snap is sidestepping the metaverse

More than other recent years, in 2021 the tech industry focused a great deal of its energy on a single question: who will build and own the next generation of the internet?

In one corner you have the scrappy upstarts eager to topple the existing world order and rebuild it from scratch on the blockchain. These companies give their effort the aspirational name “Web3.”

In the other corner you have the existing tech platforms, who envision the next generation of the internet as a slightly more interoperable version of the existing web. What will set it apart is new hardware: augmented reality glasses and virtual reality helmets that will bring us together in a series of linked experiences that occupy an ever-increasing share of our waking hours. Platforms have taken to calling this “the metaverse.”

Web3 and the metaverse will surely intersect along the way — Meta CEO Mark Zuckerberg has said he imagines people bringing non-fungible tokens along with them as they traverse the company’s virtual worlds. But while crypto-based platforms are still mostly in their earliest stages, the battle for the metaverse already has at least a half-dozen established companies investing billions of dollars in realizing it.

Today, let’s talk about one that strangely flies a little under the radar — and is taking a more straightforward path. While other companies are painting grand visions of the metaverse via press interviews and op-eds, Snap has been quietly focused on two of the ideas that can actually bring it into existence: steadily improving its hardware every year or so, and attracting developers by giving away that hardware and offering them ways to profit from it.

I.

The core function of AR glasses is to project images in front of your face, turning your field of vision into a virtual computer screen on which you can receive messages, play games, and interact with digital or real-world objects for educational or commercial purposes. Most platform executives agree that this would be a good and useful thing, and that lots of people would buy the hardware that makes it possible.

The problem is that the tech isn’t ready: creating high-resolution projections using a device that fits on your face, has good battery life, and costs a reasonable price, is far beyond the ability of today’s platforms.

Surveying the AR landscape this week, the Wall Street Journal predicted that someday high-tech glasses will become Apple’s successor to the iPhone. It looked at similar efforts from Facebook, Microsoft, and the lesser-known Vuzix, among others. And to Snap, which made the first major set of high-tech glasses when it released Spectacles in 2016, the Journal devoted just a single sentence: “Snapchat parent Snap earlier this year added AR functions to the latest version of its Spectacles smart-glasses, which are so far available only for developers.”

Indeed, when they were announced in May, Spectacles became the first pair of the company’s glasses I didn’t get to try myself. Instead, the company seeded them with a handful of developers who create AR effects, games, and utilities and gave them a few months to build.

And then, one day last week, the company invited me to a rented backyard in San Francisco’s Castro district to see the results.

Within a few minutes of wearing the glasses, two things became clear to me. One is that these are very much a product for developers rather than consumers. The chonky frames, 30-minute battery, and presumably high price would limit their appeal to all but the most hardcore futurists.

At the same time, my morning with Spectacles was enough to convince me that AR glasses have a promising future, and are likely to print money for the companies that manage to perfect them.

It started with a donut. Sitting around a table with some Snap executives, I was introduced to Brielle Garcia, a full-time AR creator who is part of the company’s Ghost program for up-and-coming developers. Garcia has made dozens of AR effects for Snapchat — the company calls them “lenses” — and one such idea came to her while eating at a restaurant during COVID. Like many eateries, this one had begun telling customers to scan QR codes with their phones to access the menu. Garcia thought it would look better in AR.

Using Snap’s Lens Studio software, she mocked up a menu that displays items in three dimensions sitting virtually on your table. When I opened it up using Spectacles, I waved my hands to advance through the virtual goods: a burger, a sushi roll, a piece of pie. The donut looked realistic enough that I developed slight hunger pangs looking at it. Compared to a QR code menu on my phone, Garcia’s AR project was meaningfully better. And I felt that way despite the relatively low resolution of the text, at least compared to what you might see on a current-generation smartphone.

The Snap team had other tricks to show off. In one game, a zombie chased me around the yard. (Alex Heath, who got a similar demo at The Verge, posted a video of his zombie chase that gives you the idea.) In another, I hung virtual Christmas lights on the trees.

The flaws are all readily apparent. The biggest among them is the relatively small field of view that Spectacles can produce using its current technology. When you don the glasses, you might assume that you’ll be able to see a digital overlay that covers everything you see. Instead, it’s a relatively small box at the center of your vision. As a result, I was constantly moving my ahead to attempt to “place” the digital effect back in the box where I could see it.

In some cases, as with Garcia’s menu, objects were relatively small and slow-moving, and this was fine. In others, particularly the zombie chase, the field of view was so small that I found the game all but unplayable.

That said, the state of the art is still further along than I expected when I first sat down with the glasses. For my final demo of the day, I used Spectacles to project a toy dinosaur on the table we were all sitting at. It appeared as a perfect hologram, contained neatly within the glasses’ field of view — the sort of thing that would delight any child to whom you showed it.

A small thing today, but one that points to a big future.

III.

Snap faces a lot of competition as it works to turn today’s Spectacles into the iPhone of the future. Apple is at work on its own headset, which will combine AR and VR, and will reportedly debut it next year. Meta is working to launch AR glasses next year as well. And Microsoft just signed a deal with Samsung to collaborate on a future generation of its HoloLens headset that will presumably be aimed at consumers. (It’s not expected until 2024.)

Meanwhile, more software-oriented efforts from Roblox, Epic Games, and Niantic are all afoot — and will likely lead to hardware projects of their own down the road. (Niantic has already commissioned a reference design.)

But one thing forget about Snap, as co-founder Bobby Murphy told me this week, is that the company has been working on this initiative for many years — predating much of its current competitive set.

“We've been incredibly invested and interested in an AR future for for many, many years now,” Murphy told me ahead of its LensFest developer event, which runs through Thursday. “The ability to perceive and render digital experiences directly into the world really aligns to how we as humans naturally operate.”

To date, Snap has signed up 250,000 people to create more than 2.5 million AR effects. More than 300 of those people have gotten 1 billion or more views on their lenses, the company says. Snapchat lenses are viewed 6 billion times per day.

Of course, the majority of those are purely for entertainment: making your face look younger, or prettier, or otherwise distorted to send snaps to your friends, or to place a digital dancing hot dog in the environment around you. But Snap has started to layer in other sorts of experiences, like a “scan” feature that lets you use the Snapchat camera to identify trees — or, more importantly, from a revenue perspective — shopping opportunities.

It turns out that all those funny-face lenses trained a generation of users that a screen can itself be a window into real-world experiences, whether on a smartphone or a pair of glasses.

“That's actually been a very helpful starting point for us to start to push into kind of a much wider variety of use cases,” Murphy told me.

One thing you won’t catch Murphy doing much is talking about the metaverse. While Snap’s ambitions arguably fit under that umbrella, the company seems confident enough in its existing vision not to adopt the buzzwords of the moment. At the same time, Murphy says the recent acceleration in development around AR is real.

“It's not that there's been a leap in technology, but I think we are starting to see a broader emergence of use cases for which AR is maybe escaping the novelty sphere, and actually driving real value for for companies and for creators,” he said.

There’s no reliable timeline for when that next leap will occur — and when hundreds of millions of people will begin wearing their AR glasses in the way many assume they someday will. But using the latest version of Spectacles, I find myself having trouble believing that someone won’t get there eventually — and maybe sooner than a lot of people think.

“The way that we're looking at our opportunity in the future, it's really around developing this kind of singular, holistic platform,” Murphy said. “In which you as an AR creator can make something really compelling, and get that in front of people — through Snapchat, through CameraKit, through Spectacles — and then build a career or build a business through that kind of path.”

Winning over developers doesn’t guarantee that any particular company will win the our mixed-reality future. But no one can win without them, either. For the moment, Snap has more than it share of enthusiastic creators. And together, they just might make the metaverse an actual reality — even if the company never calls it that.

More Snap: All of today’s LensFest announcements, including multiplayer Spectacles games, real-world physics for AR effects, and tipping for AR creators. And you can catch the keynote here.

Platformer Jobs

Today’s featured jobs on the Platformer Jobs board include:

• Trust and Safety Content Policy Manager, Niantic.
• Congressional Innovation Fellowship, TechCongress.
• Project Area Research Coordinator, Hacks/Hackers.

Some posts here are paid. For more great jobs in tech policy and trust and safety, or to create a listing, visit here. Nonprofits and academic institutions can post for free using the code NONPROFIT.

Governing

⭐ A look at the many compromises, both moral and product-related, that Apple has made to continue doing business in China. The effort has been led by CEO Tim Cook. An important investigation from Wayne Ma at The Information:

Cook forged the five-year agreement, which hasn’t been previously reported, during the first of a series of in-person visits he made to the country in 2016 to quash a sudden burst of regulatory actions against Apple’s business, according to internal Apple documents viewed by The Information. Before the meetings, Apple executives were scrambling to salvage the company’s relationship with Chinese officials, who believed the company wasn’t contributing enough to the local economy, the documents show. Amid the government crackdown and the bad publicity that accompanied it, iPhone sales plummeted.

Throughout that pivotal year, Cook, who was the architect of Apple’s supply chain in China, personally lobbied officials over threats that would have hobbled the company’s devices and services, including Apple Pay, iCloud and the App Store, the documents show. He often succeeded, and his previously unreported interventions, along with the multibillion-dollar agreement he signed with a powerful Chinese government agency, paved the way for Apple’s unparalleled success in the country. The revelations also suggest Apple’s dependence on Cook for government affairs could present risks down the road if he were to step down as CEO.

The Department of Justice wants to know why Roblox suddenly started calling its games “experiences,” presumably to comply with Apple’s rules against putting an app store inside the App Store. Hey, me too! (Juli Clover / MacRumors)

The Senate confirmed Jessica Rosenworcel, acting chair of the Federal Communications Commission, for another term. But the FCC remains deadlocked with two Democrats and two Republicans. (Ben Brody / Protocol)

The Biden administration met with 13 companies, including Google, to ask for more help in protecting the nation’s infrastructure from cyber-attacks. The hope is to attract new allies in the fight against ransomware. (Eric Geller / Politico)

Google sued two Russians, alleging that they’re behind a massive botnet that steals people’s information and mines cryptocurrency. “The company also worked with Internet infrastructure companies to take down servers used by hackers to control the network, effectively rendering the ‘botnet’ of infected devices unable to receive new commands from their controllers, at least temporarily.” (Gerrit De Vynck / Washington Post)

More than 200 newspapers have joined lawsuits alleging that Google and Facebook have illegally monopolized the digital ad market. “The lawsuits were filed after the House Judiciary Committee published its major digital competition report last October, which included a section on newspapers.” (Sara Fischer / Axios)

Rep. Devin Nunes, who sued Twitter because someone pretending to be his cow made fun of him there, resigned from Congress to lead Donald Trump’s possibly forthcoming social network. Can’t wait to read the community guidelines. (Amy B Wang and David Weigel / Washington Post)

Microsoft seized 42 domains used by a Chinese cyber-espionage group in operations targeting organizations in the United States and 28 other countries. The group, known most recently as Nickel, has been operating since 2012. (Catalin Cimpanu / The Record)

Industry

⭐ Ubisoft became the first major gaming company to offer in-game NFTs. Lots of caveats and questions here, starting with “why does this have to be on the blockchain?” But it feels like a rubicon has been crossed. Here’s Andrew Hayward at Decrypt:

Today, the publisher behind Assassin’s Creed and Just Dance revealed Ubisoft Quartz, a platform that lets players earn and purchase in-game items that are tokenized as NFTs on the Tezos blockchain. Quartz will launch first in the PC version of Tom Clancy’s Ghost Recon Breakpoint, the latest online game in the long-running tactical shooter series.

Quartz will launch in beta on December 9 in the United States, Canada, France, Germany, Spain, Italy, Belgium, Brazil, and Australia. Ghost Recon Breakpoint players who have reached XP level 5 in the game can access the NFT drops. Ubisoft’s release says that players must be at least 18 years old to create a Tezos wallet for use with the game.

⭐ Honeywell said it had generated the first-ever quantum-computer-generated encryption key, which may be impossible to crack. If true, a significant development in future encryption efforts, and a huge business opportunity. (Thomas Black / Bloomberg)

Discord is testing paid server memberships, with 90 percent of revenue going to the server. Love it, ship it. (Tom Warren / The Verge)

Twitter acquired the team messaging app Quill. Quill was beautifully designed; the acquisition bodes well for Twitter DMs. (Quill)

Amazon Web Services had another big outage. Among today’s victims were Disney+, the news outlet Protocol, and Amazon. (Richard Lawler / The Verge)

Messenger chief Stan Chudnovsky will leave Meta next year after more than six years at the company. Chudnovsky was a legendary growth hacker and deputy to David Marcus at PayPal before coming to Messenger; notably, he announced his departure just days after Marcus said he is leaving Meta for other things. (Kurt Wagner / Bloomberg)

Facebook is planning a major expansion of in-app commerce in 2022. A leaked document calls commerce “our highest priority and largest investment area,” following Apple’s rollout of App Tracking Transparency. (Ashley Stewart / Insider)

Facebook video game streamers will be able to invite audience members to play with them. A fun idea; it will start with the launch of Pac-Man on the service. (Dean Takahashi / VentureBeat)

A look at the role of YouTube creators in pumping up Shiba Inu and other meme coins. “It’s often impossible to tell when a YouTuber is providing savvy analysis, or just cashing in. Scribner gets daily requests from altcoins and exchanges offering $25,000 for a single mention, usually paid out in Ethereum.” (Mark Bergen / Bloomberg)

An interview with Jonah Ehrlich, a core member of ConstitutionDAO. “The most fun description I’ve heard is that a DAO is a group chat with a bank account. Essentially, what a DAO lets you do is have this very lightweight organizational structure to be able to move around assets and interact with the world.” (Nilay Patel / The Verge)

CryptoPunks with lighter skin tones are selling for higher prices. Investors say “the people currently willing and able to pay top dollar for digital goods aren’t bidding on avatars that don’t look like them.” (Misyrlena Egkolfpoulou and Akayla Gardner / Bloomberg)

Those good tweets

Talk to me

Send me tips, comments, questions, and AR effects: casey@platformer.news.