In retrospect, Magic Leap CEO Rony Abovitz realizes that all the hype was a big mistake. “I think we were arrogant, ” he says.
It’s nearly 11 pm on a Monday in late July, and we are in the back room of an Italian eatery not far from the Fort Lauderdale beach. It’s a place he often takes guests who build the trek from Los Angeles or San Francisco to Mickey Mouse’s Florida homeland for a demo. Oscar-winning visual impacts wizard John Gaeta, known for his work on the Matrix and later at Lucasfilm’s ILMxLAB, sits to my right, having joined Magic Leap last year. Former Samsung executive Omar Khan, who is on day 11 in his new role as chief product officer, sits to my left. Everyone is in a good mood because ultimately, I mean eventually , after two years of boastful promises followed by two years of near silence, the company is on the cusp of uncovering a headset that actual developers–and any old person in the wild–will be able to buy and bring home.
But it’s unclear , now, whether enough people will be willing to try it. Such a thought would have been absurd merely three years ago when Magic Leap was the most wonderful company in augmented reality, and any interaction with its secretive technology became a status symbol among techies. Yet Magic Leap has promised so much for so long, with no outcomes to speak of, that many of those who occupied that first wave of hype have written off all hope that its infamous, mythical, mixed-reality product is real at all, let alone the transformative technology it set out to be.
Abovitz gets it. In the fall of 2014, when Magic Leap’s entire personnel could still fit inside his conference room, and demos were run on a refrigerator-sized metal block nicknamed the Beast, Google led a $542 million series B investment. It was an absurd-sounding amount of money for such an early round of funding–and Google CEO Sundar Pichai joined Magic Leap’s board. Suddenly everyone was curious about the mysterious Google-backed tech company with a quirky founder who shunned Silicon Valley’s norms–a man who planned to headquarter his company in Florida rather than moving to the West Coast.
Where virtual reality surrounds a user in an artificial world, augmented reality superimposes virtual objects into your real-world surroundings. In its simplest form, that entails an overlay of information, like a dangling Pikachu in Pokemon Go . But Magic Leap, has sought to give those superimposed objects shape and heft–if you’re assuring something, you can touch it, or is moving forward, or interact with it, as if it were real. Abovitz bragged that Magic Leap had a new super-slick method for superimposing these digital assets — a technique called digital lightfield technology–that was better than anything Microsoft or Facebook or anyone else had developed.
But Abovitz’s grand descriptions always seemed to fall short of explaining how this technology worked. Before Magic Leap had a headset or software or programs, it hired marketers to sell the Dream of Magic Leap, all the while promising that a product was just around the corner. Abovitz fell mysterious clues on Twitter, hid Easter eggs inside old TED talks, and accepted an invitation to speak at the 2015 TED conference, bailing just days before his scheduled talk.
For the past four years, the headsets Abovitz has promised have failed to materialize, and tech prognosticators have begun to question whether people will even want to wear headsets at all , now that they can simply pull out apps on their iPhones to augment reality. The company has guarded its secrets, uncovering very little about how digital lightfield technology works or what its future product might look like. Developers, analysts, and general tech enthusiasts had grown increasingly skeptical that Magic Leap was developing anything worth following at all. Headlines ask “Why Do People Keep Devoting Magic Leap Money ?” and cry “Believe It or not, Magic Leap Says Its Headset Will Ship’ This Summer.’” As Jono MacDougall, developer and author of the blog GPU of the Brain , wrote, “It makes us feel like they are in a secret club and they won’t invite us in. It builds us feel like they think they are better than us.” He added, “It builds us want them to fail.”
Yet for all the things that have gone wrong, a few important things have worked out. Magic Leap has now raised more than $2.3 billion, enough money to fuel a lengthy research-and-development stage. It has built a stable of advisers and investors that include Alibaba executive vice chair Joe Tsai, Hollywood director Steven Spielberg, and Richard Taylor, who shepherds Magic Leap’s alliance with his mixed-reality and game studio, Weta Gameshop, a division of Weta Workshop. It has built an eclectic workforce of around 1,500 employees. Over the past year, under the direction of new chief marketing policeman Brenda Freeman, the company has endeavored to stop playing up the mystery and start telling people about the product it’s trying to build. “Secretive is this term that can be really loaded, ” Freeman says. “The idea is to make sure people trust us and we have credibility.”
The first test of this trust is about to occur. Today, the company begins to sell a $2,295 headset called the Magic Leap One Creator Edition in six US cities. Abovitz is certain, or at the least he’s really hoping, that once developers begin to play with the company’s invention, they’ll fell their complaints and change their minds about Magic Leap. And then, as they code new games and other experiences, everyone else will too. But Magic Leap’s next stage rests on its ability to do something wholly unconceivable to early Magic Leapers: It needs to succeed as an ordinary company.
The TL ;D R version of Magic Leap’s history goes like this: In 2011, after Abovitz sold his surgical robotics company, Mako Surgical, he teamed up with two others to start house Magic Leap. For the first few years, the “wandering through the desert years” as Abovitz calls them, the company kept a low profile. But the year Magic Leap created its Google money, the committee is also began trying to seed the promise of what it was building. Abovitz hired a flashy marketer, Brian Wallace, who’d been at Blackberry and helped launch the “Next Big Thing” campaign at Samsung. He began hosting celebrities interested in watching how his goggles could change Hollywood. A pilgrimage to South Florida became a status symbol among tech and media exec.( Beyonce reportedly determined the demo bearing .)
Building a new headset proving to be much harder than Abovitz foresaw. “I came out of building robots for surgery, so I supposed this would be easier than that, ” he says now. “It’s easier in the sense that we’re not cutting into people, but at a systems engineering level, this is harder.”
Abovitz had promised not just new hardware, but also new software that could function inside of an entirely new paradigm. What does a desktop look like outside of the two-dimensional bounds of a computer? How do people interact with controls when they’re pointing a light in the air, rather than moving a mouse around a screen? And, for this audacious invention to taken away from, Abovitz needed to cultivate a group of developers excited enough about the goggles and intrigued sufficiently by the software that they’d construct their own programs for it. It’s hard to win over developers until you have a product and customers to test the tools they create. You must convince them to join you on faith. So no, it wasn’t going to be ready in 2014. Or 2015. Or 2016. Or, actually, 2017.
Meanwhile, Abovitz clashed with Wallace, who had a background resulting large national branding campaigns with more predictable product growth and launch cycles. Wallace grew frustrated that he felt he was being asked to sell something that didn’t exist. “As the months and years wore on it became clear to me that what he was directing us to say publicly was not going to converge with current realities of the product when it launched, ” Wallace now says.
Abovitz says the marketing team wasn’t in line with the company’s culture. In retrospect, he likens it to a type of organ rejection, describing the ethos of the time as tribal. “It was like, which culture is going to win? This splashy big company kind of thing? Everyone else was like, that doesn’t feel right.” To cut to the chase, he explains, “we were not connecting, ” he says.
The last period I visited Magic Leap was the spring of 2016. There was a palpable tension when the marketing side of the business promised I’d find a product following completion of the year. Even then, it felt ingenuine. In my demo, the goggles were still attached to a large computer, and the software crashed after 10 or 15 minutes.
Later that year, Wallace’s contract was “terminated without cause.” Abovitz brought on media executive Brenda Freeman, a former chemical technologist who came from a media background and had been the chief marketing officer of National Geographic Channel. She arrived at a company that “was more focused on the marketing message” than paying attention to what the company was house, she says now. “It was empty carbohydrates, ” she says.
Freeman got rid of the large agencies. For awhile, things got very quiet.
Today’s Magic Leap offices seem a lot like any tech company headquarters you’d visit in Silicon Valley, minus the gourmet chefs.( Breakfast is catered on Mondays and lunch on Wednesdays and Fridays. This qualifies as a perk in Florida .) Walk past two security guards into an atrium where a wall of preserved plants rises two stories. Pass over your ID, and the receptionist will send you up the staircase, past a second security guard to a reception region, where you will be met by an escort.
The differences between Magic Leap and other tech offices are subtle. You’d have to look past the rubber unicorn head and the red stuffed version of the corporate logo, a “Leaper, ” hand-knit by Abovitz’s wife, to notice the talking stick, which he had his designers stimulate to help ensure that the white guys and loud mouths don’t do all the talking at sessions. And you’d have to be wearing a headset, as many of government employees straying through the office are, to see a deer grazing in front of the couch in Abovitz’s glass-walled office. Or to notice the T. rex in the hallway just outside. As I stand in front of Abovitz’s desk, watching the dinosaur stretch his neck, a human walks behind the cartoon character and he is completely obscured.
Over the past two years, Abovitz has attempted to move the company out of the research and growth stage, and focus on ultimately shipping a product. In early 2017, Magic Leap put out a call for developers–Abovitz did this via tweet–and began to seed the company’s developer tools among more than 100 of them, spread out around the world. Then, in December, the company finally disclosed its headset with a blog post and a feature in Rolling Stone . This was followed in March by a preview of its software growth kit and a website dubbed the “creator portal” with resources to help interested developers.
In the future, Abovitz hopes that developers programming for Magic Leap will be able to have their creations rendered on multiple operating system. That T. rex outside his office? Theoretically, he hopes you should be able to see it via any computing device you choose, including your telephone. It’s a democratic approach to constructing software that’s a smart move for a company looking to enticement developers with the assurance that their work will be seen. In order for the product to become a mainstay, Magic Leap will need to coax them to expend their time programming for its headset with the promise that there will be future customers.
To entice them, Magic Leap is trying to attain development dead simple. As the chief content officer, Rio Caraeff, explains: “We don’t have, you know, 50 million developers, and we have to do everything we can to make it easy to construct for Magic Leap.” Sure, there will be ambitious inventors right from the beginning, some of whom Magic Leap has partnered with merely to help a larger audience reimagine what the technology can do. The Icelandic band Sigur Ros worked with Magic Leap to construct an electrifyingly beautiful visual voice experience. But Magic Leap has also a style for developers to input a tiny snippet of code into their existing projects and refer to 3-D models to render web pages in 3-D in Magic Leap’s Helio browser. So, you can open a demo of The New York Times in Magic Leap’s Helio browser, just as you might on your desktop. But by adding a small snippet of code that renders a 3-D model, The New York Times can also indicate you a news photo rendered in 3-D so you can more closely explore it.
In seeding developers, Magic Leap is attempting to steer the design direction of its technology. Sure, 40 percent of the developers who received the goggles early are focused on gaming and entertainment, use examples that have been the company’s mainstay. But Magic Leap has also developed tools for corporate communication( Imagine Zoom, but if your entire conference party were avatars sitting around a digital seminar table .) Roughly 10 percent of the company’s existing developers come from healthcare and medical imaging, which isn’t surprising given Abovitz’s background.
I tried out the Magic Leap One in a 1,000 -square-foot faux-living room that had been tricked out in West Elm furniture, and it wasn’t great at first. The headset was beautiful, and unlike others I’ve tried, it felt light on my head. A disc-size battery and computing pack, constructed like a small Cd, fit easily in my front pocket. A main menu popped up in front of me, the field of view large enough that it didn’t seem narrow. But as great as this was, there were flaws. When I tried to use the hand controller to navigate to a basketball demo, the controller didn’t react; the experience appeared frozen.
Sam Miller, the baby-faced former NASA engineer who says he bided up all night the first time he satisfied Abovitz to brainstorm how Magic Leap might work, stood along the side wall, watching, are seeking to situate the problem. The girl who was giving me the software demo removed the headset, took a look inside, and returned it to me. Miller indicated I change the nose bridge. Finally we got the thing working.
The problem, we figured out, was the fit. Each define of goggles comes with five nose pieces and the ability to add prescription lenses. Magic Leap’s experience is so closely linked to a person’s physiology, these goggles will need to fit perfectly to work. This is a challenge for a company trying to introduce a new type of tech. So, Magic Leap has contracted with former Apple executive Ron Johnson’s startup, Enjoy, which sends customer service people to deliver new tech gadgets and help users defined them up. Enjoy representatives will deliver every Magic Leap headset, fit it, and provide a tutorial on how it works.
Once the headset was working, the experiences were creative and compelling. The images were crisp and solid( as solid as virtual reality can be, anyway ). With a click of the controller, I pinned a Helio browser on the wall to my left. I opened a Wayfair demo in a second browser directly in front of me. A plush chair appealed to me from the Wayfair website, so I employed the controller to drag it immediately into the living room and ensure what it might look like. I ultimately find the NBA demo, utilizing my controller to plant the playing field on the ground so that I could better watch an interesting move in a game I was watching. And I got to play Dr. Grordbort’s Invaders , a first-person shooter game being developed by Weta Gameshop.
With help and support from a friendly robot called Gimbal, I shot at the menacing robots that were walking ominously toward me until I’d killed them all and a portal opened in the wall. As I was spraying my ammunition, I accidentally made Gimbal, and I was so caught up in the game and the character that without reasoning, I apologized to him.
These experiences are surely on par with other augmented-reality and virtual-reality demos I have find. Are they really mind-blowingly better than the rivalry? Not yet. But Magic Leap does have a product, and despite its naysayers, it’s very close to being in all of our homes.
When we first met in 2016, Abovitz told me he foresaw a great unveil for Magic Leap. He said he hoped it’d be like Charlie and the Chocolate Factory, that a few lucky people would find golden tickets and is an indication for an event like none before. It hasn’t happened that way. Instead, Magic Leap’s great unveil has happened a lot like the product releases at other large tech companies: a spattering of press, centered around an embargoed rollout.
This has left many reviewers disappointed. They complain that the device’s field of view is not that much larger than Microsoft’s HoloLens: In other words, Magic Leap’s imagination goggles are just another version of the status quo. A video of a Magic Leap experience that began to circulate in July showed little jittery rock-throwing creatures, far less magnificent than the whale rising out of the gym floor that headlined one of the company’s original conception videos. The Apple blogger John Gruber called the promo disappointing, saying, “I’ve long been suspicious that the reason Magic Leap is so secretive about their actual technology is that it’s nowhere close to what they promised in their notion videos. This seems to confirm it.”
Abovitz calls this his “tv-on-the-radio” problem. He took to Twitter shortly after the video’s release to respond to critics. “Most people just got it once they first saw TV. Same with @magicleap, ” he tweeted. Abovitz believes that the only thing that will assuage the public’s uncertainty about the viability of his product is for those haters to see it, touch it, engage with it, and come away believers–that no sum of promo and marketing will give what Magic Leap is attempting.
I will agree with all the people who have ensure Magic Leap and report that the technology paired with the choice of content actually are different and better than other things I’ve seen. The company says it has already devoted 10,000 demos, and it will start a roadshow this fall to bring Magic Leap systems to college campuses and other places where the general public can try it.
But good technology doesn’t guarantee that a company will redefine a field. Many tech companies manufactured early versions of PDAs before Apple made the iPhone. Furthermore , no one is sure if people other than gamers and perhaps folks in firms will want to wear headsets when they could just hold their phone screens out in front of them for an augmented position of the world. While Apple’s two-dimensional iPhone approach to augmented reality is scarcely as mind-blowing as a hands-free headset, it’s immediately available to everyone and thus practical. The company can leverage its 20 million developers and all of its users to build a range of AR experiences that could subsequently transfer to any device we may adopt.
Magic Leap may not have 20 million developers yet, but it has vast amounts of cash. It has dozens of patents. It has patient investors. And it has a founder who remains resolute in his ambition. “We didn’t only shoot off and do Apollo and land on the moon, ” he tells me as I’m getting ready to leave. “It was all these incremental steps, and if we hadn’t done it that way, there would have been no learning.”
Maybe he’s right–that all the hype and marketing belies the fact that Magic Leap is just a kind of normal tech company, applying fund and talent in equal measure in pursuit of what is, they hope, a big enough idea. It’s no chocolate mill. There are no Oompa Loompas. There are just engineers and designers, weary from rushing to launch their first product, hoping developers will fall hard for Magic Leap One Creator Edition. But if they don’t, the company will do what healthy, well-funded companies do: try to improve it. Already, in another part of the building, a squad of engineers is developing Magic Leap Two. Release date: TBD.
Correction 08/8/ 18 1:52 pm EST: A previous version of this story indicated that the author played an NFL football game. It was a basketball game, produced by the NBA . em>
More Great WIRED Stories
- Playing Monopoly: What Zuck can learn from Bill Gates
- A cavorting polar bear and other gorgeous droning photos
- Sorry, nerds: Terraforming might not work on Mars
- No solar-powered EV? You can still drive on sunshine
- How a bunch of lava lamps protect us from hackers
- Get even more of our inside scoops with our weekly Backchannel newsletter
Read more: http :// www.wired.com /~ ATAGEND