Apple and Pixar created a new file format for augmented reality on your phone
The new USDZ file format will make it easier than ever to look at AR objects in iOS. Sharing photos and videos on a computer or a smartphone is, for the most part, pretty easy. File formats like JPG and PNG for still photos, and MOV for videos, display just as intended on pretty much any device. Now that augmented, and even virtual reality are gaining popularity, device and software makers are looking to standardize the way we share three-dimensional models for use in various apps. We know how to share a photo or video of a globe, but how do we share an interactive model of it?
At its WWDC conference earlier this month, Apple announced that it has teamed up with Pixar to develop a new file format called USDZ, which the upcoming iOS 12 operating system will natively support. It was a small piece of the presentation, but this kind of standardization will be increasingly important as AR gains traction with users.
What is USDZ?
USD stands for Universal Scene Description, and it’s a file format that’s fundamental to Pixar’s 3D animation process. You can read the technical classifications for USD here, but it’s essentially a way for content creators to code 3D objects and package-save them with enough information about things like geometry and shading to stay consistent across editing applications.
USDZ takes the concept one step further and packages all the USD elements an application needs to display that 3D object, and combines them into a single, uncompressed zip file. Each USDZ file is an archive full of individual elements that applications can reference in real time to make an object appear on a screen and in augmented reality situations. Apple ARKit 2 integration As part of the iOS 12 release later this year, Apple is introducing the updated version of its augmented reality platform, ARKit. It has some interesting features, including the ability for multiple users to simultaneously view the same augmented reality scene from different angles at the same time for things like catapult battles and collaborative learning. But, it will also include native support for USDZ files.
If you’re part of the Apple Developer’s program and you’re trying out iOS 12, you can go to this link and find a collection of USDZ objects to interact with using Apple’s AR Quick Look. Once you download the object, you can virtually place it in the scene in front of you, like you can with typical AR apps like Ikea’s Place app, which lets you drop virtual furniture into your real-world surroundings using your phone’s camera.
Who can use USDZ?
During the WWDC keynote, Apple announced that it’s partnering with Adobe to integrate the USDZ format into the Creative Cloud apps like the ubiquitous photo editing app Photoshop and its 3D compositing software, Dimension. Adobe’s overall AR creation strategy is called Project Aero. The fundamental idea is to allow content creators to make 3D objects and allow users in apps and on the web to interact with them in a standardized way across AR-capable devices. In the video above, USDZ is the container that holds the elements that make up the 3D sculpture and allows the iOS device to view it in real time.
What’s the competition look like?
According to Stefano Corazza, head of augmented reality at Adobe, the company is currently working with USDZ as well as a competing format called glTF, which already has support from behemoths like Google, Microsoft, and Facebook.
Corazza says that format is primarily designed for the web and is still working on adding some of the features that are inherent to USDZ right from the outset.
Some other people in the 3D world have concerns about USDZ as well. Apple’s sheer number of iOS devices can make a file format relevant for content creators, even if it’s not the strongest candidate.
Look for it later this year
Whether Apple and Pixar can make the open USDZ standard the go-to format for 3D objects will shake out over time. But, USDZ support will be fully integrated into iOS 12 when it launches later this year. Then, the floodgates for 3D dancing objects will officially open.
Apple is expected to transition its iOS devices to USB-C connectivity later this year, by shipping a Lightning -> USB-C cable and a new 18W charger, previously rendered here. This will move new iPhone buyers over to using USB-C for charging with a cable. It will also mean that customers can take advantage of Type-C fast charging without needing to buy additional accessories.
Next year, Digitimes reports that Apple will add USB-C ports to the iPhone itself. This would be a major shift for the product line and would presumably be the beginning of the end for Apple’s proprietary Lightning connector.
Facebook has now enlisted Qualcomm to provide the tech for its gigabit Wi-Fi project that is meant to make sending data through routers more efficient and increase internet speeds. It’s called the Terragraph Project and it’s been in the works since Facebook first announced it at the company’s 2016 annual developer conference, describing the project as a “multi-node wireless system focused on bringing high-speed internet connectivity to dense urban areas.”
New Qualcomm chipsets will be integrated with the Terragraph technology, so that manufacturers can hopefully upgrade routers to be able to send data at the 60GHz frequency, which will increase broadband connections to higher speeds.
A Qualcomm spokesperson described it as a solution for both rural areas and urban areas that simply have spotty Wi-Fi in certain regions. Field tests are set to begin in the middle of next year, but there’s no word on when the Terragraph Project will actually go live. We’ve reached out to Facebook for more information.
Qualcomm is also making a 5G small cell chipset for phone manufacturers and carriers, which the company announced today as well. Qualcomm is already working with “early access” partners. There’s no word on exactly who those carriers will be, but given previous partnerships, it’s likely Nokia and Samsung could be among them. Samples of chipsets will become available next year, meaning that the product release will be further down the line than that.
When Facebook announced in January that it would soon de-emphasize posts from publishers in users’ news feeds, it felt like the last betrayal in a bad marriage. Referral traffic to publisher sites from Facebook had already dropped 50 percent in the past year (see chart below), and things were only going to get worse.
They’d stay together for the followers, sure. But things would never be like they were just a couple of years ago, when Facebook seduced publishers with the promise of building a blossoming business together within its walls.
In the months since, publishers have been focused on rediscovering themselves. They’ve talked of building a better experience on their sites and stronger relationships with readers, refocusing after chasing scale on Facebook for years.
“Most publishers abandoned reader revenue and thought they’d build revenue on scale, and thought things would be great,” Raju Narisetti, the recently departed CEO of Gizmodo Media Group, explained on a panel at the International Journalism Festival last month. “But it hasn’t been great.”
But for some publishers, another question has emerged: Why was Facebook able to drive clicks at such a torrential pace? And what could they learn from its techniques?
Facebook-ifying the web
The past year has seen an intriguing wave of technology that allow publishers to take the most effective parts of Facebook’s News Feed and apply it to their sites. This technology has come from an unlikely source–content-discovery engines like Outbrain, Taboola, and RevContent.
The trio of competitors are responsible for the vast majority of the “recommended” sponsored content under articles on publisher sites. These sponsored spots are a major source of revenue for publishers, but sometimes derided by media critics for the sketchy quality of their content.
For years, they’ve all also competed with Facebook’s ad business, which remains one of the most effective ways for brands and publishers to drive paid clicks to content. And all three companies came to a similar conclusion: What if they could help publishers create an experience on their own sites that resembled Facebook’s feed?
From a user-experience perspective, there are two elements that make Facebook such an effective delivery mechanism for content. The first is the feed itself–an infinite scroll of fast-loading content modules that’s inherently addictive. The second is personalization; Facebook’s algorithm knows what you click on and then serves you more of the same.
Outbrain, Taboola, and RevContent all track billions of clicks each month, and can track people’s content preferences in a similar way. And they’ve all launched tools that allow publishers to turn their mobile sites into a Facebook-lite experience through an infinite feed of personalized content. Here’s what each offers.
Just a year after launch, Feed is already beginning to transform Taboola’s business. It’s a card-based system that allows publishers to create an infinite stream of content below an article. For Taboola CEO Adam Singolda, the most exciting part is that this content isn’t limited to articles. Feed allows publishers to include myriad content formats–articles, native video, and even weather cards via The Weather Channel.
According to Singolda, roughly 20 percent of Taboola’s revenue now comes from Feed. That’s because the new technology allows for autoplay videos in the feed natively, as Instagram and Facebook do.
“We now stream 100-130 million video views every single day,” he explains. “I believe we will be at a billion video views a day, giving us an opportunity to give $20 billion of video budgets to go into the open web and not only YouTube ad Facebook.”
Feed is most appealing to publishers looking for a monetization boost, taking a page from the playbook that’s allowed Facebook to capture nearly 20 percent of the total digital ad market. It also features carousels of content, which lets publishers generate multiple video views from just one spot in the crawl.
HuffPo Korea, for instance, saw a 40% increase in RPM (Revenue Per Thousand Impressions) and a 60% percent increase in CTR (Click-through-Rate) after adopting Feed. In other words, Feed is allowing the site to generate more revenue per pageview, while also increasing the rate in which people click on additional content, whether it’s organic HuffPo content or sponsored ads.
Outbrain: Sphere and SmartFeed
In February, Outbrain announced two new tools: SmartFeed and Sphere. SmartFeed is extremely similar to Taboola’s Feed, in both name and features–minus the carousel and weather cards. Sphere is much more interesting, and may appeal the most to publishers looking for high-quality replacements for traffic lost by Facebook’s algorithm change.
Sphere is an invite-only content recommendation network, fittingly launched on Valentine’s Day, which allows publishers to show each other love. The appeal is that they can buy and sell traffic within the network without worrying about low-value sponsored content (“10 Celebrity Sideboob Shots You Just Have to See!”) tainting their sites. CNN can rest assured that it’s recommending a high-quality article on a Meredith publication instead of a sketchy post on brainpill.com.
According to Matt Crenshaw, general manager for business development at Outbrain, Sphere’s algorithm is based on how consumers engage after they click on an article, helping everyone drive better lifetime value (LTV) from customers. “We looked at Facebook and said, ‘There’s gotta be a better way to do this,’” he says.
If a piece causes a consumer to leave a site immediately after clicking on it, that piece gets downgraded in the algorithm. If the user clicks on a piece and then subsequently clicks on a second article, it gets upvoted and shown more frequently.
This is a stark departure from how every other advertising network works. Usually, ad placement goes to the highest bidder. Sphere mitigates this by creating a fixed CPC (cost per click) of $0.015. Publishers collect 100% of the revenue from the first click. Outbrain only takes a cut if the reader clicks on another article. According to Crenshaw, the $0.015 CPC is is “very much in line and slightly favorable to what [publishers] can get with Facebook.”
As for the the way Sphere intermingles content from media companies, “we want to build a world where premium publishers grow each other,” he adds. “When we talked to them two years ago, publishers said, ‘No, that’s my competition.’ Now they see platforms as the competition.”
The newest of the tools, RevContent’s Engage.im, takes a significantly different approach, allowing users and publishers to recreate the Facebook experience. The tool integrates into a publisher’s content-management system (such as WordPress) and commenting infrastructure (Disqus, for example), allowing readers to comment directly on the content module, much like they would with Facebook. Through a Facebook integration, users can pull in their Facebook data to personalize content, and then select topics they’re interested in to customize it further.
According to RevContent CEO John Lemp, publishers have complete control over the tool and can choose to feature just their own content, or include sponsored content as well.
The early results are promising. The tool, which was announced in March, has been live on Newsweek’s site for several months. According to Newsweek CEO Dev Pragad, “Traffic from Engage.im performs at 531 percent higher average time on site than social, resulting in a significantly improved user experience and better engagement with our content.” Newsweek has seen a 4-5X increase in engagement before personalization, and an 11X increase in engagement afterwards, as measured by time spent with content.
“We want to build a personal experience that allows our audience to customize their site to their interests and create a space where they can engage with our content to establish a deeper relation,” explains Pragad.
Newsweek has spent the year in an “insane crisis” this year following a raid by the Manhattan DA over financial ties with fringe religious groups, the firing of top editors investigating the story, the hiring of an executive who had been accused of sexual harassment, and finally, an alleged ad fraud scheme in which the company reportedly bought fraudulent traffic via hidden pop-ups on pirate streaming sites. (Just writing that sentence was exhausting.) Its site’s remake with the Engage tool could be considered, most generously, as an opportunity to create a new experience and identity–assuming it can resist allowing through the sketchier sponsored content that can appear in content recommendation engines.
Luckily for RevContent, Engage–which is still in beta–is live and working on several publisher sites. RevContent shared engagement stats from two additional major news sites and one entertainment site. The publishers saw a 175% increase in time on site, 50% increase in pageviews per session, and a 28% decrease in bounce rate as the result of using the tool.
The open web: a new hope
For years, the share of users’ time shifted more and more into the walled gardens of Facebook and other apps. In turn, the media industry has been haunted by the fatalistic sense that the open web is dying. That might be changing.
After all, what’s likely driven most users from the web to apps is not their inherent appeal. Rather, it’s that the experience on most mobile sites sucked. Publishers, with poor formatting and intrusive ad formats, were the among the worst offenders. Instead of fixing that experience, many tried to curry favor with platforms instead.
Each of the new tools from Taboola, Outbrain, and RevContent paints a unique picture of what a better open web might look like on publisher sites. It’s a vision of transformation for these companies as well, which could find a second life beyond the buying and selling of link clicks.
Singolda, Taboola’s CEO, envisions Feed as an operating system that allows fast-loading, personalized content from myriad sites that loads instantaneously, similar to Google’s AMP technology. He predicts that in just a few years, the open web will flow so quickly and seamlessly from page to page that we’ll stop thinking about web pages as standalone entities.
Meanwhile, Lemp, RevContent’s CEO, believes that creating a robust Facebook-like experience is essential, and that a feed isn’t enough. “I compare it to having your toddler get into his power wheel and have it go into a race on the street against a Tesla. They’re both electric cars, but the Tesla is going to win.”
Outbrain, while embracing the same feed principle as Taboola, is instead betting that the quality of the content makes all the difference—that the future lies in empowering publishers to create a better content ecosystem together, optimized for deeper engagement. Ultimately, a big part of that challenge is prompting publishers to think like marketers and focus on the lifetime value of users, instead of optimizing for revenue at the pageview or ad-unit level.
“The currency is going to graduate from being clicks and attention to lifetime value and loyalty,” said Crenshaw. “The Jeff Bezos line is to think about what won’t change, not what will change. What won’t change is publishers will always have to be thinking about what to show next–to create a guided journey for users.”
And if publishers are able to do that as well as Facebook, now that their romance with the social network is over? Well then, they might have found the perfect rebound: readers.
Joe Lazauskas is the the head of content strategy at Contently and co-author of The Storytelling Edge, a new book about the science of storytelling and how to use it to transform your business.
Microsoft is acquiring conversational AI startup Semantic Machines in an effort to make bots and intelligent assistants like Cortana sound and respond more like humans. Founded in 2014, Semantic Machines uses machine learning to make bots respond in a more natural way to queries. Semantic Machines is led by UC Berkeley professor Dan Klein and former Apple chief speech scientist Larry Gillick. Both are considered pioneers in conversational AI.
Microsoft’s acquisition will boost the company’s Cortana digital assistant, as well as the company’s Azure Bot Service that’s used by 300,000 developers. Microsoft has already used a human voice for its Cortana assistant. The software maker worked closely with Halo developer 343 Industries on the eyelike visual elements and voice actress Jen Taylor for the voice of Cortana back in 2014. “With the acquisition of Semantic Machines, we will establish a conversational AI center of excellence in Berkeley to push forward the boundaries of what is possible in language interfaces,” explains David Ku, chief technology officer of Microsoft AI & Research.
Google is also working on similar human-sounding AI. The search giant showed off its Google Duplex work earlier this month, which allows the Google Assistant to call businesses and book hair appointments or restaurants on behalf of Google users. Google’s demonstration opened up a number of concerns over casual human speech and deeper concern over ethics. Microsoft has already had its own controversial problem with its own AI thanks to its racist Tay Twitter bot, so you’d imagine it will be very careful with whatever it develops from its acquisition of Semantic Machines.
Nokia ended speculation today that its Digital Health division could end up at Google or even Samsung. Instead, the wearable company will be sold to the co-founder of Withings and return to being an independent brand.