While many of the virtual reality experiences being shown off at the 2017 Tribeca Film Festival are pushing boundaries in VR story-telling techniques, “Hallelujah” is perhaps most noteworthy because of the cutting edge tech used to shoot the experience and the story behind it.
Lytro has been around for eleven years; raised over $210 million from Silicon Valley’s top investors including Andreessen Horowitz, Greylock Partners and NEA; and yet this VR music video represents the startup’s public-facing square one as it executes on a pivot it’s been building up for the last two years. It’s all designed around Lytro’s core technology called “light field capture.”
True light field capture technology is confusing to pin down with a simple definition but one of the things it can enable is a bit easier visualize: realistic live action spaces that users wearing virtual reality headsets can explore. You can do some of this in today’s game engine-built VR titles, but with light field tech, the real world can be captured in 3D space as it moves, with a realism that can’t be oversold.
It’s a decidedly empowering experience that will likely soon make Lytro’s VR product, Immerge, among the most-desired tools for creatives looking to create high-end VR content.
The technology behind the Within-produced “Hallelujah” is a technical feat for the Mountain View-based Lytro but it’s perhaps also proof that the venture-drenched startup hasn’t been all that unhinged in betting so heavily on light field tech.
Lytro was founded more than a decade ago, and has, for much of that time, been an ahead-of-its time technology in search of a problem to solve, all while burning through quite a bit of cash.
The startup focused the bulk of its early efforts on consumer-focused light field cameras that allowed users to — among other things — retroactively change the focus of their shots. The cameras were interesting and undoubtedly innovative but were hampered by their niche audience, price and the free falling nature of the larger consumer camera market. In 2015, the company announced it was laying off 25-50 of its 130 employees and was abandoning consumers to pivot to VR.
Fast forward a couple of years and the company is still taking risks as it looks to find the future its technology fits into. A few months after announcing development on its VR-centric camera, the company announced Lytro Cinema, an almost comically large filmmaking camera that sports the highest resolution video sensor ever made capturing as much as 400 gigabytes per second.
The virtual reality rig used to shoot “Hallelujah” also comes with a massive form factor; Lytro’s VR Immerge camera is a hulking, data-hungry, hexagonal device made up of an array of 95 individual cameras. The massive size of the hardware is directly proportional to the amount of space that users can walk around. Essentially, if the camera can’t see the…