Hey Where Are We Going?: Movement in VR

One of the fastest ways to gain or lose a viewer’s interest when watching your VR film or video is through camera movement. Here are a couple of quick tips to smooth things out and keep going forward.

Grounding

In most VR videos, whether it’s 180 degrees or 360 degrees, the viewer enters the viewing space from the camera’s perspective. Meaning that they, the viewer, are the camera. So if you move the camera in unnecessary or unpredictable ways you can make the viewer uncomfortable and lose their attention. A good tip for avoiding this is grounding them. For instance, if the viewer is suddenly flying thousands of feet above the Earth, it is helpful for them psychologically to see a normalized reason for that vantage point. If they look up and see that there is a parachute over their head, they suddenly have a greater sense of understanding as to what they are doing in flying through the air and what a reasonable explanation would be to happen next. At some point they will likely land.

Camera Shake

VR is particularly unforgiving when it comes to shakiness. With some cameras or on some headsets, this can even make a viewer sick to their stomach. Trying to keep the camera stable whenever possible is an important element to keeping the viewer engaged. If there is shakiness, you should try to limit it when possible and have a good reason for it. Which brings us onto our next tip….

Give Me A Reason To Move

Though it might be implied in the other two tips, let’s just say it right here; the camera should have a reason to move if you are moving it.

If the viewer feels like they are the camera, if you move them without warning or reason, it feels forced and unnatural and will likely not be very well received. However, if you move the camera steadily in a space that it (the viewer) would move through the scene naturally, then you are likely to have a more successful scene. For instance, putting the camera on a boat or a car (or in the last example, hooked to a parachute) then the viewer has a reason to move. You can also give the viewer a reason to move if they are following the action in the scene, like walking with a group of people if they are there. Even in this instance, implementing steadiness and normal feeling speed or movement are the baseline for a comfortable viewing experience.

As with all “rules,” these too can be broken. But this should be done intentionally and with an understanding of how you want the viewer to feel while watching the scene.

Critical Impact on a Viewer’s Virtual Reality Experience: 360 2D Vs. 3D Cameras

How the Differences in Building 360 2D Vs. 3D Cameras Will Shape VR Adoption?

The definition of Virtual Reality has been evolving over the last couple years. While we are all clear about what a VR headset is and what it needs to do, people often are confused about what VR cameras should be able to do. Is it 360° or 3D or both? There is clearly a hype around 360° 2D consumer cameras right now, but the wave of 3D cameras is not far behind. However, to bring more clarity around why 3D is still behind, this article should explain some of the differences and especially challenges which make building 3D cameras much more difficult than a 360° 2D camera.

2D vs. 3D 360°: More than Just a Couple Lenses

First of all, the amount of camera modules and lenses needed to do 2D 360° is at a minimum two and can go up to four, but 3D needs way more than that. If you imagine that capturing 3D in one direction can only happen with at least two lenses – as we reproduce what a human eye can do in stereo – then you will understand that the most you can achieve in 3D with two wide angle lenses is 180° through and with six lenses is 360°. It is possible to create 360° 3D with four lenses, two facing one direction and two facing the opposite, but then you are sacrificing the sides which will be only in 2D. Many 3D cameras use eight or more lenses to create 360° 3D, because the more lenses you use the better resolution you can achieve with stitching.

csuckyexwdnwkvd2cni0

A 360 3D camera system

 

Straightforward Vs. Additional Alignment: Manufacturing 2D and 3D

Second, 360° 2D cameras have a more straightforward manufacturing process than any 3D camera for Virtual Reality. In the assembly, two lenses are mounted on sensors back to back, and the key step is the mechanical calibration to precisely align them. However, 3D VR cameras have to go through the same step in manufacturing, but then add an additional software calibration process which guarantees a perfect 3D experience. Every single 3D camera has to go through that process in order to generate 3D data necessary for playback.

 

14720425_1772791419626962_8359529628630914869_n

A LucidCam production unit

 

Stabilizing Multiple Points: Image Processing in the 2D vs. 3D

Finally, image processing needs for 3D cameras are much higher than for 360° 2D cameras because of stabilization, high dynamic range and calibration. For 360° 2D, you need the stitching software to combine the two lenses, and that happens mostly in real-time. However, for 3D cameras, you need more than just stitching, since you always have two reference points which you need to consider instead of one like in 2D. That means when you stabilize 3D, you are not stabilizing one point, but multiple points in differently shaking images. It can create a huge challenge, as for a perfect 3D effect and depth, you would need to keep the reference points at the same distance. Another impact is on the high dynamic range between two lenses capturing with a slight offset.

Even though you are recording the same direction, the light might be different due to the offset of the lenses. Besides those two you have to also deal with calibration which we briefly discussed above, but not just in manufacturing. What happens when the camera falls on the floor and the lenses get misaligned?

Those are just a few reasons why building 3D cameras is so difficult and needs time to get right. The smallest error can cause a huge impact on the viewer, leaving behind an experience which keeps people away from ever adopting Virtual Reality. Therefore, ramping up 3D cameras have taken an incredibly long time compared to all the 2D 360° cameras in the market. All we can hope is that the computer vision technology for 3D keeps getting better and better over the next couple years to finally take true VR content to the next level.

 

13886998_1740837016155736_2957138012620034834_n

Calibration of 3D from two lenses is challenging

 

Consumer Insights of 360 VR cameras

 

360-camera-comparison-680x383

360 VR Cameras landscape. Image courtesy of http://www.roadtovr.com

In the last couple of months, many Virtual Reality cameras have come to market which try to put content creation into the hands of consumers. However, sales of these VR cameras have been only moderate with the Ricoh Theta and Samsung 360 leading the pack. Because the unexceptional sales volume surprised us, we have collected the feedback to see what is holding down the pace of purchase.

Most consumers who bought a 360 VR camera mentioned that the big thrill in owning a VR camera  frequently faded after a few weeks, and after only using it a couple of times. This feedback was consistent and widespread and really surprised us because purchasing a VR camera is not only expensive but also requires time and effort to learn how to operate. Therefore we looked carefully at the user experience, storytelling and day-to-day integration to try to determine why consumers are not completely satisfied.

The first barrier is simply getting consumers ready to actually make a purchase. When consumers enter a retail store like Best Buy and walk past the unusual  ball-shaped camera devices, at first glance it does not quite resemble a camera at all, and it’s not very intuitive in terms of how to hold it and see what it captures. The biggest difference between a techie and consumer is the amount of effort he or she is willing to put in to learn a new technology. While a techie would spend hours researching and learning how to operate a 360 VR camera, the average consumer is more impatient and wants the device to directly function. Since the 360-degree camera capture experience is completely different from traditional digital cameras, there is just no obvious reference point for a consumer to know how to easily use it.

The second barrier to purchase or use is related to the 360 content itself which is very different from what consumers are used to — the 16:9 frame. With 360 degrees you pretty much capture everything, meaning you have no option other than to include things you want and things you do not want in the frame. This raises two more problems. First, consumers like presenting themselves from their best side and in the best light, but now they no longer can control that because it would take too much effort to make sure all 360 degrees look great. Second, consumers like telling a story by framing the perfect moment, and now they have to find other ways to direct the viewer’s attention. Given these challenges, it makes more sense that most 360 VR cameras are bought by professionals now. They either have the time and resources to stage 360 degrees or know the ins-and-outs of storytelling with sound and movements in 360 VR.

Lastly, portability and ease of carrying is a huge factor for consumers. Most of today’s pictures and videos are taken with smartphones because it fits into what you are already carrying like your phone in your pocket. However, 360-degree cameras are normally the size of a ball which often does not quite fit into your pocket and requires a bag or a mount in order to carry them around.

The only one which does fit is the Ricoh Theta which is almost the size of a smartphone, but still needs to be connected through wifi to a phone. The best integrated solution would be a 360-degree camera embedded into a smartphone, but since today we don’t want to buy thick or bulky phones, it would have a huge impact on the design of the smartphone.

360-degree Virtual Reality cameras are a great invention, but their value add compared to a standard panorama shot by a smartphone is small compared to the price you pay. We do not know if 360 VR will hit mass consumer adoption, but we know that professional videographers and content creators love capturing and developing commercial experiences with it. Therefore we believe that consumer adoption of 360-degree cameras will be way behind actual 360 content produced for commercialization.

Han Jin
Founder & CEO – Lucid VR
Check out Lucid Cam at http://www.lucidcam.com

Why 3D cameras will finally take off

For decades humanity has experimented with binocular cameras, trying to reproduce the same sight we have in 3D. One of the first 3D cameras, Verascope f40, came out in 1938. But why hasn’t everybody gotten their own 3D cameras these days to capture their experiences—just as they have with their GoPros?

http://collectiblend.com/Cameras/Richard-Jules/Verascope-F40.html

Verascope f40 – one of the very first 3D cameras. Photo courtesy of Collectiblend.com

Three major reasons have kept 3D cameras from mass adoption:  availability of viewing devices; sociability of 3D content; and the maturity of 3D technology.

First, until recently the only way to watch 3D content had been through an expensive 3D TV or a side-by-side view-master. As the Virtual Reality industry has ramped up and more head mount displays saturate the market, viewing 3D content has become easier than ever.  Today viewing videos or images captured with 3D cameras or even VR cameras is possible not only on an expensive HTC Vive or Oculus Rift, but also on anybody’s mobile phone with a Google Cardboard. This has drastically increased the devices available for viewing 3D content.

Google Cardboard allows many people to have the first experience with VR.

Google Cardboard allows many people to have the first experience with VR.. Photo courtesy of slashgear.com

Second, capturing 3D content and viewing it on a 3D TV would allow you, your friends and family to view it, but sharing it with someone remotely or exciting someone to jump into 3D content creation was not possible. Although Virtual Reality, especially mobile VR, allows you to transfer and watch 3D content easily, it is still an isolated experience. However, when you consider that a 3D TV costs thousands of dollars, you now need only a mobile phone and low-cost Google cardboard to view 3D content. And as I believe that VR headsets will replace mobile phones in the future, the options to consume content created by 3D VR cameras will exponentially increase.

Lastly, one of the challenges 3D technology faces, especially 3D displays, is the angle from which the person watches the video on the screen. If you are not standing directly in front of the screen at a 90° angle, the 3D effect does not work and can cause people to feel uncomfortable viewing it. Many companies have tried to make VR content viewable for everyone. Solutions range from shifting screens to segmented depth calibrations to eye tracking paired with customized playback. However, none of these technologies can currently ensure a comfortable and fast viewing experience for 3D content. This is another area where Virtual Reality headsets provide a much easier solution by literally mounting the screen directly before your eyes and using an accelerometer to adjust the display as you move your head. The additional data coming from the accelerometer provides the feedback needed to directly adjust the 3D, making it comfortable to watch. As VR technology matures, 3D playback will continue to improve.

Affordable and sophisticated VR Headset will improve consumers' experience with VR and bring it closer to the mass.

Affordable and sophisticated VR Headset will improve consumers’ experience with VR and bring it closer to the mass.

As we have seen, Virtual Reality can finally provide a scalable platform for 3D content which was never possible before. The more VR is adopted in the coming years, the better the solution for viewing, sharing and displaying 3D content created with 3D cameras. As the VR market becomes saturated with head mounted displays, the market will not be satisfied with purely 2D 360° content, but will demand more and more true 3D content, thus giving 3D cameras the chance to come back from its prematurely-announced demise.  

How about you? What is your opinion on 3D camera?

Han Jin
Founder & CEO – Lucid VR
http://www.lucidcam.com