Samsung is collaborating with Oculus VR to create a virtual reality headset for its flagship phones. Oculus will develop the software for the product and Samsung the hardware, but the deal will allow Oculus access to Samsung’s new OLED screens, which is a major success for the business. Samsung may also become the first VR headset to reach the consumer market ‘ beating out both Facebook’s own Oculus and Sony’s Morpheus.
The biggest complaint about the Oculus Rift headset, other than the motion sickness that some people suffered, was the low resolution screens that were used in the earlier models. Many felt that the visible pixels broke the immersion of the experience, with some complaining that even the new 720p screens were still plagued by this problem. The issue lies in using the panel only a few inches from the eye ‘ and that is an area in which Samsung may prove very helpful.
The Galaxy S5 has a 5.1 inch 1080p screen, and some Samsung devices are reported in the production pipeline featuring a 1440p display, most notably the widely rumored 5.7 inch Galaxy Note 4. The Rift is still not a consumer product, so there is a good chance that these panels may find their way into the later editions as a result of this collaboration, but the Samsung headset will be very different from the Oculus Rift for one reason ‘ cost.
If Samsung wants its headset to be a value-add complementary product to its handsets, the headset needs to be affordable. The Rift is being targeted at hardcore gamers, the kind who will happily spend $800 on the latest gaming monitors and build computers costing thousands of dollars ‘ all for the incremental boosts to their performance. But the Samsung device needs to appeal to the consumer who has a Samsung handset as part of their monthly mobile subscription, the kind of consumer who would baulk at a triple figure price tag. Fortunately, the mobile phone is well-positioned in this regard.
Firstly, the phone itself can provide all the processing power and hardware needed if it simply slots into a passive headset that adds lenses to produce a 3D image from the 2D screen. In this slot configuration, the phone contains all the tracking and processing functions, meaning that it can be simply plugged into the headset. This negates many of the other problems that Oculus encounters.
The Rift is a wired unit that needs to be plugged into the user’s computer, which is running and rendering the video game. It also requires a pair of headphones for sound but most significantly it needs a tracking system that is set up in the room to track the movements of the user’s head. This is because early versions of the Oculus tracked the user’s head movement from the headset itself, before conveying that information to the computer to adjust the image shown on the screen. This introduced a disorientating lag that induced motion sickness in many users. Oculus countered this by introducing IR LEDs and a tracking camera that helped reduce the lag and solve the sickness issue for many users.
But this still means that an Oculus headset requires a cable out to an external power source, a cable out to the external processing unit (the PC), an external head tracking system (which is currently trying to resolve the problem of tracking the user when the headset is not facing the camera, such as when the user has turned around in the course of playing the game) and a large amount of cash to buy the unit.
By putting all of this functionality into the mobile phone, Samsung is poised to produce a headset that solves all of the problems that the Rift is currently suffering ‘ and as far as we can tell, all it needs is an app on the phone and a pair of lenses held in place with some plastic and an elastic strap.
But functionality can be moved from the phone to the headset if needed. Accelerometers in the headset might also provide better tracking than just the ones found in the phone, and batteries in the headset would extend the phone’s battery life. A wireless solution with onboard power opens this headset up to virtual arenas (think digital paintball) that would require only a central server (which could even be offloaded to the phones themselves) and a digital map of the venue. Adding a wired power requirement kills this massive opportunity and really should be avoided if Samsung wants to become a viable first-to-market product that can be used outside the home ‘ something that Oculus can only hope to achieve by adding a battery-filled backpack, only adding to the cost and bulk.
But we’ve now reached the elephant in the room ‘ graphics horsepower. Mobile GPUs are leagues behind the graphics cards used by the Rift currently, which recommends the ability to play current generation 3D video games at 1080p and 75fps. Those performance figures are actually higher than the new generation of consoles, which aim for 30fps and 60fps targets for 720p and 1080p content, and are not attainable by the GPUs currently found in smartphones.
So the elephant has trampled over the dream of digital paintball, with added VR explosions and aliens. The phone will simply not have enough onboard graphics processing grunt to render a bleeding-edge photorealistic environment. Streaming the rendered picture to the phone is an option, but would require external or cloud processing that introduces additional costs at some point in the chain that would have to be passed on to the consumer ‘ something that doesn’t make sense for the value-add product which the Samsung unit is likely to be.
This means that the phone could power less visually-demanding games and environments. The popularity of mobile gaming might be enough to draw in users looking to add to the experience, although we don’t anticipate users enjoying VR Candy Crush during their commute. But previous generation console games could be ported to the mobile, and current generation mobile games will obviously be suitable. Again, the phone could stream the externally rendered video from another device, which is especially likely if the headsets are ever used in the above digital paintball example. A server is ideally placed to render and configure the clients in the real-world arena, reducing the strain on the phone’s battery.
However, the sources that leaked the story say that Samsung is primarily focused on creating a media device to allow users to view video content ‘a much less intensive GPU task for the device. Similar approaches have been explored with the Rift, the most popular example implementation being a virtual tour of a foreign country for elderly users unable to travel. Other use cases could include augmented reality real estate tours, VR product demos and immersive video chats ‘ even as a tool for treating PTSD and training medical workers for difficult operations.
But we need to look no further than having a truly high quality portable personal screen for watching video to be the killer app for this device.