Mixed reality capture places real-world objects in VR. In other words, it mixes images from the real world with the virtual one. Oculus mixed reality capture is designed for developers, marketers, and influencers to share an intimate VR experience with viewers. By placing yourself and others in a VR scene, you can more effectively demonstrate the interaction between the user and virtual world.
This guide applies only to Mixed Reality Capture for Oculus Rift and Rift S. See the Mixed Reality Capture Setup Guide - Oculus Quest guide for MRC capture on Oculus Quest.
This guide details the setup for Rift and Rift S. The process varies between the headsets due to the different tracking systems. We’ll note these differences.
Mixed reality capture is only available for select applications.
Mixed reality capture uses an external camera to capture real-world images, against a green-screen, and combine them with a scene generated by a VR application to create a single blended scene. A user can then interact with the VR scene, and a video can be created that shows the user’s interactions in the real-world overlaid on the VR experience
Before any calibrations, configuration, or implementation, you’ll need a PC and camera that meet the performance requirements of mixed reality capture. Review the System Configurations page some general hardware guidelines. Similarly, the Room and Sensor Setup page contains information about the room and sensor setup for use with mixed reality capture. These are not required configurations, but are provided as guidelines when setting up your room for mixed reality capture. Review the guidelines for creating a safe use environment in the Health and Safety warnings located at https://www.oculus.com/legal/health-and-safety-warnings/.
There are two steps to capturing mixed reality capture scenes. Setting up your external camera and a VR Object, and compositing the final scene.
First, you need to decide if you’ll be using a static or dynamic camera to capture the scene. Static cameras will only give you a single unmovable view in the scene, while a dynamic camera, a camera that you’ve associated with a VR Object, allows you to move the camera around in the scene. If you use a dynamic camera, you’ll start by creating the VR Object. This object, a Touch controller, tracks the position of the camera in relation to the VR scene. Information about creating a VR Object is found in the VR Object Setup. You may skip this step if you’re planning to use a static camera. The next step is to calibrate your external camera to capture the real world images. The calibration process removes image distortion and determines the depth and position of objects captured in the scene. Information about calibrating the camera is found on the Camera Calibration page.
Once you’ve finished the setup and configuration, you can launch the mixed reality capture capable app and composite the final scene together. Please review the Launch the App and Composite the Scene page for information about this process.
Non-Oculus equipment/service references are not recommendations, guarantees, or endorsements of products or performance. Your results may vary. These are instead options to vary your own customized experiences. Furthermore, incorrect installation or use of any products or items can damage your computer, space, or otherwise impact performance. If you’re not experienced or qualified to do so yourself, please seek assistance.