Oculus Quest Development

All Oculus Quest developers MUST PASS the concept review prior to gaining publishing access to the Quest Store and additional resources. Submit a concept document for review as early in your Quest application development cycle as possible. For additional information and context, please see Submitting Your App to the Oculus Quest Store.

Camera Calibration

Calibrate your camera for mixed reality capture using the PC Mixed Reality Capture Tool and the Mixed Reality Capture Quest App.

This guide will enable your Quest to create an in game camera that’s matched to the location of your real world camera when you’re in a mixed reality capable app. You’ll use this in game camera to later send video to Open Broadcaster Software to create the mixed reality effect.

For best results we recommend that you have your room set up in the way that you will use for mixed reality capture.

If you have not done so already, download the MRC Tools for Oculus Quest.

Before You Begin

Your Quest has a proximity sensor on the headset located between the lenses. You’ll need to make sure this stays covered during the calibration process, otherwise your Quest will think you’ve taken it off and go to sleep. You can either cover this with a piece of tape, your finger, or keep your Quest sitting on your forehead.

Make sure both your Oculus Quest and PC used in the MRC capture process are on the same WiFi network.

Calibrate the Camera

This process will configure your camera and Quest for mixed reality capture, transmit the necessary data to your headset, and get you ready to stream your capture in Open Broadcaster Software.

Do not move the camera once you begin this process.

If you haven’t already, install the Mixed Reality Capture Tool installer to your PC.

  1. Launch the Mixed Reality Capture Tool on your PC and click Get Started.
  2. Click Agree to accept the MRC License, Privacy Policy, and Oculus Terms of Service.
  3. Select the Quest, then click Continue.
  4. Find the IP address of your Quest and enter into the text area. This will enable the Mixed Reality Capture Tool to connect with your Quest.

Note: If you haven’t installed the Mixed Reality Capture App on your Quest, click on the here link in the PC app. This will take you to page where you can “purchase” the app by clicking the Free button. Put on your headset and go to the Not Installed section of your Library. Install the app.

Launch the Mixed Reality Capture App on your Quest. Note the IP address that appears.

Type this IP address into the text field in the Mixed Reality Capture Tool on your PC and click Calibrate Your Camera.

  1. After you’ve connected to your Quest, select your camera from the dropdown and click Start Calibration.
  2. Calibrate your camera. To calibrate, match your Right Touch Controller to the image of a controller shown on screen. When the real controller and the virtual controller align on screen, and the virtual controller turns blue, pull the trigger. You want to match these as closely as possible, this will determine how accurate the real and virtual controller sync is. You will do this 10 times. The first two matches determine the Field of View (FOV), the next four matches determine the X,Y,Z values, and the final four determine the pitch, yaw, and roll of the camera.
  3. When you have matched all 10 points, you will see a preview with adjustment sliders. Hold your controller up to the camera, and you will see a blue virtual controller matched against it.

Use the sliders to make any necessary adjustments.

If you’re unable to get a satisfactory match, you can click Restart Calibration to start over. When you are satisfied, select Save to Headset.

  1. Finally, verify that Open Broadcaster Software (OBS) is installed and that the Mixed Reality Capture Plugin is copied into the right OBS folder. You’ll need this plugin for OBS to communicate with your Quest and receive video from it.

If you haven’t done it yet, click on the in-app link to download and install OBS.

If you haven’t added the Mixed Reality Capture plugin to OBS, go to the folder where you downloaded the Mixed Reality Capture PC tool. Find the folder called Mixed Reality Capture Plugin. Copy the folders inside, then navigate to where you installed OBS (in Program Files). Paste the folders you copied into the top of the OBS Studio folder.

If this is your first time using the tool, you will also need to select Generate Scene Collection. This saves a JSON file on your computer that you will use in OBS. Remember where you saved the file, you’ll need it later.

When you’re done, select Finish. It’s now time to launch OBS.

Got to Composite the Scene for further instructions.

Troubleshooting

  • If your controller doesn’t seem to respond to trigger pulls while calibrating, make sure the on screen controller is blue. This means your Quest is on, the calibration app is active, and your Quest can track your physical controller.
  • If your Oculus Quest reports that it is unable to find Guardian. Try restarting the Quest to find a previously created Guardian. If you have to create a new Guardian, repeat the calibration steps on this page.
  • If your Guardian drifts too much (usually after a few loss/recovery of tracking) repeat the calibration steps on this page.
  • If you cannot connect your Quest and PC tool, check that you are on the same Wifi network for both. Also, if you have any antivirus software running, you may need to disable the firewall as it can block the tool from connecting.