Exploring Oculus Lip Sync with the Sample Scene

To get started, we recommend opening the supplied demonstration scene LipSync_Demo, located under Assets/OVRLipSync/Scenes. This scene provides an introduction to OVRLipSync resources and examples of how the library works.

How to use LipSync_Demo:

You can switch models between morph target (our human avatar) to a texture flip-book target (a robot avatar), and also switch between microphone and our provided sample audio clip using the following controls.

Keyboard Controls
KeyControl

1

Select Morph target, Mic input (default).

2

Select Flipbook target, Mic input.

3

Select Morph target, Audio Clip.

4

Select Flipbook target, Audio Clip.

5

Select Morph target, Precomputed Visemes.

6

Select Flipbook target, Precomputed Visemes.

L

Toggle loopback on/off to hear your voice with the mic input. Use headphones to avoid feedback. (default is off).

<left arrow>

Decrease microphone gain (1-15).

<right arrow>

Increase microphone gain (1-15).

ActionControl

Swipe Down

Decrease microphone gain (1-15).

Swipe Up

Increase microphone gain (1-15).

Swipe Forward / Swipe Backward

Cycle forward/backward through targets:

  1. Morph target - mic input
  2. Flipbook target - mic input
  3. Morph target - audio clip input
  4. Flipbook target - audio clip input
  5. Morph target - pregenerated visemes
  6. Flipbook target - pregenerated visemes

Audio clip input plays automatically.

Single Tap

Toggle mic loopback on/off to hear your voice with the mic input.

To preview the scene in the Unity Editor Game View:

  1. Import and launch LipSync_Demo as described above.
  2. Play the LipSync_Demo scene in OVRLipSync > Scenes in the Unity Editor Game View.

To preview the scene with a Rift:

  1. Import and launch LipSync_Demo as described above.
  2. In Build Settings, verify that the PC, Mac & Linux Standalone option is selected under Platform.
  3. In Player Settings, select Virtual Reality Supported.
  4. Preview the scene normally in the Unity Game View.

To preview the scene in Gear VR:

  1. Be sure you are able to build and run projects on your Samsung phone (Debug Mode enabled, adb installed, etc.) See the Mobile SDK Setup Guide for more information.
  2. Import and launch LipSync_Demo as described above.
  3. In Build Settings:
    1. Select Android under Platform.
    2. Select Add CurrentsScenes in Build.
    3. Set Texture Compression to ASTC (recommended).
  4. In Player Settings:
    1. Select Virtual Reality Supported.
    2. Specify the Bundle Identifier.
  5. Copy your osig to <unity-project>/Assets/Plugins/Android/assets.
  6. Build and run your project.
Note: In order to select targets, change mic input level, and so on. for Gear VR, you will need a compatible Bluetooth keyboard. If you do not have one available, you can experiment with these changes in Unity Game View.