This website uses cookies to improve our services and deliver relevant ads.
By interacting with this site, you agree to this use. For more information, see our Cookies Policy

Archived Documentation

This version of the guide is out of date. Click here for the latest version.

Exploring Oculus Lipsync with the Sample Scene

To get started, we recommend opening the supplied demonstration scene LipSync_Demo, located under Assets/Oculus/LipSync/Scenes. This scene provides an introduction to Oculus Lipsync resources and examples of how the library works.

Using the LipSync_Demo scene

You can switch models between a geometry morph target and a texture flip target, and also switch between microphone and our provided sample audio clip using the following controls:

Keyboard Controls
Key	Control
1	Select Morph target, Mic input (default).
2	Select Texture Flip target, Mic input.
3	Select Morph target, Audio Clip.
4	Select Texture Flip target, Audio Clip.
5	Select Morph target, Precomputed Visemes.
6	Select Texture Flip target, Precomputed Visemes.
L	Toggle loopback on/off to hear your voice with the mic input. Use headphones to avoid feedback. (default is off).
D	Toggle debug display to show predicted visemes
<left arrow>	Rotate scene object left
` (backtick)	Add 100% activation to "sil" viseme on geometry morph target
Tab through \ (QWERTY row of a US keyboard)	Add 100% activation to "PP" through "ou" visemes on geometry morph target
<right arrow>	Rotate scene object right

Action	Control
Swipe Down	Decrease microphone gain (1-15).
Swipe Up	Increase microphone gain (1-15).
Swipe Forward / Swipe Backward	Cycle forward/backward through targets: Morph target - mic input Flipbook target - mic input Morph target - audio clip input Flipbook target - audio clip input Morph target - pregenerated visemes Flipbook target - pregenerated visemes Audio clip input plays automatically.
Single Tap	Toggle mic loopback on/off to hear your voice with the mic input.

To preview the scene in the Unity Editor Game View:

Import and launch LipSync_Demo as described above.
Play the LipSync_Demo scene in the Unity Editor Game View.

To preview the scene with a Rift:

Import and launch LipSync_Demo as described above.
In Build Settings, verify that the PC, Mac & Linux Standalone option is selected under Platform.
In Player Settings, select Virtual Reality Supported.
Preview the scene normally in the Unity Game View.

To preview the scene in Gear VR:

Be sure you are able to build and run projects on your Samsung phone (Debug Mode enabled, adb installed, etc.) See the Mobile SDK Setup Guide for more information.
Import and launch LipSync_Demo as described above.
In Build Settings:
1. Select Android under Platform.
2. Select Add CurrentsScenes in Build.
3. Set Texture Compression to ASTC (recommended).
In Player Settings:
1. Select Virtual Reality Supported.
2. Specify the Bundle Identifier.
Copy your osig to <unity-project>/Assets/Plugins/Android/assets.
Build and run your project.

Note: In order to select targets, change mic input level, and so on. for Gear VR, you will need a compatible Bluetooth keyboard. If you do not have one available, you can experiment with these changes in Unity Game View.