More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

More results...

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Under Construction
Face Animation Importer (iClone plugin)

I have an iClone plugin – FACE ANIMATION IMPORTER – for iClone 8.

It is the only way to currently IMPORT facial animation into iClone!

The plugin is available in Lite and Pro versions on the Reallusion iClone Plugin Marketplace

 

Why buy the Pro version?

The Pro version includes an automatic fix for ‘overdriven Blendshapes‘. These are the problems caused by MetaHuman Animator Blendshape weights being applied to the iClone face and overloading it, causing parts of the face to distort.

IMPORTANT: Please note that no solution to the ‘overdriven Blendshape’ problem is going to be perfect – the MetaHuman face is VERY different to the iClone/Character Creator face! The PRO version is my best attempt at fixing the issue and has great results most of the time.

How to use the Plugin

Step 1/2. Record Face Mocap

  1. Use an iPhone 11 or higher. (iPhone 12 or higher is recommended by Epic Games for best results.)
  2. Install the ‘LIVE LINK FACE’ app from the App Store.
  3. Use ‘LIVE LINK FACE’ – set to METAHUMAN ANIMATOR mode – to make a calibration recording and a performance recording, transfer the result to your PC. For full recording instructions, click here.
  4. On your PC, use an audio program like AUDACITY to convert the movie file to a WAV file (16-bit or 8-bit, NOT 32-bit float).
  5. Create an UNREAL EDITOR project and import the MetaHuman Animator recordings, then export a CSV using the special script. For full import and processing instructions, click here.
  6. Finally, follow the instructions below (‘Step 2. Import into iClone with FACE ANIMATION IMPORTER’) to import the result into iCLONE using the ‘FACE ANIMATION IMPORTER‘ plugin.

  1. Use an iPhone 11 or higher.
  2. Install the ‘LIVE LINK FACE’ app from the App Store.
  3. Use ‘LIVE LINK FACE’ – set to ARKIT mode – to make a calibration recording and a performance recording, transfer the result to your PC. For full recording instructions, click here.
  4. On your PC, use an audio program like AUDACITY to convert the movie file to a WAV file (16-bit or 8-bit, NOT 32-bit float).
  5. Finally, follow the instructions below (‘Step 2. Import into iClone with FACE ANIMATION IMPORTER’) to import the result into iCLONE using the ‘FACE ANIMATION IMPORTER‘ plugin.

Step 2/2. Import CSV into iClone with ‘FACE ANIMATION IMPORTER

  1. Open iClone 8 with a fresh new project.
  2. Add a CC4 character to your scene (ie. CC4 Camila, CC4 Kevin or CC4 Susan).
  3. Go to the top PLUGINS menu, hover over FACETASKER then click ‘FACE ANIMATION IMPORTER‘.
  4. Choose a format from the drop-down menu.
  5. Select your CSV and, optionally, a WAV file with your audio.
  6. Click “Import Facial Animation“.
  7. Once it finishes importing, it will say something like “Success! An expression clip has been added to your character”.
  8. Close the plug-in.
  9. In the iClone Timeline, make sure to turn on visibility for two tracks for your character: the Expression track and the Sound track:
  10. Now click and drag the SOUND clip to the left or right, until it’s in perfect sync with the mouth movements. (Sometimes you need to move the sound clip 15 frames to the right, but it varies depending on your iPhone.)

Why do my facial movements look strange??

If you’re using the LITE version of the plugin, your facial movements might look quite strange due to ‘overdriven Blendshapes‘. That is, the values that the MetaHuman face animation has are WAY too strong or are in combinations that ‘break’ the iClone/Character Creator face.

Use the built-in CURVE EDITOR in iClone 8 to fix these overdriven keyframes. Or use the PRO version of the plugin, which has a complex algorithm to correct these problems.

IMPORTANT: Please note that no solution to the ‘overdriven Blendshape’ problem is going to be perfect – the MetaHuman face is VERY different to the iClone/Character Creator face! The PRO version is my best attempt at fixing the issue and has great results most of the time.

 





LATEST UPDATES






© Seabridge Films 2024. No warranties are made for the accuracy of content on this website. For educational purposes only. Please do not reproduce, in whole or in part, any resources in this website without express written permission.

Use of code from this website, including scripts and Python-based plugins, is at your own risk.