iFacialMocap

iFacialMocap allows you to capture facial expressions in an iOS app and communicate in real time with 3DCG software on your PC. You can also do an FBX export by email.PC-side software allows you to import VRM models.

To export FBX, turn on the REC mode and record. And when you press the mail button, the version selection screen of FBX appears, and when you press the OK button, the FBX file is saved in the File folder and the mailer starts.

Detailed usage is available at the following URL:

https://ifacialmocap.com/

This app can create face animations by communicating with Maya, Unity, 3dsMax and Blender in real time. In addition, animations created in real time can be baked.

This app can load VRM avatars within the iOS app. In addition, this app is linked with VMagicMirror on the PC and VRM related apps such as Luppet and HANA_APP.

To use, first start this app, then start "iFacialMocap to SoftWare app" on your PC and enter your iPhone's IP address.

(Donwload from PC use :https://ifacialmocap.com/download/

)

Next, create up to 52 morph targets (BlendShape or ShapeKey) according to the naming convention.

Finally, use 3DCG software to load the script / add-on and press the connection button.

Very accurate facial motion capture can be performed very easily.

This app is only available for models equipped with FaceID. The camera image and resulting depth data are only used to send motion capture data to the user's PC. That data is not stored in the iPhone. To get depth data from Apple's API, access to the camera is required.

This application is only used for communication with PCs within the same network and does not send information to third parties.

This app can only be used on iOS devices equipped with FaceID.

Supported devices are as follows：

・iPhone

iPhone13 mini

Phone13 Pro Max

iPhone13 Pro

iPhone13

iPhone12 Pro Max

iPhone12 Pro

iPhone12

iPhone 11 Pro Max

iPhone 11 Pro

iPhone 11

iPhone XS Max

iPhone XS

iPhone XR

iPhone X

・iPad

iPad Pro 12.9-inch (5th generation)

iPad Pro 12.9-inch (4th generation)

iPad Pro 12.9-inch (3rd generation)

iPad Pro 11-inch (2nd generation)

iPad Pro 11-inch

* Face ID is not installed in the new iPhone SE 2nd generation released in 2020, but you can use iFacial Mocap by updating to iOS 14 or later. Not limited to iPhone SE 2nd generation, iFacial Mocap can be used if it has an A12 or higher chip and has been updated to iOS14.