SamuKata
cebstudios

cebstudios

patreon


cebstudios posts

Script to import Avatary FaceMocap in Blender as Shapekeys

Script to import Avatary FaceMocap in Blender as Shapekeys

This script helps you to import in blender the meshes created with Avatary Autoface.It will get all the objs generated and create a single mesh with all objs as shapekeys, so you can create the handles and use it with FaceGood facial mocap system.


You can download Facegood software for free at View Post

AnimMotion and Some explanations

Sorry for the lack of update, let me explain what is happening and the ideas I'm working on.

Probably you have seen that I released the AnimMotion open beta.
This addon aims to make animation extremely simple, but, it's not an easy one to create.

The programming part seems to be the easiest part at the moment.

What is tak...

View Post

Mocap Import beta 0.76

Fixed a problem that if you didnt have opencv2 or medipipe installed, you wouldnt be able to open the addon.

And added an option to install opencv2 from the addon.


Attention.

If you try to install mediapipe and it doenst work, try closing blender and open it as ADMINISTRATOR, and try to install mediapipe again.

View Post

AnimMotion Beta 0.10 OpenBeta

AnimMotion Beta 0.10 OpenBeta

Here is how to install and how to use this new addon for blender that is in development.


To download it, please go to:

https://carlosedubarreto.gumroad.com/l/animmotion_ob

View Post

Dev Preview: AnimMotion new addon for animation in Blender

Dev Preview: AnimMotion new addon for animation in Blender

Here is a early test of a new addon in development.

This addon comes to make easy the creation of animation. This is done giving the user the ability to control the character like in a videogame, at the same time, the animation is recorded.


This will be a paid addon, that will be available for free for our patreons.

...

View Post

MOCAP Import beta 0.75

MOCAP Import beta 0.75

This new version brings a better UI, and a new method to use mediapipe, that should bring better conversion from video to an animated armature.


Besides that, you will also get an option to load a single video to convert, or to load a folder full of video files.

View Post

Facemocap test (Blender Motion Track, RBF and Shapekeys)

Facemocap test (Blender Motion Track, RBF and Shapekeys)

After watching the amazing new addon from Facegood/Avatary I saw that a similar approach could be done right inside of blender.

Link to Facegood/Avatary: https://www.avatary.cc/en/ 


Here is a test using only Blender.

What was don...

View Post

New and Amazing Facemocap Tool

New and Amazing Facemocap Tool

When looking at twitter I've found a post showing some amazing tech for facial mocap.

This tech was done by Facegood, a chinese company.


The post in twitter

https://twitter.com/Yokohara_h/status/142803124471...

View Post

Script to install Opencv and Mediapipe inside of Blender (Windows)

Script to install Opencv and Mediapipe inside of Blender (Windows)

You can download the file and open on the script tab inside blender, or copy the text and do like its show in the video

-----------------

import subprocess
import sys
import os

# path to python.exe
pyt...

View Post

Update on Development

It has been more than a week that I started the C++ development effort to create a better and custom mocap data creation tool.

But, C++ is not so easy like Python, and that's why I was not able to give much update on the work  I've been doing.


There is 2 sample videos I've done, that were after configuring all the env...

View Post

Addon development

Hello everyone.
I'm not posting about the development of mocap import addon, because I had to do a step back, to learn about C++ to go further on the addon development.

But soon I'll release an update to the addon with the news things i released on the dev preview files.

View Post

Dev Preview: Mediapipe multi convert video to mocap

Dev Preview: Mediapipe multi convert video to mocap

I made a change in the code, so now, if you want to load a single video, on the load button you choose a video.

If you want to load lots of videos, just choose a folder and the script will load all the mp4 files i that folder and create a mocap version of it, keeping each video file in a collection with the name of the video 

View Post

Dev Preview: Mediapipe hands mocap in Blender

Dev Preview: Mediapipe hands mocap in Blender

This code preview let you get bones movement from hands.


The easiest way to install the python packages inside blender to be able to use this blend file and run your own pose estimation, is doing this:

go to your blender installation folder, and copy its path

In this example, the path to blender is:

D:\...

View Post

Tutorial: Lipsync animations in Blender using Audio2face. Example on CC3 character

Tutorial: Lipsync animations in Blender using Audio2face. Example on CC3 character

This tutorial uses:

Nvidia Audio2Face 

https://www.nvidia.com/pt-br/omniverse/apps/audio2face/


Mocap Import:

2021-07-25 08:54:28 +0000 UTC View Post

Blender RigidBody problem and how to solve it.

Blender RigidBody problem and how to solve it.

If your simulation is exploding. Move it from the center, and it might start working correctly.  

This problem was driving me nuts, but with the help of RiceClever from the Blender Discord server, I could find what was the problem

View Post

Dev Preview - Custom Bone Retarget

Dev Preview - Custom Bone Retarget

This video shows a part of the project for the modular mocap.


Here you can see that at the first try, the bone does not align correctly. That's because the bones are in different position in relation to each other.


Preparing to run:

First run the code in the script view(0_RUN_Menu_retarget...

View Post

Dev Preview - Mediapipe and new method of retarget

Dev Preview -  Mediapipe and new method of retarget

This is a preview video of the reviewed code for mediapipe.

In this post you can download a demo file with a model from Vroid and the script

You also have the option to load the py code in your own scene


We provided the mapping to be used with Rokoko Studio and AutoRig Pro


The youtube video explains ...

View Post

DEV - Quaternions angles from obejcts, with one/more child bone

DEV - Quaternions angles from obejcts, with one/more child bone

Updated code that also works with one child (hierarchy of one and two bone child)

Blend file attached

Added a file with loop to add N childs


View Post

DEV - Quaternions Angle transfer from anywhere

The previous post worked only when the reference point where on the Y axis.

By the time you moved (both objects that you wanted to get the angle) the angle got "crazy"


I found a workaround (not the best solution) to make it work anywhere (except when y=0).

Blend file attached and below is the code.


View Post

DEV - Transfer angles from objects to bones

DEV - Transfer angles from objects to bones

After days researching it, we've found a way to copy the angles from an object to bones.


Here is the code and the blend file is attached to this post

#This code was created to copy the angle between 2 points

#And transfer it to a Bone


import bpy,math
e1 = bpy.data.obj...

View Post

Dev update - Converting location to rotation

Dev update - Converting location to rotation

Since last week we've been working on the code to make a better conversion of data from Mediapipe (wich is great because Mediapipe is fast and runs on CPU)

One step we saw, was that, to make this better data conversion, it would be better to work with rotation data instead of location data.


The problem:

Mediapipe at ...

View Post

Mocap_Import Beta 0.73

Mocap_Import Beta 0.73

- added alternative import for frankmocap

- fixed import orientation for frankmocap (instead of load tilted, now it loads upside down, its not perfect but seems to be less worst 😊)

View Post

DEV Code Preview - Reviewing Mediapipe solution on Mocap_import Blender Addon

DEV Code Preview - Reviewing Mediapipe solution on Mocap_import Blender Addon

This is a preview video of the reviewed code for mediapipe.   

Making mediapipe more stable when creating an armature is a crucial part to be able to continue the idea of a modular mocap solution.  

 Its not perfect, but it is getting much better.


Attached is a blend file with the code needed for ...

View Post

Updates 02/07/2021

Hello,

This week we got more busy than usual, so there was not many new things to show.

We are working to have some interesting things to show you all, probably by the end of next week.


Thanks a lot for your support 😍

View Post

Chain animation, blender source files

Chain animation, blender source files

After some research, we were able to make a good chain animation using as reference this tutorial

https://www.youtube.com/watch?v=vhicmKyMB-s  

View Post

TTS engine to create high quality speech

Here is the service we are using to do the text to speech on our tutorials.

https://azure.microsoft.com/en-us/services/cognitive-services/text-to-speech/#features 


We use a python code to gene...

View Post

Blender3.0 using asset browser with animation, quick tip

Blender3.0 using asset browser with animation, quick tip

Here is a tip on how to use asset browser on Blender 3.0 Alpha to use your animations, or pack of animations downloaded



View Post

Deeplabcut Facemocap Preview Code

Deeplabcut Facemocap Preview Code

Here is the preview code to be used with deeplabcut.

To use it, you must train your machine learning using deeplabcut. You can find more about it in:

https://github.com/DeepLabCut/DeepLabCut 


When you train you data, you can create ...

View Post

Mocap Import 0 722 - Easymocap Upgrade

Mocap Import 0 722 - Easymocap Upgrade

This new version of Mocap Import, you are able to use the oficial code from Easymocap site https://github.com/zju3dv/EasyMocap


Now you can generate body and figers movement adding "--write_smpl_full" to the command


For example:

pyt...

View Post

Audio2face import problems, workaround tip

Audio2face import problems, workaround tip

Sometimes when you import audio2face files in blender, you will have problems, here is a simple workaround to help with the problem.

View Post