SamuKata
cebstudios
cebstudios

patreon


4d Scan Test, Tutorial importing in Blender

ATTENTION: you can find the videos I used on the attachment of this post


This video shows a test done using the 4D Scan of Agisoft Metashape Pro (this option is available on the Professional version)

https://www.agisoft.com/features/professional-edition/

You can have a trial of 30 days

To do it was very simple. I recorded a video using 2 Smartphones, a Samsung M52 and Samsung S20 both using UHD resolution.

I synced both videos using blender VSE, and exported the individual frames to a separated folder

For example, folder "2cam_small_test" is the parent folder. inside it, I've created a folder for each camera and exported the image sequence on those folders.

After that I opened Metashape, went to "Workflow", and choose "Add Folder"

Choose "Dynamic Scene" and "Create Camera from each subfolder"

Choose Align Photos

These options worked well for me

Then you will be presented with a point cloud

Go to the option Build Mesh

The most important option that you have to choose is: Source : Depth Maps

Leave the option All Frames to process all the animation

Result after the build mesh

Now go to "Build Texture"

I had a good result using these options: and it was faster to process using the mapping mode = spherical

Result after the Build Texture

Nw you just have to export the results going to File, Export, Export Model

Here are the options that worked well for me to export the data:

Importing in Blender

To import in blender the most simple solution is using StopMotion OBJ from https://twitter.com/neverhood311

You can download it at:

https://github.com/neverhood311/Stop-motion-OBJ

install in blender as you do with all other addons

and you can take advantage of this addon going on th import panel in blender

Go to the folder where you exported the files

write part of the nal of the file sequence that you exported, on this example part of the name would be "final"

And check the "Material per frame"

configuration used to load the files in blender

Depending on the amount of frames that you have, blender might take a long time processing.

If you have a huge mesh and lots of frames could be interesting to use the streaming option, instead of cache, because cache will you your ram memory and if you dont have much, it will crash blender.

Loaded in blender

To see the textured result, press the "preview mode"

And thats it. have fun.

Comments

Hello Yash, thanks for the comment. I've attached to this post the videos tha I think I used for this test. They are all 4k videos. If you have a hard time testinf on other software, try the Metashape trial, it worked extremelly well, so much that I want to buy it 😊

Hi ! is there a way you can share the raw images dataset with me? I want to experiment this workflow but am not able to, because I don't seem to find a good enough face capture dataset. Thanks :)


More Creators