What are current recommendations for 3D from depth map?

[rjlittlefield]

There used to be a fairly simple method in Photoshop for converting image + depth map into a 3D model. This was documented by Jörgen Hellberg at viewtopic.php?t=33926 .

Unfortunately, Photoshop will no longer do this job. (More info at https://helpx.adobe.com/photoshop/using/creating-3d-objects-animations-photoshop.html )

So, I am looking for recommendations on how to do the same sort of thing using current tools.

What are your thoughts? What's a good way to do this?

--Rik

[Beatsy]

Blender 3.6 Alpha has just introduced a 3d-model from depth-map and image feature. The s/w has a steep learning curve for modelling, but if you only want it for this function, it should be relatively easy to try out.

I occasionally play with Blender (I like the physics simulation and inverse-kinematics stuff, plus rendering of course) but I don't know if this new feature meets your needs. I haven't tried it. Maybe worth a look though.

Some info here... https://www.blendernation.com/2023/03/1 ... d-objects/

Edit: forgot to mention that Blender is free s/w

[kaleun96]

There used to be a fairly simple method in Photoshop for converting image + depth map into a 3D model. This was documented by Jörgen Hellberg at viewtopic.php?t=33926 .

Unfortunately, Photoshop will no longer do this job. (More info at https://helpx.adobe.com/photoshop/using/creating-3d-objects-animations-photoshop.html )

So, I am looking for recommendations on how to do the same sort of thing using current tools.

What are your thoughts? What's a good way to do this?

--Rik

It's a bit expensive (~$180) but perhaps you could use Meshroom to do the depth mapping and 3D modelling. I've recently been giving macro photogrammetry a go and found Meshroom to work really well for this. Here's the resulting model I produced using Meshroom

Though I'm not sure how well it would work in the case of the example from Jörgen you posted. Meshroom would probably struggle with the out of focus areas and finding enough points for alignment. In my case, I was using multiple focus stacked photos, rather than multiple photos that make up one focus stack. In that case importing the depth map from Zerene into Meshroom might be the better option, if it can be done. Meshroom has a free 30 day trial so you can at least try it out first if you think it might work.

[dy5]

Cam -

The coin reconstruction is very impressive! How many stacked photos did it require?

Cheers - David

[kaleun96]

Cam -

The coin reconstruction is very impressive! How many stacked photos did it require?

Cheers - David

Thanks David! I did one pass of 36 photo stacks (one stack every 10 degrees) then rotated the coin at the point where it was being held, and did another pass of 18 photo stacks (one stack every 20 degrees) to capture the edges of the coin that were previously being hidden by the holder. All up it was probably about 500 photos, so averaging less than 10 photos per stack.

[Adalbert]

Hello Rik,

This is still possible with CS5, isn't it?

I have just tried to create 3D with CS5,
but I'm not sure what exactly to do at step: "Create 3D"

I have already prepared PMax and inverted DMAP_depthmap
and tried with post-card and 3D-Mesh.

BTW, how can such 3D files (e.g. DAE) be viewed at all
or, for example, in the forum?

Best, ADi

[Smokedaddy]

Blender is an amazing free program. Like Steve said, huge learning curve but amazing. I used to generate 3D models of Mars using HiRISE DTM's using Blender and 3D printed them. Very cool. This "might" be doable, plus it's open source. Other than that I haven't tried anything else in Blender. Extruding a 2D image doesn't qualify. <g>

[Adalbert]

Hello,

Blender is an amazing free program.

sounds good :-)

So, I have just installed it and tried to create 3D from Zerene->DMap_depthmap.tif,
but without success

Could you please explain how to create 3D from depth-map?

Thank you in advance.

Best, ADi

[Beatsy]

...
Could you please explain how to create 3D from depth-map?
...

Blender specifics are rather "off topic" for this forum. There is loads of information available on line - and given the enormous learning curve, you'll be best served if you wade through some of it yourself to start with. That way you'll learn useful terms (and even techniques) as you go. Then, if you're still stuck, you can ask on a Blender forum (there are zillions) once you've formed a helicopter view of what's involved.

Having said that, a quick Google search threw up this article - it might give you a start on the journey. It's an old article so things might have changed, but you should be able to spot more terms and "signposts" that will help you to search for more relevant examples. https://johnflower.org/tutorial/make-mo ... heightmaps

[Adalbert]

Hello,
Thank you very much for the advice!
Enclosed is my first attempt with radiolaria:

BTW, I have used Blender 3.6.4
Best, ADi

[rjlittlefield]

Adi, nice job!

Can you share the recipe, or note which references were best for figuring it out?

--Rik

[Adalbert]

Hi Rik,

I have already sent you the description of my solution by PM.

BTW, I have only been working with Blender for one day,
so, I don't want to spread my somewhat simple solution,
which has been worked out by trial and error :-)

Best, ADi

[rjlittlefield]

Understood, thanks.

BTW your experience with Blender is more than mine, by at least one day.

So many tools, so little time...

--Rik

[Smokedaddy]

Maybe this will help a little. As the author mentions in the comments, you would plug your depth map into the displacement instead of the image and probably won't need to do as much sculpting because the depth map will have done most of it for you.

https://www.youtube.com/watch?v=f25h308PVlg

-JW: