(05-04-2024, 05:42 PM)kodra Wrote: As far as I can tell, once a ObiSoftbodySkinner is bound to a SkinnedMeshRenderer, the mesh is still rendered even I disable the SkinnedMeshRenderer at runtime. So I assume the ObiSoftbodySkinner "takes it over" at runtime and the SkinnedMeshRenderer is no longer in use. (plz correct me if it's not how it works)

Quote:However, there are some operations that we usually can only access through the SkinnedMeshRenderer. For example, changing the blendshape weights, switching the material, etc.

Quote:How do we do these in the case where ObiSoftbodySkinner presents?

(05-04-2024, 08:24 PM)josemendez Wrote: In few words, yes that’s how it works, except for one important difference: Obi will batch together multiple softbody skinned meshes by combining them, in order to be able to deform a lot of geometry efficiently in parallel. Deforming each individual mesh in the main thread is just not an option, specially not when performing simulation in the GPU.

So there’s not a single “internal SkinnedMeshRenderer” per ObiSoftbodySkinner, but just a few of them for all ObiSoftbodySkinners.

(05-04-2024, 08:24 PM)josemendez Wrote:
Blendshapes are not supported. Never have been and probably never will due to how softbody deformation clashes with pose-driven deformation: blendshapes change the rest shape of the base mesh which would require re-generating the blueprint every time a blendshape weight changes, something that cannot be done in realtime.

(06-04-2024, 07:11 AM)kodra Wrote: I'm a little confused about this. I thought the Softbody, when used with SoftbodySkinner, acts very similarly to skeleton animation: each particle is just like a "bone" in skeleton, and when a particle moves, the vertices with non-zero weights binding to that particle moves along. Just like how skeleton animation works, right?

(06-04-2024, 08:22 AM)josemendez Wrote: Not really. What you describe is only the very last step. Softbody simulation works using shape-matching, which tries to match the current shape of the softbody to the original shape of the mesh. This involves preprocessing a lot of data about the original shape, which is stored in the blueprint.

Blendshapes modify the original shape of the mesh, prior to skeletal deformation. The reason is that you want to be able to alter the shape of the mesh and *then* have it animate, otherwise the mesh would blend towards the blendshape at rest.

So the desired order would be:

Original mesh -> blend shapes -> lerp(softbody simulation,skeletal animation, influence)

Note that skeletal animation does not happen either before or after softbody simulation, but at the same time. Then, the painted per-vertex influence is used to choose between both.

(06-04-2024, 08:31 AM)kodra Wrote: But the blendshape works on skinned mesh.

(06-04-2024, 08:44 AM)josemendez Wrote: Nope, that's not how blend shapes work at all. They work on the base mesh, prior to any skinning or skeletal deformation.

Imagine you make a blend shape for a facial expression. If you were to apply blend shapes on the skinned mesh (after skeletal animation), rotating the neck to the left then applying the blend shape would make the face morph into the original position facial expression, looking forward: it would "override" animation.

Same happens with softbody deformation. If you were to apply blend shapes after softbody simulation, the mesh would completely ignore the deformation due to the softbody and morph into the original, rigid blend shape.

So blend shapes must be applied *before* both skeletal animation and softbody simulation, which in the case of a softbody means recalculating the rest shape as modified by the blend shape.

(06-04-2024, 08:53 AM)kodra Wrote: I know blendshapes work on the rest shape. I meant that blendshape work on the mesh that is skinned (has vertices weights painted), not the softbody mesh. By "softbody mesh" I mean the thing is simulated, which is just a bunch of particles with constraints between them.

Quote:Shape-matching constraints work on the softbody mesh, so it should not be affected by blendshapes.

(06-04-2024, 09:06 AM)josemendez Wrote: In that case you’d have a mesh with blendshapes and no visible softbody deformation: a regular SkinnedMeshRenderer.

I believe what you want is not softbody simulation on blendshapes, but softbody simulation *or* blendshapes. This is easily accomplished by separating the face/blendshape affected areas into their own SkinnedMeshRenderer.

It would be possible to have blendshapes work in areas of a softbody where the painted softbody influence is zero, but that can harly be considered “blendshape support for softbodies” imho.

(06-04-2024, 07:11 AM)kodra Wrote: My use case is that the mesh is only partially driven by softbody, similar to "ElasticCharacter" sample: the arms are driven by the softbody, but the legs are driven by skeleton animation. Let's say I have a blendshape that changes the shape of legs; is it possible to make them work together?

(06-04-2024, 09:27 AM)kodra Wrote: My use case is that the mesh is only partially driven by softbody, similar to "ElasticCharacter" sample: the arms are driven by the softbody, but the legs are driven by skeleton animation. Let's say I have a blendshape that changes the shape of legs; is it possible to make them work together?