Well, my persistence payed off. The character is finally having a decent simulation. I had to build a great wall of colliders (I still feel like other skinned meshes offer zero collision) but in the end it worked. Still I would love to know why the points do not align. I had to simulate them to align them. If that's an error I have to know it.
https://imgur.com/a/bkED2Vs
https://imgur.com/a/bkED2Vs