The issue was due to the values for Vertex Weld Distance and Minimum Particle Size being too small.
After many experiments, I set them to 0.012 (for concrete mesh), and the mesh deformations and material distortions stopped
After many experiments, I set them to 0.012 (for concrete mesh), and the mesh deformations and material distortions stopped