As I suspected. You must avoid any recalculation unless the user explicitly requests it. All I have to do is press the Gamedraw button to mess up with the normals, at that point I have not requested any shape change of any sort, you need to fix this.