I removed the thumb safety from my M&P, only took a few minutes. You only have to knock out one roll pin; the armorer's tool in the grip of the pistol works perfect for this.

If you email S&W and ask them for the little plugs to fill in the holes that are left when you remove the safety, they will mail them to you for free.