If they are adjustable, that's different.

My logic based on most pistol sights NOT being adjustable, and seeing many people say "these sights are off!" when they aren't, it's just a lack of practice on their part.

Again, if the sights are adjustable, there is a much greater chance for them to actually be off. Can you physically see the rear sight more to one side than the other?