I would agree with you if you said they don't get software updates and improvements like a smartphone but even the most basic point-and-shoot has better glass and better optical zoom than a smartphone.
I took this with a 12 MP DSLR using a 400mm zoom with a 2x Extender (effectively an 800 mm lens):
Today's point-and-shoots will give you the equivalent of a 720 or 960 mm lens. I'd still rather use the DSLR with a high quality zoom for this shot but there are perfectly good point-and-shoots that will get you pretty close to this and the only way you're doing this with a smartphone is putting it up against a pair of binoculars or a telescope (doable but awkward for a handheld situation).