Kill them now...
When they die - the yard will be overrun with suckers...
Mine started to uproot due to high winds and I had 5000 of the bas*&rds suckers coming up all over the place.
So I killed it.

http://www.savannaoak.org/aspencontrol.html

But - hey, if you like 'em - it's your yard... pretty trees in fall.