Way back when I first started carrying I packed with a belly band. I'm convinced that the continuous pressure around my lower mid-section caused (or exacerbated) a bad case of IBS that lasted about a year.
If you're going to carry a gun heavier or larger than a pocket piece you either need to start wearing a belt. Otherwise you'll just have to get used to the downsides of a shoulder holster, pocket holster or ankle holster and skip the waist carry.