I know what you mean about the PVC with threaded ends, although galvanized pipe looks much more authentic [ROFL1]
It would need to be pretty thin PVC otherwise the container would be heavier than the bolt. Something to look for the next time I'm in a hardware store.

