There will always be people who want to control others.
There will always be people who have more power than others (military, financial)
Without some way to inhibit powerful controlling people from stomping on others, tyranny will result.

The United States has (had) a constitution to set limits on government to prevent tyranny.

What does Libertarianism provide to limit a powerful and control minded person or group from imposing their will on the people?

If it weren't for the fact that there will always be powerful controlling people, Libertarianism could work.
If it weren't for lazy people, Communism could work.