Libertarians often get accused of blaming everything on government. Little old us, picking on big strong government? That's silly.
The problem is not government, nor is it crime. The problem is people using theft and aggression against others. To draw a false distinction between these primary sources of theft and aggression in the world is to miss the point entirely. It is to be a part of the problem rather than a part of the solution.
Theft and aggression exist, and always will, so I might as well accept it and deal with it. So how can you and I survive in the world without resorting to the same tactics used by the bad guys?
Through voluntary cooperation and trade, of course. This is called "the economic method", and when this is used everyone wins, or they are free to walk away- in which case they still win since they were not forced to enter a transaction without their consent. When the economic method is used, completely free of coercion or fraud, there are no losers.
When cooperation and free trade fail- which they sometimes will because there will always be bad people out there who will resort to coercion and fraud- you survive by falling back on self defense.
Isn't self defense an act of aggression? No, it isn't. It can be violent, but it is never aggression. Aggression is the act of starting the attack- throwing the first punch- not of defending yourself or your property from others. Any "laws" that get in the way of self defense and defense of property only make society less civil. They protect the bad guys while hobbling the rest of us.
Almost everyone recognizes violent crime and theft as wrong-doing. In that, libertarians fall squarely on the side of the rest of society. Where we differ is that we make no allowances for theft and aggression done under color of "law". Double standards are rejected and no one gets a pass for their actions.
Without the human potential and energy being wasted maintaining the double standard, the real problems of aggression and theft can be dealt with more effectively.
Then the mental resources and energy that are no longer being wasted can be directed at the other problems that the universe throws at our species. After all, natural disasters, disease, and ignorance won't magically go away by themselves. That takes people who care enough to act, freely, to find voluntary solutions.