The Assumption of Aggression
Think of "liberals" and you think of the "laws" they impose on the rest of us.
Think of "conservatives" and you think of the "laws" they impose of the rest of us.
Think of "libertarians" and most people think of the "laws" that the Libertarian Party members want to get rid of or change, through political activism.
Think of "anarchists" and most people think instead of communists who want to use The State to impose their desires on everyone else.
Few people think of people interacting as individuals on their own, without using The State. So, for the people who have their preference but don't seek to use coercion or theft, the round holes of assumed "political action" are a non-fit from the beginning.