Says who? The non-aggression principle is a limit on "expression"--you can't "express" something that violates someone else's rights.

I think the correct word to describe what you're actually thinking of is "libertine", not "libertarian".