Although trolls are lawyers, there is still a "cost", and in this cost is time and the opportunity cost of spending time elsewhere. Going to court, getting a judgement and collecting fees is a huge time sink. Patent trolls are not dumb. They will litigate when you are a big fish.