I think anyone who pays tuition at the university should have free speech anywhere, but people who are just random(crazy religious people and abortion activists) should be restricted.
I agree that abortion activists can be zealoted at times, but your statement illustrates precisely why restrictions on the first amendment are exempt from value judgements.
Stifling the speech of someone you categorize as 'crazy' is exactly why the first amendment exists. If everybody wanted to waste their free speech on how cute puppies were, we wouldn't need it.