DL, you are, of course, free to go...and I don't think anyone will beg you to stay if you don't wish to. But I wouldn't let a little perceived conflict with one or two members wave you off.
There are folks in here that cover all ends of the spectrum...and everything in between. If you get out of line, someone is liable to step on you. But then again, someone is liable to step on them for stepping on you.
Not everyone can be as wise, and even tempered, and supportive, and witty, and...oh yeah, humble...as I am.
But it takes all kinds...and we have all kinds here.
So, do as you please. But good luck either way.