Call lesser raises then. It's simple. Think of it this way, if you wouldn't open with a bet if called to you, don't call the raises.

This is still what I need to work on in my own game, I find myself calling raises with marginal hands (KJ, QJ, AJ..) which I really shouldn't.