Preflop, I generally fold 66 or lower to a raise with someone yet to act behind me, especially when the raiser happens to be a TAG such as you describe.

Since you did play the hand, calling to the river doesn't seem bad to me, because it's very possible that every street missed him considering the range of overcards that he's likely to raise with.

If he raised a pocket pair or xT, you're screwed, but you might as well find out how badly.