I think you've got to pay off. When someone beats you with quads you just say "nh". People will call/bet these types of hands with almost any pair, not just the 4th ace.