This happens to me all the time. It's almost like the nut flush draw (the single A) won't ever fold. I almost always stick it all in here and pray that the diamond doesn't fall, which it usually does.

Checking or calling and letting him hit it easier may save you some chips but in the end you can't let people draw. You have to make them pay for it.