You can avoid any hard feelings in this situation by simply letting him as soon as "announces he always does business whether he was favorite or not.", that you don't and decide on a case by case basis.

Now he was told up front so he really can't complain if you don't do business with him later.

Personally I hate this "doing business thing" and I'm thankful that it doesn't come up in the games I play or deal.