if he doesn't know if the card is red or black, it doesn't matter if you switch or not.

if he does know, then you switch.