folded $6000 pot for $400 on river.

here's a damn sad story. (and if you disagree with my play, fine, but i firmly believe it was the correct play.)

i'm playing 5 card high only $2 - $5 PL omaha

3 of us see the flop. after a raise.
on the flop there is a club draw. i bet 2/3 the pot from first position, call, call.
on the turn I hit a set of queens which is the stone cold nuts so far. i have no clubs. i check. guy bets the pot, next guy calls. i reraise the maximum. guy #2 gose all in for his little remaining money.

now remember i just came over the top, About $2600 of my money is in there.

now the last guy thinks for a while, then calls. he has $400 left. there's now $6000 in the pot.

now, since i have the nuts with a set of queens, he must have a flush draw to go with any sets, or it would be insane to call all in on just a midle set at best. I also figured he'd have gone all in for the last $400 if he didnt have a draw.

so on the river the club hits, and he goes all in for his last $400. and now i also figured, well, he knows i'm gonna call his $400. so he would never bluff here. (And i have no clubs at all in my hand) and why else would he call without the club draw?

so i folded and he had just middle set.

my story of losing $6000 for $400.

Your thoughts?