I think OP played this hand ok. He had a read on the other player as a very loose agressive type who had a lower flush and they'd been going back and forth in a pissing contest. Good place to push as his opponents frustration might make him call with a weaker flush. For him to EXPECT the other guy to have a straight flush is bad poker it seems to me. You cant expect the hand of doom to come crushing you from the sky at every moment.
Expecting your set to lose to a bigger set, expecting the other guy to have 4 of a kind when you have the full house.
Come on, thats just ridiculous.
Sometimes you will lose these hands unfortunately and all of these players who act as if they could lay it down are full of crap, IMO.