I would have bet more on the flop so flush/straight draws would't have odds to call.

What was the starting stack size?