Agree about more players. If you got some cold-callers after UTG's raise it would change things completely. Also if the raiser was on your left (blind steal).

This is an unusual situation, HU with an EP player. I don't see the harm in folding this at a typical loose table.