'rude' is subjective.

If you happen to think it's rude, and you don't want to be rude, then don't do it. If you don't think it's rude, and don't care about what other's think enough, go for it.

Personally, I leave when I feel like it