What is appropriate conversation at a B&M table?

[CripAces]

So when I play at a B&M I love chatting it up. The hope is to create a friendly atmosphere and pass the time when I am not in a hand. I still pay attention to the hands and how people react ect ect ect. Well friday I was playing at Lucky Chances and had a couple of guys one and old timer and another a guy around his mid 30s get pissed off at me for chatting it up at the table. I never critized anyone's play, nor was I being a table captain. I was just sitting having a conversation with my friend and a couple other guys at the table. The old guy made the claim they we were here to play poker and not chit chat.
Now to the question I have. Where is the line as far as conversation goes? Its +EV to create a friendly conversation at the table and create a social atmosphere? I honestly wouldn't be asking and had it just been 1 guy at the table I would have ignored him as being grouch, but because there were several I was suprised. What are your guys opinions?