Every conversation is not yours to join, Hated New Guy

Just because someone is speaking, it doesn't mean they're speaking to you. And it most certainly doesn't mean they want you to respond.