My work did this, I would just huddle around the smoker's and called myself an honorary smoker. No one cared, I think the supervisor who rarely joined us just assumed he had come before or after I smoked.