OP here, Just to clear things up. We were visiting an office site and it was at lunch I discussed the possibility of a promotion. Then, when it was time to leave the office site, I had to follow him out a series of doors and corridors to get to the parking lot. He had asked me to text my collegue to let the home office know that we were coming back and as he turned left through a door, I unintentionally went to follow him. Fortunately I looked up and noticed the puzzled look on his face and the sign on the door above my hand before I actually entered the bathroom.