A footman can conveniently be found carrying a chair down the hall in Mary's direction, actually. Shirogane has no idea she's actually searching for one, and he'll give her a polite nod as he and the chair walk on by. He's trying to keep to the side, assuming her brisk pace means she's on some important errand of her own that in no way involves finding a footman to lift heavy objects.