Letterman is like that with all his guests, not just Justin