I'm thinking it is the cat litter that can linger or get into clothes. I know some people who keep the cat litter in the laundry room/storage room or whatever and you can smell it.