You could just put a random note in their mailbox.

My mom was best friends with one of our neighbors, I loved the woman, but she was a total bitch. She would leave random notes in people's mailboxes. She got quite a lot accomplished!