I think if someone is fantasizing about raping children, hell yes they should be punished. Eventually they might actually do it, when the fantasy isn't enough. It happens all the time.