He did let them show their faces in public.  Just not when he was with them.  He didn't want people knowing what his children looked like so when they did go out in public, no one knew who they were.

He said they went to the movies and other things out in public normally.