The public can see the folder of course, they just can't access the URL of the folder which is within the community.
Its the correct behavior since the entire community is private.
There is no simple way to change that. .LRN is designed to keep everything within a community private to the community members.
