If you are still have trouble with the site not being public, then you would need to edit the permissions of the bucket by following the instructions below
Amazon S3 block public access prevents the application of any settings that allow public access to data within S3 buckets. This section describes how to edit block public access settings for one or more S3 buckets. For information about blocking public access using the AWS CLI, AWS SDKs, and the Amazon S3 REST APIs, see Using Amazon S3 Block Public Access in the Amazon Simple Storage Service Developer Guide.
Editing Public Access Settings for an S3 Bucket
Follow these steps if you need to change the public access settings for a single S3 bucket.
To edit the block public access settings for an S3 bucket