Currently, a public repository is not allowing users to Fork the repository.
Under the repository, we do not get option for creating fork of the repository, only options available are Clone, Manage and Download.

Workaround is assigning permissions to the public repository. Doing so enables the fork option to appear for those users.