Serps will likely not know how to proceed While using the URL . It is unclear to them whether they're allowed to access. When directives usually are not crystal clear to Google, they're going to go With all the least restrictive directive, which In this instance ensures that they'd in https://rankingseotoolz.com/robots-txt-generator