Suddenly I am having this problem, I only noticed it because I saw that the google search console does not scan my site since October 23rd.
I'm on 3.34.1 (this is my url) and having issues overriding the default robots.txt by adding my own file to the theme.
This is a custom result inserted after the second result.
Hello, A client of mine is going through a bit of a crisis. A developer (at their end) added Disallow: / to the robots.txt file.
Our robots.txt field is populated properly but the file rendered includes random characters and duplicates our sitemap.
I've searched the forums to try and find an answer I am having where robots are generating multiple abandoned carts a day but can't find any ...
This is the official support thread for Bad Robot Blocker. Description: The Bad Robot Blocker is a simple PHP script designed to trap bad robots and spiders ...
So I have no idea where this robots.txt file is generated from, where its located, how this is happening. Its a ghost file! I even overwrote ...
We've achieved this simply by building the blog functionality on bubble and migrating from ghost. see what we got here No-code blog by Zeroqode.
Over the last few weeks, my search results have dropped off since changing hosts. On the robots.txt tester. ... Disallow: /ghost/. Disallow: /p/.
I have a weird problem with the robots.txt file. My robots.txt code in the server is: Code: Select all # If the Joomla site is installed within ...