- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
"Indexed, though blocked by robots.txt" But these pages are not blocked by the robots.txt.
Hi everyone,
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Hi @nuo I'm not seeing the screenshot. Can you please repost? Thanks so much!
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Hi Bernadette,
Thanks for the response.
Below are the images:
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Can you check and see what the URLs are that it is blocking? I suspect they are all backend resources in /ajax, or something like that.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
I'm having this same problem.
I have 45 pages that are blocked by robots.txt, none of which are set to be hidden.
Here's one example:
https://www.appliedbiochemists.com/shoreklear-plus.html
But here: https://www.appliedbiochemists.com/robots.txt you can see that this page and the others Google is saying are blocked aren't on the list.
How do I get them to not be blocked?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Hi @pulsar Can you post a screenshot of your Google dashboard that shows the url blocked? Does it give you any additional information?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Sure here's the warning we're getting.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
What happens when you click on "learn more"?
@whitemonkey Do you have any input on this?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Hi. Ive had a few blocked before. Normally they dissappear eventually.
I "site:" https://www.appliedbiochemists.com/shoreklear-plus.html
its live but no info available.
Try submitting a SITEMAP.XML again
Also. Go to the Old google search console. And go to CRAWL then robots txt tester and submitt your site there...
THEN back on the new google search console. Inspect a BLOCKED url and request indexing ..
Hope google crawls ur site again..
Thx @Bernadette this is all i can suggest...
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Might just take time, we did only launch a week ago.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Ok good luck there. I wrote a post on my travel blog which has a sub section about weebly.
links to my other page about how to index ur pages is at the end of the post
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
Thanks for the feedback, @whitemonkey!
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report