Site is not being indexed on Google

immy · ‎09-25-2017

Hello there,

My web site https://www.elitecabs.co.uk is not being indexed by Google. I have waited for over 3 weeks now. I have had a look at the robots file on Google Webmaster and it adds below into it. Does this stop the Google to index the website? How can I get rid off these two lines?

User-agent: NerdyBot
Disallow: /

Thanks,

Imran

Brodie · ‎09-25-2017

Hi @immy,

Weebly automatically creates a blank robots.txt file for your site. Google occasionally has difficulty crawling a site and will then send a message like that. They make errors on a regular basis and it's not something to worry about. If this is a false positive, it should be cleared up the next time Google crawls your site.

For more information on your Robots.txt file, check out our help guide here:

https://hc.weebly.com/hc/en-us/articles/216567308-Working-With-Your-Robots-txt-File

But in general, as far as SEO, it can take a number of weeks for a new site to index.