Robots Block indexing

nitinseo · ‎03-09-2018

I have got this issues in my robots txt file. How can i solve it

User-agent: NerdyBot
Disallow: /

User-agent: *
Disallow: /ajax/
Disallow: /apps/
Disallow: /forms.html
Disallow: /passwords.html
Disallow: /non-clickable-page.html

Bernadette3 · ‎03-10-2018

There are a few threads on here discussing NerdyBot. I believe this one describes it best: https://community.weebly.com/t5/SEO/How-modify-the-file-robot-txt/td-p/3328/page/2

What is the name of your website? I'm wondering if you may have a page hidden from search.

Maya211 · ‎03-10-2018

I have the same problem if you solve it please pm me!

Bernadette3 · ‎03-10-2018

What is the name of your website @Maya21?