What is the easiest way to test if indexing a page by google is allowed?

[Perfecto]

Hi,

I need a script to test if everything is allowed for Google indexing. The most complicated one is for the Robots.txt file.

 

[VladZen]

You can make such script in ProjecttMaker. How do you make it in usual browser?

 

[Perfecto]

In my browser I make it with this : https://chrome.google.com/webstore/detail/robots-exclusion-checker/lnadekhdikcpjfnlhnbingbkhkfkddkl
For rhe robots.txt it seems a bit complex to me because there are a lot of different syntax to forbid the indexing of a page

 

[lokiys]

In my browser I make it with this : https://chrome.google.com/webstore/detail/robots-exclusion-checker/lnadekhdikcpjfnlhnbingbkhkfkddkl
For rhe robots.txt it seems a bit complex to me because there are a lot of different syntax to forbid the indexing of a page

You just make your own rules and regex what should be checked for each parameter.
Scrape robots.txt and get what's there and make regex to check if Google is allowed or disallowed.