Google Search Scraping - how is google detecting me?

[emperorjones]

I'm scraping google using "site:" modifier but after a few pages, I get blocked.

I'm using rotating proxies from Storm Proxies that change on each http request, user agents, clearing cache & cookies. I have long pauses between page requests and am only searching 4 pages before starting a new instance in zennoposter.

I'm wondering how Google know to block me so soon, especially that after 4 pages I am changing proxy & user agent?

Thanks.

 

[Frcc78bis]

Hello,

I was doing some research for a project and I'm using a lot of google operator like "site:"
I'm using no proxy just my internet connexion
And after just 5 or 6 search I have captcha. And now still 2 days after I still have captcha when I use a search operator
Not sure if there is a solution to this problem. Google is now very agressive with this type of request
Maybe try to use another search engine

 

[PHaRTnONu]

lots of ways
{-Environment.CurrentUser-}
{-Profile.UserAgent-}
https://superuser.com/questions/470348/how-much-information-can-websites-get-about-your-browser-pc

 

[LightWood]

In any case, Google checks your actions. A fast page switching, without for example the movement of a mouse, etc., is not much like a real person.