google suggestions craper

[archel]

Hi

I'd like to scrape the google suggestions but can't make it to work.

When you enter a word manually in the google search field, google gives you the suggestions.
Though, the word doesn't show up when using zenno...only when you click on the search button, google then shows the word, together with the search results, but without the suggestions of course.

anyone knows how to simulate manually typing it in?

thanks in advance.

 

[flexfanatic]

Maybe I'm misunderstanding what you're trying to do but why would you need to simulate text entry. If you're trying to scrape the results why not just load the keywords from a text file?

 

[archel]

Well, if you type it in manually, eg. within action recording section of zenno, you get this:



When you then do it with debug (doesn't matter if I pull it from a txt file or not), you get this:



Only when you push the search button, google registers and shows the keyword you entered. But since I want the suggestions, I can't push the search button.

 

[flexfanatic]

Ah, now I get what you're trying to do. Not that's out of my league of skills but now you have me interested. Also have you tried http://ubersuggest.org/ (create a bot to enter your term there ands scrape the results).

 

[archel]

Yes, I've thought about ubersuggest.
It gives you 10 results instead of 4, which is good, but it is very slow (you have to press submit button and then wait...) while the suggestions in google are instant (and not recorded?).

Thanks for your help already though.

 

[flexfanatic]

Well for those that are looking to use ubersuggest, I created a Google Instant Search parser that uses their site. Enjoy (free of course).

Google Suggestions Scraperr

 

[bigcajones]

That's fine and dandy that you made this bot and want to share it, but many of us have shared templates here without having to give us your email. Would appreciate a file we can download here on the forum.

 

[flexfanatic]

Template is attached. Enjoy

 

[archel]

That's find and dandy but anyone knows how to solve the google issue?

 

[bigcajones]

@archel, that's funny and still working on it. Damn them Googlers.

 

[flexfanatic]

That's find and dandy but anyone knows how to solve the google issue?

Sorry archel, I didn't mean to hijack your thread. I tried figuring out using Google but gave up after about one hour (I'm still a beginner you know).

 

[archel]

No worries.

I'll try to look at it some more and post it if I'd find it.

 

[archel]

Ok, found it. It's quite easy.

Instead of 'value', just input 'innertext'.

 

[bigcajones]

We must've got it about the same time. Here's another option. Use a Rize=>Html element right before it and do a 'focus' for event name.

And for anyone watching this thread here's a template for it. Just fill the keyword.txt file with your keywords and the appropriate text files will be generated.

Посмотреть вложение GoogleSuggest.rar

 

[archel]

Damn, got sort of the same problem on another search engine...:
http://www.vinden.nl/

Tried everything I know, even simulating keystrokes with codecreator.

Would be great if anyone knows how to beat this one. It has 10 suggestions instead of 4.

 

[username]

If you have money, you can do it in Automate Anywhere, in fact, the damn thing lets you to enter strings in style of typing, unless you copy the string to clipboard before. Sorry for mentioning another product.

 

[Stereomike]

I find their site a bit messy, after a bit of surfing I still can't say, what it is able to achieve...