Basic Scraper example

[Perropoly]

For now watched videos tutorials about registration in web sites.

Could be possible to have a scrape example template (not video), for example, from the first 2 google search results for the word: cat

Something like

- search keyword cat in google
- scrape title and urls from first page
- store in file
- traverse to second page,
- scrape and store

From this template I can expand and add more logic.

Thanks
Perrropoly

 

[step85]

It's possible
Results save in folder Results file test.txt

 

[dongle132]

thx!
I've been playing with this expression for scraping google ->

(?<=\" href\=\").*?(?=\<\/A\>\<\/H3\>\<BUTTON class\=vspib type\=submit\>\<\/BUTTON\>\<\/SPAN\>)

 

[Perropoly]

I'm cloning / adapting your example to scrape other sites. When we get the dom page of the text (with the web browser), how we open or transfer the page to the regexp builder in order to create the regular expression. I'm doing it with expresso, it must be a way to do it inside Zennoposter.

I created the template in the action recording sector, moved it to the template editor to start building the regexp and extract data.
I found the action recording section more for registering and filling forms, while for scrapping you must create the step branches in the editor. Is there a way to select and scrape from the action editor and then make modifications in the template editor?.

 

[dongle132]

I'm cloning / adapting your example to scrape other sites. When we get the dom page of the text (with the web browser), how we open or transfer the page to the regexp builder in order to create the regular expression. I'm doing it with expresso, it must be a way to do it inside Zennoposter.

Wrote it in the other thread:
If you are recording you have to click the "Page text" Icon from the menu. Then the source opens within zenno-editor and you can click the 4th button from top "Copy to macros builder" to have the DOM text in the regexp builder.

 

[step85]

I'm cloning / adapting your example to scrape other sites. When we get the dom page of the text (with the web browser), how we open or transfer the page to the regexp builder in order to create the regular expression. I'm doing it with expresso, it must be a way to do it inside Zennoposter.

example on picture
http://help.zennolab.com/en/v3/zennoposter/current_page_text.htm

 

[jp1]

It's possible
Results save in folder Results file test.txt

is this google.xml still working for you guys? i'm quite sure it was a few weeks ago but now it isn't! weird. it won't parse any results, as the execution result of the Get is blank, which means no save results happen. It's beyond me what could be wrong.

 

[chakki]

simply fix the regular expression