[SOLVED] Stops writing collected urls

[ZeroCouponBond]

Hi, i try to scrape search pages. But when I run it in ZennoPoster, it works for the first 45-60 minutes, but then it stops writing to the text-file, but still going trough each page.

It works like this:
Start -->
Set counter 0 -->
Clear Cookies -->
Get line from list (textfile with alot of urls) -->
Go to line -->
Scrape new urls on webpage (its 50 urls on each page that i want) and save it to the list "List1" that is connected to a txt-file -->
Counter +1 -->
Turn-off switch on maximum count -->
Random pause 5-10 sek -->
Cleaning cookies and then on........

 

[Hungry Bulldozer]

You should remove loop from the project and execute it in ZennoPoster with as many iterations as want to be in your loop. This way it will have opportunity to free up memory.

 

[ZeroCouponBond]

You should remove loop from the project and execute it in ZennoPoster with as many iterations as want to be in your loop. This way it will have opportunity to free up memory.

Thank you very much, I will try that.

I have been running my setup in debug-mode in ProjectMaker for 25 hours now (finished in 3 hours), but I will prefer to do this in ZennoPoster MP instead. I´ll try your setup without loop tomorrow and update you on the outcome

 

[Hungry Bulldozer]

I'm sure it is gonna do the trick

 

[ZeroCouponBond]

Hi again, I was trying to this now, but I have a little problem.

Is it possible to link the counter to the execution count in zennoposter mp? So that the counter is increasing by one on each execution count.

Because I want it to go through every single one of the urls in the list and not just alot of random ones.

 

[ZeroCouponBond]

Solution: Just choose first line and then delete line from list of URLs (this is chosen in the Get line-square). I didnt see that option earlier. It works justas I wanted now. Thanks