Compare two list

[javier]

Hi,

I want do the next:

I go to website and take all links I see. Well If I do today I find 50 link, thats work good. I save this links in a list and do something with this.

The problem is that when I return tomorrow I find 60 links, 50 I take yestherday and 10 new link. I only want save new links.

I think and think, I know I can download all links again and later delete duplicate, but how I can say to my template do something with only new links I found?

Thats it.

Thanks for read.

 

[rostonix]

1) You add to project the list 1 which will contain all the links that you already worked with and sync with file on hard drive.
2) When you scrape new portion of links, you add them to list 2.
3) Merge lines in list 1.
4) Take line from list 2
5) Text processing - regex.
In text window you put variable from merge step (3).
In regex field you put variable from (4)

Then use If action.
If something found = skip this link and take another

 

[javier]

Now I read and don`t understand some comands but I go to fight with software before asking again.

Thanks for your help

 

[rostonix]

Now I read and don`t understand some comands but I go to fight with software before asking again.

Thanks for your help

You're welcome.
If you will not figure this out let me know
You will need only two actions from left panel: word processing and list processings

Anton

 

[javier]

oK, I have variable {-variable-linkfound-}

I can have nothing or htp:/....

How I write in logical if, if {-variable.linkfound-} are empey do something Else do other thing?

 

[archel]

in logic:
'{-variable.linkfound-}'!=''

successful exit = link is there
bad exit = link not there