About compare the lines:
1) You add to project the list 1 which will contain all the links that you already worked with and sync with file on hard drive.
2) When you scrape new portion of links, you add them to list 2.
3) Merge lines in list 1.
4) Take line from list 2
5) Text processing - regex.
In text window you put variable from merge step (3).
In regex field you put variable from (4)
Then use If action.
If something found = skip this link and take another
Who can make the template for me? thank you very much, I was so stupid!
1) You add to project the list 1 which will contain all the links that you already worked with and sync with file on hard drive.
2) When you scrape new portion of links, you add them to list 2.
3) Merge lines in list 1.
4) Take line from list 2
5) Text processing - regex.
In text window you put variable from merge step (3).
In regex field you put variable from (4)
Then use If action.
If something found = skip this link and take another
Who can make the template for me? thank you very much, I was so stupid!