Is there any limitation in amount of list elements using remove duplicates option?
I have really huge ammount of URLs about 9kk and remove duplicates doesn't work on that big list.
The problem is that I get no error. After removing duplicates the list is the same as before removing duplicates and I am 100% sure that 30% of links are duplicated.
Maybe it is becouse the list is binded to a file. I have split this list to 3 parts and withound binding to a file remove duplicate works. What do you think about it?