Remove duplicates problem

[bfirst]

Hi

Is there any limitation in amount of list elements using remove duplicates option?
I have really huge ammount of URLs about 9kk and remove duplicates doesn't work on that big list.

How can I solve this problem?

 

[rostonix]

What is file size?
What exact error do you get?
What are PC's specs?

 

[bfirst]

The problem is that I get no error. After removing duplicates the list is the same as before removing duplicates and I am 100% sure that 30% of links are duplicated.

File size 750MB,
PC specs:
Intel Xeon E3 , 3.10 GHz
RAM 16GB

 

[bfirst]

Maybe it is becouse the list is binded to a file. I have split this list to 3 parts and withound binding to a file remove duplicate works. What do you think about it?

 

[rostonix]

Do you have checkbox "save changes to file" enabled in list settings?