Nice one, I use csvfix to get dupe removal done. It can do all sorts of stuff besides dupe remove, but you have to a read a little to get into the commandline structure. It does all kinds of magic to your csv files (sorting, filtering, removing by value etc etc)