This handy little snippet removes double lines from text files. You can filter out those double lines from the lists you are grabbing. I use this script in a game I play called Blogshares to filter out double lines created when my bot stud makes link lists for me.
Download Script
(downloaded times)
Loading tweets...
billy