A shell script that uses scripts available at Scriptome to clean duplicate sequence from a file.
The script will generate 2 files: .uni is the fasta unique sequences and .diff all differences found.
To use this you must save this as a shell script, and call:
Linux> ./script.sh file.fasta