Remove Duplicate In A File Sep 14, 2018 • Ulysses Here’s a Perl script for removing duplicates in a file. <pre lang="perl"> perl -ne 'print unless $dup{$_}++;' input_file > output_file