/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

1 vote142 views1 answer
List drives unbuntu server
Shell/Bash
9 votes184 views4 answers
Pm2 --run
Shell/Bash
0 vote130 views1 answer
Snap scrcpy
Shell/Bash
1 vote128 views1 answer
Windows proxy for local system
Shell/Bash
0 vote152 views1 answer
Install angular 9.1.7
Shell/Bash
0 vote119 views1 answer
Scp two remote devices
Shell/Bash
35 votes164 views6 answers
Git undo merge
Shell/Bash
0 vote126 views1 answer
Ubuntu install bluetooth drivers
Shell/Bash
31 votes138 views2 answers
Npm install router
Shell/Bash
2 votes151 views1 answer
Which user apache runs as ubntu
Shell/Bash