/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

1 vote219 views1 answer
Lxde desktop shortcut not runable
Shell/Bash
0 vote132 views1 answer
Clear error log apache2
Shell/Bash
9 votes148 views3 answers
$path mac
Shell/Bash
-1 vote138 views1 answer
Always asks for ssh-add
Shell/Bash
0 vote137 views1 answer
Gcloud check region
Shell/Bash
0 vote160 views1 answer
How do i search for available packages from the command-line
Shell/Bash
0 vote140 views2 answers
Github merge
Shell/Bash
0 vote147 views1 answer
Pause powershell script until keypress
Shell/Bash
-1 vote167 views1 answer
Switch branch git
Shell/Bash
0 vote153 views1 answer
Check for webhint version
Shell/Bash