/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

63 votes177 views3 answers
How to remove a remote origin in git and add new
Shell/Bash
0 vote201 views2 answers
Install Docker on Windows Server 2019
Shell/Bash
0 vote187 views1 answer
"jetbrains-license-server" "github"
Shell/Bash
0 vote189 views1 answer
Install webmin ubuntu
Shell/Bash
15 votes189 views1 answer
Flutter Android sdkmanager not found
Shell/Bash
0 vote249 views1 answer
How to append program output to file linux
Shell/Bash
0 vote181 views1 answer
E package 'curl' has no installation candidate ubuntu 18.04
Shell/Bash
7 votes204 views5 answers
Clear pip cache
Shell/Bash
0 vote193 views1 answer
Join 2 files linux
Shell/Bash
0 vote206 views1 answer
Error: pathspec 'new_brach' did not match any file(s) known to git
Shell/Bash