/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

37 votes178 views6 answers
Git discard unstaged files
Shell/Bash
1 vote156 views1 answer
Git hub folder not accessilble
Shell/Bash
0 vote150 views1 answer
Bash create user with encrypted password
Shell/Bash
0 vote159 views2 answers
Install appx
Shell/Bash
121 votes237 views5 answers
Brave
Shell/Bash
0 vote161 views2 answers
Ubuntu can't locate packages
Shell/Bash
-2 votes196 views1 answer
Ubuntu turn of sleep
Shell/Bash
26 votes161 views6 answers
Install vs code on ubuntu
Shell/Bash
0 vote183 views1 answer
Perl install Switch
Shell/Bash
0 vote175 views1 answer
How to copy a Directory and its content in ubuntu
Shell/Bash