/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

2 votes141 views3 answers
Setup user in git
Shell/Bash
1 vote104 views1 answer
Git push heroku main everything up-to-date
Shell/Bash
0 vote140 views1 answer
How to downoad website using httrack in kali linux
Shell/Bash
1 vote136 views1 answer
How to make dock transparent ubuntu
Shell/Bash
4 votes184 views2 answers
Git delete last commit in remote
Shell/Bash
4 votes158 views4 answers
Git stash pop specific
Shell/Bash
0 vote133 views1 answer
Teststand enter non ascci
Shell/Bash
0 vote140 views1 answer
Docker destroy all
Shell/Bash
0 vote199 views1 answer
Remove the credentials of git
Shell/Bash
0 vote160 views1 answer
Avro for debian
Shell/Bash