/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

6 votes105 views3 answers
Get current branch name git
Shell/Bash
0 vote107 views1 answer
Conclusion: don't install league/flysystem-aws-s3-v3 2.1.0
Shell/Bash
0 vote121 views1 answer
How to rebase initial commit
Shell/Bash
4 votes98 views1 answer
Steam is not in the sudoers file.
Shell/Bash
0 vote110 views1 answer
Snap install docker
Shell/Bash
1 vote111 views1 answer
Dos delete
Shell/Bash
0 vote104 views1 answer
How to clear background jobs
Shell/Bash
1 vote103 views1 answer
Bash create empty array
Shell/Bash
0 vote98 views1 answer
Install multiselectfield
Shell/Bash
0 vote101 views1 answer
Cpanel /home/cPanelInstall
Shell/Bash