/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote183 views1 answer
Qemu-img convert vdi to qcow2
Shell/Bash
8 votes195 views2 answers
How to install pil in anaconda
Shell/Bash
0 vote190 views1 answer
Clone the dev masters of the package git
Shell/Bash
1 vote207 views1 answer
Check ports in use windows 8080
Shell/Bash
0 vote169 views1 answer
Ubuntu history select
Shell/Bash
3 votes261 views2 answers
How to install sdkman linux command line
Shell/Bash
6 votes175 views2 answers
Certbot remove domain
Shell/Bash
2 votes191 views1 answer
Firebase rules deploy
Shell/Bash
0 vote176 views1 answer
Fsl convert_xfm
Shell/Bash
0 vote180 views1 answer
Add pwd to path linux
Shell/Bash