/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote191 views1 answer
Start Win-KeX in Seamless mode with sound support
Shell/Bash
0 vote185 views1 answer
Concat strings inside array bash script
Shell/Bash
-1 vote154 views1 answer
How to install google chrome in ubuntu 32-bit
Shell/Bash
9 votes200 views2 answers
Shebang
Shell/Bash
0 vote163 views1 answer
Copy to clipboard while ssh into another terminal
Shell/Bash
0 vote178 views1 answer
Git merge tag to branch and squash commits
Shell/Bash
0 vote160 views1 answer
.net core upgrade
Shell/Bash
0 vote203 views1 answer
Run adb command mac stackoverflow
Shell/Bash
12 votes170 views4 answers
Docker compose no cache
Shell/Bash
3 votes177 views2 answers
Restart gnome shell
Shell/Bash