/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote205 views1 answer
Msfvenom x64 windows reverse shell
Shell/Bash
0 vote181 views1 answer
Slack powershell command
Shell/Bash
1 vote181 views1 answer
Delete all files smaller than a certain size linux
Shell/Bash
0 vote223 views1 answer
Batch disable windows system recovery
Shell/Bash
2 votes169 views1 answer
Linux show file absolute path
Shell/Bash
1 vote173 views1 answer
Macos start avd cmd
Shell/Bash
4 votes170 views1 answer
Git commit all
Shell/Bash
0 vote176 views2 answers
How to install bootstrap icons package with npm
Shell/Bash
1 vote178 views1 answer
Install sublime text manjaro
Shell/Bash
1 vote182 views1 answer
Failed at the [email protected] postinstall script.
Shell/Bash