/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote149 views1 answer
How to install aws-jumpclous
Shell/Bash
0 vote134 views1 answer
Yum webmin reinstall
Shell/Bash
4 votes162 views3 answers
Install netbeans in ubuntu 20.04
Shell/Bash
0 vote140 views1 answer
Keep ec2 instance connected on command line
Shell/Bash
0 vote172 views1 answer
Install raspap
Shell/Bash
0 vote253 views1 answer
New screen linux
Shell/Bash
0 vote140 views1 answer
Ca(oh)2 là gì
Shell/Bash
0 vote146 views1 answer
If you cannot update any of the repositry in ubuntu
Shell/Bash
1 vote158 views1 answer
How to delete multiples files in Github
Shell/Bash
2 votes146 views1 answer
CocoaPods could not find compatible versions for pod "razorpay_flutter" when running pod install
Shell/Bash