/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

1 vote161 views1 answer
Yarn .gitignore for not Zero Installs
Shell/Bash
0 vote163 views2 answers
How to define a command bash
Shell/Bash
6 votes153 views3 answers
Git blame
Shell/Bash
0 vote164 views1 answer
Minikube start with docker driver
Shell/Bash
14 votes148 views3 answers
Total disk space in linux
Shell/Bash
0 vote152 views1 answer
You must specify at least one graphical backend feature: "metal", "vulkan", "empty"
Shell/Bash
12 votes153 views1 answer
Git ignore mode chmod
Shell/Bash
0 vote147 views1 answer
Relaunch doc macos
Shell/Bash
74 votes143 views6 answers
Clone a git branch
Shell/Bash
100 votes166 views6 answers
Git amend commit message
Shell/Bash