unique
unique is a simple tool that outputs the unique lines of its input. That input can come from stdin or from a file.
Installation
brew install ro-tex/tap/unique
Or brew tap ro-tex/tap and then brew install unique.
Build it yourself:
You will need Go for this.
go install github.com/ro-tex/unique@latest
Grab a binary:
If you prefer a binary, you can download a Linux or Mac one from https://github.com/ro-tex/unique/releases.
Usage
When no arguments are given, unique reads from the standard in.
Running
echo " one\n one\n two\n one" | unique
will output
one
two
In order to read from a file, use the -f parameter:
unique -f file.dat
That is equivalent to
cat file.dat | unique