tldr/pages/common/uniq.md

# uniq

> Output the unique lines from a input or file.
> Since it does not detect repeated lines unless they are adjacent, we need to sort them first.
> More information: <https://www.gnu.org/software/coreutils/uniq>.

- Display each line once:

`sort {{path/to/file}} | uniq`

- Display only unique lines:

`sort {{path/to/file}} | uniq -u`

- Display only duplicate lines:

`sort {{path/to/file}} | uniq -d`

- Display number of occurrences of each line along with that line:

`sort {{path/to/file}} | uniq -c`

- Display number of occurrences of each line, sorted by the most frequent:

`sort {{path/to/file}} | uniq -c | sort -nr`
uniq: add page 2016-01-12 15:08:52 +00:00			`# uniq`

pages*: simplify page description (#12149) Co-authored-by: Sebastiaan Speck <12570668+sebastiaanspeck@users.noreply.github.com> Co-authored-by: K.B.Dharun Krishna <kbdharunkrishna@gmail.com> 2024-02-14 20:25:13 +00:00			`> Output the unique lines from a input or file.`
sort uniq first (#954) 'uniq' does not detect repeated lines unless they are adjacent, so we need to sort them 2016-07-15 12:18:37 +01:00			`> Since it does not detect repeated lines unless they are adjacent, we need to sort them first.`
coreutils*: use short more info links (#5658) 2021-04-01 16:54:26 +01:00			`> More information: <https://www.gnu.org/software/coreutils/uniq>.`
uniq: add page 2016-01-12 15:08:52 +00:00
			`- Display each line once:`

*: path/to/everything (#9589) 2022-12-04 09:12:49 +00:00			`sort {{path/to/file}} \| uniq`
uniq: add page 2016-01-12 15:08:52 +00:00
			`- Display only unique lines:`

*: path/to/everything (#9589) 2022-12-04 09:12:49 +00:00			`sort {{path/to/file}} \| uniq -u`
uniq: add page 2016-01-12 15:08:52 +00:00
			`- Display only duplicate lines:`

*: path/to/everything (#9589) 2022-12-04 09:12:49 +00:00			`sort {{path/to/file}} \| uniq -d`
uniq: add page 2016-01-12 15:08:52 +00:00
fix typos using misspell (#1374) 2017-05-12 10:29:18 +01:00			`- Display number of occurrences of each line along with that line:`
uniq: add page 2016-01-12 15:08:52 +00:00
*: path/to/everything (#9589) 2022-12-04 09:12:49 +00:00			`sort {{path/to/file}} \| uniq -c`
uniq: add sorting example (#945) This involves another command, but it's such a natural extension of uniq's `-c` functionality that I feel it's warranted to show here. We should probably add a sort to the -c example too, because uniq only deals with sequential line repetitions. 2016-07-10 10:26:13 +01:00
fix typos using misspell (#1374) 2017-05-12 10:29:18 +01:00			`- Display number of occurrences of each line, sorted by the most frequent:`
uniq: add sorting example (#945) This involves another command, but it's such a natural extension of uniq's `-c` functionality that I feel it's warranted to show here. We should probably add a sort to the -c example too, because uniq only deals with sequential line repetitions. 2016-07-10 10:26:13 +01:00
*: path/to/everything (#9589) 2022-12-04 09:12:49 +00:00			`sort {{path/to/file}} \| uniq -c \| sort -nr`