Free, no sign-up

Remove duplicate lines

Paste a list and duplicate lines disappear instantly. You can see how many lines were removed, and if you want, show only the duplicates themselves.

Duplicates
Keep
Sorting
Cleanup
Add
Original text
Result
How to use

A list without duplicates in a second

  1. 1Paste a listemails, links, SKUs, keywords
  2. 2Adjust the comparisoncase, spaces, first or last occurrence
  3. 3Get the resultcopy it or download as a .txt file

How duplicates are counted

Two lines are treated as identical if they match completely. Spaces at the edges don't matter: "item " and "item" are the same line. Without "Match case", "Item" and "item" in lowercase are also the same. Line order is kept, and one line stays from each group of duplicates.

First or last occurrence

Usually the first occurrence is kept: the line stays where it first appeared. "Last" is useful for logs and exports where the newest entries are at the bottom.

Duplicates only

"Show duplicates only" outputs the lines that appear more than once - each of them once. With "With duplicate count", you also see how many times each line appears. This is handy for finding duplicate orders, emails in a mailing list or keywords.

FAQ

FAQ

Didn't find an answer? Message us and we'll help.

  • Paste the text into the left field. Duplicates are removed right away, and the list without them appears on the right. Below the fields you can see how many lines there were and how many were removed.

  • Not by default: "London" and "london" count as one line. Turn on "Match case" if you need to keep both.

  • Turn on "Show duplicates only". The result will contain only lines that appeared more than once. Add "With duplicate count" to see how many times each one appeared.

  • Yes, unless sorting is selected. Need an alphabetical list? Choose "A-Z" in the "Sorting" block.

  • Copy the column, paste it here, then paste the result back. Each cell becomes a line, and the order is kept.

  • No. The list is processed right in your browser, your email and customer lists never leave it.

Try also

Also free, no sign-up