Remove Duplicate Lines from a List
Clean a list so every line appears only once, in its original order.
- Works on your device. Nothing is uploaded.
- Free, no watermark
- No signup
How to use
- Paste your list, one item per line, or open a .txt or .csv file.
- Choose whether to ignore case, trim spaces and drop empty lines.
- Copy the unique lines and see how many were removed.
Good to know
The first time a line appears it is kept; later copies are removed, so the original order stays. With "Ignore case" on, "Pune" and "pune" count as the same line (the first spelling is kept). With "Trim" on, spaces at the start and end of lines are ignored and removed.
Empty lines are never treated as duplicates of each other unless you choose "Remove empty lines", which deletes them all. This keeps paragraph breaks in normal text.
Typical uses: cleaning a WhatsApp contact list, merging two lists of email addresses, de-duplicating keywords or roll numbers. For a sorted result, run Sort lines afterwards. Lines must match exactly (after the options), so "98765 43210" and "9876543210" are different.
Questions
Does it keep the original order?
Yes. The first copy of each line stays where it was.
Can it ignore capital letters?
Yes, turn on "Ignore case".
How many lines can it handle?
Hundreds of thousands in a modern browser.
Can I dedupe a CSV file?
Yes, whole rows are compared as lines.
Is my list uploaded?
No. It is processed in your browser.