Home › All tools › Remove duplicate lines
Remove duplicate lines
Strip duplicate lines from a list, or pull out just the lines that repeat.
सूची से डुप्लिकेट लाइनें हटाएँ।
How to use it
- Paste your list, one item per line.
- Choose whether you want one of each, only the repeats, or only the lines that never repeat.
- Copy or download the cleaned list.
About this tool
De-duplication is exact-match by default: two lines are the same only if every character matches. The options loosen that — ignoring case, or trimming the spaces at each end — which is usually what you want for a list of emails or names pasted out of a spreadsheet.
Order is preserved. The first occurrence of each line stays where it was, which matters when the list is already in a meaningful sequence. Tick the sort option only if you want it alphabetical.
Tips
- Showing only the repeats is the fast way to find duplicate entries in a register before you import it.
- Trailing spaces are the usual reason two apparently identical lines are counted as different.
- For a comma-separated list, replace the commas with line breaks first using the clean-up tool.
Questions people ask
Is it case sensitive?
By default yes. Tick the option to ignore case.
Does it keep the original order?
Yes, unless you ask for the result to be sorted.
How many lines can it handle?
Hundreds of thousands. It runs in your browser, so very large pastes depend on your device.