Remove Duplicate Lines Converter
Deduplicate and tidy a list of lines.
Lines
Unique lines
About the Remove Duplicate Lines converter
Paste a list — email addresses, SKUs, log lines, URLs — and get back one copy of each entry, in the order they first appeared.
Order is preserved by default because the first occurrence is usually the meaningful one. Turn on sorting if you would rather have it alphabetical.
Case sensitivity and whitespace
With case sensitivity on, `Apple` and `apple` are different entries. Turn it off for things like email addresses, where case carries no meaning.
Trimming removes leading and trailing spaces before comparing, which catches the very common case of duplicates that differ only by an invisible trailing space.
Frequently asked questions
Can I see which lines were duplicated?
Not in this tool — it returns the deduplicated list. Compare the line counts shown under each panel to see how many were removed.
Does it handle very long lists?
Yes. Lists of hundreds of thousands of lines process in well under a second, entirely in your browser.