What is Lists with duplicates?
Email lists, keyword exports, log lines and merged files that accumulate repeated entries — inflating counts and hiding how much is genuinely unique.
Remove Duplicate Lines
Remove duplicate text lines
Preparing the tool…
The tool could not be loaded. Check your connection and try again.
No file selected
How to remove duplicate lines
Paste your text
Paste lines or load a .txt file — processing is entirely local.
Choose case sensitivity
Keep the default exact match, or enable case-insensitive dedupe.
Copy the unique lines
Copy or download the result — first occurrences kept, order unchanged.
Frequently asked questions
Which duplicate is kept?
The first occurrence. Every later line that matches an earlier one is removed, so the original order of what remains is preserved exactly.
Is the comparison case-sensitive?
By default yes — "Apple" and "apple" are different lines. You can switch to case-insensitive mode to treat them as duplicates.
Does it handle large lists?
Text up to 5 MB and 2 million characters is supported, deduplicated in your browser with efficient hashing.
Is my text uploaded?
No. Everything happens locally in your browser — your data never leaves your device.
Order-preserving dedupe
Here is what each format is for, and when converting duplicated lists into unique ones is the right move.
What is Unique lines?
The same lines with repeats removed, first occurrences kept and relative order intact — a clean, diff-friendly list ready for deduplicated sending or analysis.
When you need it
Use it before importing email lists, cleaning keyword exports, comparing log sources or counting unique visitors from a plain text file. Order preservation means the output still diffs cleanly against your original.