Paste a list and take out the repeated lines, wherever they sit. You get the cleaned list plus a count of what repeated and how many times each line appeared.
Your files are processed in your browser, on your own device. Nothing is uploaded to a server.
Paste a list here and every repeated line comes out, wherever it sits in the list, not only when two copies stand side by side. You pick whether matching cares about capital letters and stray spaces, and the tool reports lines in, duplicates found, and lines out after each run.
The stats matter more than they look. Every line is compared against every other line in the list, and the report names each repeated line with its count, so you can spot a supplier, keyword, or email address that crept in three times from three different sources.
The classic command line tool for this job, uniq on Unix and Linux, only removes a line when the copy sits directly next to the original. Feed it a list where the same email appears on line 4 and again on line 90 and uniq keeps both, unless you sort the list first and accept a new order as the price. Plenty of quick web tools carry the same limit quietly.
This tool holds the whole list in memory and checks each line against all the others. Order stays yours. The first copy keeps its place when you keep the first, and the last copy keeps its place when you keep the last, which matters when the newest entry in a merged list is the one you trust. Marking mode goes one step further for review work. Nothing is deleted, repeats are flagged in place, and you decide line by line.
The jobs repeat across trades. Keyword lists merged from three research tools carry the same phrase in three forms. Email and contact lists gathered from forms, spreadsheets, and old campaigns repeat names after every import. Log files, error lists, and server records repeat the same line hundreds of times and hide the rare entries a person actually needs to see. Teachers merge class lists, sellers merge product codes, and researchers merge survey answers before counting anything by hand.
In each case the repeat count itself is information. A line that appears nine times in a merged customer list is telling you something about how that list was built, and the report on this page hands you that count instead of throwing it away with the copies.
Matching is exact once your options are applied. A line that differs by one character, one extra space in the middle, or a changed letter is not a duplicate, and the tool keeps it. That strictness is deliberate. Loose matching guesses at intent, and guesses delete lines people needed. If two lines look the same here and both survive, zoom in on them character by character. The difference is there, most often punctuation, a trailing tab the spaces option does not cover, or a letter that reads alike in your font.
Everything runs in your browser. Pasted lists are not uploaded, stored, or capped, and there is no sign-up. A private contact list stays private because it never leaves the tab.
No. Every line is compared against every other line in the full list, so a repeat on line 4 and line 90 is still caught. Tools like uniq only catch neighbors unless the list is sorted first. This one keeps your order and still finds the far-apart copies.
Off by default, and the page states that plainly. With it off, Apple and apple count as one line. Turn it on when capitals carry meaning, such as product codes, passwords lists, or names where case was entered with care.
It deletes nothing. Your full list comes back with the repeated lines marked, next to a report of which lines repeated and how many times. Use it when you want to review repeats yourself before anything is removed.
Because matching is exact after your chosen options. One hidden difference is enough: a space in the middle, a tab, different punctuation, or one changed character. Turn on the line-end spaces option for trailing spaces, then compare the pair closely.
Blank lines repeat like any other line. The remove empty lines option clears them in the same pass, which suits lists pasted from spreadsheets and documents where blank rows ride along.
No. The comparison runs in your browser on your device. Nothing is sent or saved, there is no account and no daily limit, and closing the tab clears the list.
Same rules as this one: free, in your browser, with nothing uploaded.
Words, characters, sentences and reading time, live.
UPPER, lower, Title and sentence case in one click.
Characters with and without spaces, counted as you type.
Count sentences and check how long they run.
Count paragraphs, lines and words in one paste.
Count letters alone, with spaces and lines shown too.
Headlines capitalized the way style guides ask for.
How many minutes your text takes to read or say aloud.