Remove Duplicate Lines

Delete repeated lines from a list and keep only the first occurrence of each.

  • Runs in your browser
  • Free to use
ctrl + enter

About this tool

Remove Duplicate Lines is the quickest way to deduplicate addresses, domains, e-mails or any list: duplicates are removed while the original order is kept, and the counts of input, unique and removed lines are displayed. Case and whitespace differences can be ignored so "Admin@Example.com " and "admin@example.com" count as one.

Follow with Sort Text Lines for a clean, ordered list.


How to use it — quick steps

  1. 01

    Enter the lines

    Type or paste the lines in the field above, one item per line. Use Ctrl + V to paste from the clipboard.

  2. 02

    Adjust the options

    Pick the settings that fit your case; the defaults work for most people. Changes apply instantly.

  3. 03

    Press "Remove duplicates"

    Press "Remove duplicates" or Ctrl + Enter. The result appears instantly below the form.


Key features of this tool

  • Nothing leaves your browser

    The processing is plain JavaScript that runs on your device: the text you paste is never uploaded to our servers or to anyone else.

  • Instant results

    Results appear the moment you press the button, even for long inputs, and every block has copy and download actions.

  • Works everywhere

    No installation, no account and no limits: the tool works on desktop and mobile, in any modern browser, as often as you like.


Frequently asked questions

Which copy is kept?

The first occurrence; the original order of the remaining lines is preserved.

Can I see the duplicates instead?

Compare the input with the output using Compare Two Lists to list what was removed.

Are my files or data uploaded?

No. The tool is plain JavaScript that runs in your browser; the files or data you provide here are never uploaded to our servers.


Popular tools


From APIVoid, the team behind IPVoid

Enhance your threat detection capabilities

APIVoid provides threat intelligence APIs to automate security workflows, with simple pricing and a 30-day free trial to start, no card required.

What you get with APIVoid

  • IP reputation and blacklist checks
  • Domain and URL reputation scoring
  • DNS lookups and propagation
  • SSL certificate and TLS details
  • Website screenshots and page info
  • Email address verification
  • 30+ cybersecurity APIs
30-day free trial