Seocheckout

How to scrub URLs from one list from another?



Write the reason you're deleting this FAQ

How to scrub URLs from one list from another?

So I have 2 files of URLs. One of them has more than the other. What I want to do is remove all the URLs that are in the first list, that are in the other list. If that makes sense?

I'll say it again just in case.

So I have 2 files of URLs right.

One has about 350+ URLs in it.

And the other list has about 100 URLs in it.

I want to remove all the URLs that are in the list with about 100 URLs, from the list of 350 URLs.

So I want to scrub the list of 350 URLs against the list of 100 URLs.

And remove any URLs in the 350 list that are in the 100 list.

Does anyone know of any free online duplicate list scrubber tool or otherwise for that?

Or perhaps some list comparison tool online or equivalent?

I used to use texthat.com for this but they went down ages ago which is a shame because they had a full suite of text tools, list comparison tools etc

Anyone know anything like that? How to scrub URLs from one list from another?

Comments

Please login or sign up to leave a comment

Join
Everett
Basically, if you want to remove duplicate lines of the same text, you can do so in cPanel alone. They utilize a javascript code for that.

How to remove duplicate text:
  1. Open your cPanel
  2. Create a new document (.html, php doesn't matter)
  3. Make sure you're in the code editor (click Code Editor)
  4. Use CTRL + F
  5. A window should popup
  6. Input the text
  7. Input the text replace text
  8. Click on Replace

This is how I do stuff like this. It's quick, and easy. Now to actually compare a list and remove duplicate lines from one list that the other list has is quite a tricky process, this can't be done with any cPanel tools so you'll probably have to use another tool to do it, or even code a script to do it for you if you know how to code.



Are you sure you want to delete this post?

Cristian
This may sound stupid but what if you paste everything into an Excel and just use the remove duplicate tool. It will remove every duplicate line and just keep one.
At least that's the way I'm doing it, both for URLs and anything else for that matter, especially when I do a very extensive keyword research, I will get a lot of duplicate keywords, they need to be removed and organized into groups so I always us MS Excel.

For some reason, I haven't quite adapted to Google sheets, even though the are a lot faster and you can basically do the same things you are able to do in Excel.



Are you sure you want to delete this post?