Mass URL Validation: Checking 500 Links in Under 30 Seconds
How to check a long list of URLs for status codes and response times in one pass, and what the patterns in the results tell you.
Like it ? share it
Migrations, backlink audits and pre-launch checks all end at the same place: a spreadsheet column full of URLs and one question about all of them. Are these alive?
Opening them one at a time in a browser is an hour of work for a hundred links, and you will lose your place.
The workflow
Copy the column out of your spreadsheet, paste it into the Bulk URL Checker, run it, export the result as CSV. The requests go out in parallel rather than one after another, which is the whole reason it finishes in the time it does.
Reading the results at scale
On a long list you are looking for patterns rather than individual rows.
200 is what you want. Nothing to do.
404 means the page is gone. If these are backlinks pointing at your site, each one is a link somebody built for you that now leads nowhere, and it can usually be recovered with a redirect. If they are outbound links on your own pages, they are just broken.
500 or 503 is a server problem rather than a missing page. A 503 is usually maintenance and will clear. A 500 is a crash, and if it is on your own site it is the most urgent thing in the list.
403 means you were refused. Sometimes the page is genuinely restricted, and sometimes a firewall does not like automated requests. Check one by hand before assuming the worst.
The response time column
Every result carries how long the server took to answer, and anything over 500ms is flagged. That turns a link check into a rough performance scan for free.
The useful part is the shape of the distribution, not any single number. Fifty of your own pages where every one is slow points at the server or the host. Fifty pages where forty are fast and the product pages are slow points at something specific to that template, usually a query.
Three things it is good for
Affiliate links. Merchants restructure their URLs without telling anyone, and the first sign is usually a drop in earnings rather than an error. Running your top links through weekly catches it in days instead of a month.
Backlink recovery. Export your backlinks from Ahrefs or Search Console and check them. Any that 404 are links somebody already decided to give you. Most are recoverable with a redirect on your end, without asking anyone for anything.
Pre-launch QA. Dump every URL from a new section in before it ships, and you find the staging links and the typo'd paths while it is still cheap to fix them.