Earlier we used to use Broken Link Checker Tools to check broken links with 404 errors and others. This generally take a long time if your site has a huge database and sometimes site also get crashed. But you can check the crawl errors from Google Webmaster Tools which is really handy and give you more insights about the crawl error.
How to Find & Fix Crawl Errors in Google Webmaster Tools
The process is quite simple and user-friendly.
To find crawl errors, first login to your Google webmaster tool dashboard and access the target site.
From the left side, under [health] tab, click on [crawl errors]. including DNS, Server Connectivity and Robots.txt status. On the bottom end, under Crawl Errors menu you will see the list of URL which Google was unable to crawl in the last 90 days.
Now click on any URL, a new window will open with Error details, Sitemap and Linked from. Click on “Linked From” (refer to below picture).
“URL” – it will display the uncrawlable URL
“Linked from” – Here you will see the URLs from which Google had the crawl problem.
How to Fix Crawl Errors
After you have get insights of the problem you will now look for a solution to fix the problem.
The easiest method is to visit the page from which Google couldn’t crawl the specific URL and check whether the URL exists or having any error and then correct it.
Recommended Read: How to fix 404 error
After you have fixed the error, come back to Google Webmaster Tools> Crawl Errors> Check the box beside URL and click “Mark as Fixed”.
Now Google will not show the URL under crawl error until further problem persists.