Screamingfrog is able to give me a really good look at the on-page factors of a site and quickly put together a spreadsheet of the most important elements. Another important feature is the ability to configure the crawler in a very detailed manner. This has become more important lately as hosting companies develop their security systems, making crawling a site more difficult. Review collected by and hosted on G2.com.

I've used Screamingfrog for over 4 years now and I can honestly say that there is really nothing that I can say that I don't like. For what I use it for it is perfect. Review collected by and hosted on G2.com.

It's the easiest tool I've found for QUICK SEO tests. I use it daily for our clients to explain SEO and produce error reports. Review collected by and hosted on G2.com.

There are often sites that can not be read. I would also love if the platform was online as well. Review collected by and hosted on G2.com.

SEO Bot Internal Crawl / Link List Checker . The SEO Spider is very fast. It can "consume" the largest of our sites (some 5000+ items) in under 1 minute. Review collected by and hosted on G2.com.

The ability to do scheduled crawls with comparisons. ALSO, it would be nice if crawl results could be shared in a PDF format w/ graphs for individual categories of content. Review collected by and hosted on G2.com.

As for the search engine optimizer, I like the whole tool. I really like the fact that I can use the service to regularly scan the site. Copywriters often add or remove pages from sites or make changes to existing pages. This happens on any large site. Using the SEO Spider, I can monitor everything that happens with the pages.

SEO Spider allows changing User-Agent, which allows me to use SEO Spider as a tool for monitoring a mobile version of a site. If the 'status code' is not 200 or if the site loads for a long time, then I will find out first about it. This way I can quickly fix the errors and the site will not lose its position in the Google search engine results page.

I also like SEO Spider as a tool for finding errors on the site. For example, if the site uses images that are not optimized by special software, then I find such images and optimize them. This is important because Google uses the Mobile-First Index and page loading speed affects the position of the site in the Google SERP. Review collected by and hosted on G2.com.

Now SEO Spider analyzes the site, but does not analyze the server log files.

If we analyze the log files, we can draw important conclusions. For example, I could find information about which pages are being requested, but their status code is not 2xx and not 3xx.

Now in SEO Spider there is no such functionality.

I would also like to see the possibility of launching a crawl site online (for example, on the SEO Spider server). For example, I could start a site scan at night, and get a result in the morning. Review collected by and hosted on G2.com.

I'm SEO and marketing online worker and I use this tool each day . It help me a lot to analyze site's web optimization, and it's free!! I really reccomend It. Review collected by and hosted on G2.com.

I don't dislike anything about It. Maybe I would like a cheaper cost for a higher level of URLs. Review collected by and hosted on G2.com.

I love that it's quite comprehensive, which allows you to identify technical errors you would otherwise miss. Review collected by and hosted on G2.com.

Nothing in particular, I like it as it is. Review collected by and hosted on G2.com.

I love the organization of this tool. After the website is crawled, I can sort by internal links, external links, HTML, CSS, etc. It shows exactly what you are looking for no matter what your task is. If you need to see every URL, SEO Spider can show you that. If you only want to show the external links, SEO Spider can show you that too! The level of granular detail available to you is endless. Review collected by and hosted on G2.com.

I dislike how much "power" it seems that it takes to run, and how often it updates. Every time it seems I launch the tool, it has to update to the latest version and my laptop is heating up because SEO Spider is taking up a lot of power. Review collected by and hosted on G2.com.

For onsite SEO, Screaming Frog is the best. This goes for more than just crawling titles and meta descriptions. It helps you find inappropriate noindex tags or canonical tags that target pages they shouldn't. looking at an excel spreadsheet export from Screaming Frog will beat out any site crawl tool from any of the SEO all-in-one tools. In particular, the SEO Site Crawl tools do a poor job of showing opportunities with noindex tags/canonicals. They can show what pages have them but can't really reason out whether X page should redirect to page Y or not and there can be a LOT of opportunity here.

Add to that the API integrations with Google Analytics, Moz API, AHrefs API and search console. You can quickly crawl a large set of URLs and get backlink and traffic data for them.

For the advanced user, the possibilities of this crawler are pretty close to endless. Using X-path or other extractions, you can crawl generally any content from any page on the internet. I've used it to pull all the blog post titles from sites, craiglist job descriptions etc. Review collected by and hosted on G2.com.

There's very little to dislike about this tool but, if I had to choose something, I would say that if your computer isn't very good, this program can essentially lock up your PC performance wise until it's done. You can configure it to take up less resources but then it goes slower and at it's default configurations it can really affect your ability to just "set it and forget it" Review collected by and hosted on G2.com.

I really like how simple it is to export data: ScreamingFrog allows you to develop a SEO strategy by analyzing how the website responds to a crawler. It requires some knowledge though, as it's not one of those tools that gives you an automatic report. Well, if you want to do good SEO, a little effort is required! Review collected by and hosted on G2.com.

I have nothing serious to complain about this software. There is a limit of 500 URLs crawling for the free version, but the price of a full license is quite low and ScreamingFrog is too valuable to do without. Review collected by and hosted on G2.com.