Majestic SEO vs Moz Vs aHrefs vs Webmaster Tools

Majestic SEO vs Moz Vs aHrefs vs Webmaster Tools – Which One is Best?

A few weeks ago Eric Enge from Stone Temple invited me to participate in a “Majestic SEO vs Open Site Explorer” shootout. The questions and approach were solid, and interesting. From the perspective of a battle hardened SEO, how would each tool rate on update frequency, correlation with rankings, the quality of their APIs, etc?

Based on recent observation of some of SEOmoz’s challenges with scaling and subsequent index update delays, I rated them particularly low in the update frequency stakes. The perception, of course, would be that Majestic Fresh would be superior. I also *completely* guessed on the request to rate: “Percent of links reported by Moz & Majestic that still exist”.

I’m going to be completely honest. My ratings, comments and scoring were initially based on guestimates. Experienced, yes, but not satisfactory. My guesses were based on the sum total of experience gained through many different link analyses, SEO projects, consumed blog posts and marketing messages. None of these were based on a fair study comparing the tools, like for like, at the same time with the same data on the same domain. I felt pretty bad, therefore about the way I scored on each point.

On that note, I went and spent (probably far too much) time comparing the link data on SEOgadget.co.uk as provided by Majestic SEO (Fresh and Historic Indices), Open Site Explorer, Google Webmaster Tools, AHrefs and Searchmetrics. Then, I emailed Eric with my revised answers. It all felt, a lot fairer.

What’s contained in this blog post is (in my opinion) a more neutral comparison of the tools from the perspective of the data, it’s validity and total coverage. Now I’ve thought about the data I really feel the difference in how I understand how these tools work, their strengths and their weaknesses. It’s an extremely worthwhile thing to do, and I recommend you give it a go yourself sometime.

Something that I do feel important to note is this – crawling the URL data for the 100,000’s of URLs for this study was difficult enough. I can’t imagine the scale of the operation required to pull off a usable index of 150bn+ URLS.

Frankly – anyone attempting to create an index of the web; and maintain it, deserves your respect. Many of the providers offer services beyond link analysis – Searchmetrics, for example may have the smallest link index size for SEOgadget in this study, but they’re newcomers to link data indexation and analysis compared to the others. Searchmetrics are (in my opinion) the best at search and social visibility data tracking. AHrefs have some very unique features and SEOmoz have a powerful site crawling tool, rank tracking service and keyword research tools. Google Webmaster Tools are, well they’re Google, aren’t they.

The Study

In my work, I downloaded a CSV export of all links to our old domain SEOgadget.co.uk from each of the tools. I used SEO tools for Excel on my desktop SEO workhorse to gather the latest server header responses for each URL and extracted the root domain from each to allow a count of the number of unique root domains in the data. This took considerable time, particularly in the larger datasets from Google Webmaster Tools and Majestic Historic. In brief, my key data points were:

– Number of rows in each export
– Duplication in data (by linking URL)
– Number of links reported
– Number of unique linking root domains
– Number of links live (200 or 301 / 302 redirect)
– Server Headers to analyse the composition of each index (expressed as 200, 301, 302, 4xx and 5xx)
– Coverage of all links (calculated by merging all root domains from every tool, de-duplicating and calculating a % of coverage each tool offers)

Totals Summary (Click to enlarge)

Master Totals - Small

*small amend in this screenshot – there was an error in the #live links for Majestic Fresh – fixed in the rest of the article!

Who Provides the Most Data?

Data makes the world of serious SEO go-around. But who has the most? This is a count of the number of rows of data downloaded in each export, and the number of duplicates removed from each.

data-duplication-row-count

True to their word, Majestic have a seriously large index. We extracted 62944 rows of data,  17,725 of which were duplicate (by source URL only – there could be, for example, a separate row of data for every link on the same page). Thankfully, Google Webmaster Tools are great about allowing us to download all of the link data, even though they limit us to the first 1,000 errors found via their web crawler.

PRODUCT #Rows #Dupes
MAJESTIC HISTORIC 62944 17725
GWMT 28719 326
OSE 6605 621
MAJESTIC FRESH 14787 3885
aHrefs 2946 447
SEARCHMETRICS 2896 83

 

How Many Links and Unique Linking Root Domains are Reported?

Domain diversity is the most important aspect of serious link data analysis. How wide a net do each of these tools cast?

links-reported-vs-root-domain-comparision

Again, Majestic’s Historic index rules the roost with the number of links reported, but the winner here is Google Webmaster Tools, for sheer domain diversity, their data seems to cast the widest net. Open Site Explorer reported a slightly higher number of root domain links(1696 from OSE, vs 1687 from Majestic Fresh). Note the vast drop off between the number of links reported by Majestic Fresh and the actual domain diversity in the data. Majestic tend to crawl deep on any one site, reducing the diversity of the data but increasing the sheer link count:

PRODUCT #Links Reported #UNIQUE RDs
MAJESTIC HISTORIC 45219 3224
GWMT 28393 4436
OSE 5984 1696
MAJESTIC FRESH 10902 1687
aHrefs 2499 500
SEARCHMETRICS 2813 144

 

How Many Links are Still Live?

We’ll come on to the composition of each of the tool’s indices later in the post, suffice it to say that tracking new and lost links is an emerging and important requirement from the SEO community. While their index is comparitively small, AHrefs are excellent at reporting on new and lost links through their user interface. As their index grows this will become a powerful tool.

links-reported-vs-links-live

I was pleasantly surprised by just how many links remain live (definition of live for this study is responds with 200 or 301/2 redirect) in the Majestic Historic Index. My perception had been that their index accumulates the data and contains, therefore, very large volumes of 4xx errors. It’s worth noting that around half of Majestic Fresh’s index responds with a 301 redirect. In a lot of cases this seems to be missing trailing slashes in the export data. I’ve observed that, while the root domain diversity of OSE and Majestic Fresh are very similar, Majestic Fresh tends to crawl more pages on each domain. This would explain the larger index count with similar levels of domain diversity in the data.

PRODUCT #UNIQUE RDs #Links Live (200 + 3xx)
MAJESTIC HISTORIC 3224 38412
GWMT 4436 26867
OSE 1696 5536
MAJESTIC FRESH 1687 9972
aHrefs 500 2432
SEARCHMETRICS 144 905

 

Who Has the Best Coverage?

What tool casts the widest net? Is there such a thing as perfect when it comes to a link tool? Clearly, Google Webmaster Tools reports on the most diverse range of domains but does that mean it’s got the whole internet covered? No, none of them do. I took every single root domain reported by each tool and created a master list of 6,755 unique linking root domains pointing to SEOgadget. Of those, 5,682 of them are still live domains. Then I divided the number of reported linking root domains from each tool by the aggregate number to calculate a % of coverage. Obviously this assumes that the aggregated list represents the truly complete list of all domains that link to SEOgadget.

live-link-coverage

Google Webmaster Tools came out best, with Majestic Historic 2nd and Majestic Fresh and OSE a tied 3rd. AHrefs have done well for a small startup! Noone reports anything like 5,682 linking root domains to SEOgadget.

For the tool providers with the largest index sizes (GWMT, Majestic, OSE), here is a break down of the server header responses found in the data:

Index Composition – Google Webmaster Tools

gw-tools-index-composition-summary

Response Server Header Count
200 26862
4xx 1209
5xx 359
Grand Total 28430

Index Composition – Majestic Fresh and Historic

majestic-historic-index-composition-summary

Response Server Header Count
200 28874
301 8313
4xx 6233
302 1225
5xx 572
Grand Total 45217

majestic-fresh-index-composition-summary

Response Server Header Count
200 5289
301 4683
4xx 676
302 159
5xx 94
Grand Total 10901

 

Index Composition – Open Site Explorer

ose-index-composition-summary

Response Server Header Count
200 5218
4xx 316
302 176
301 142
5xx 131
Grand Total 5983

 

Missing links in Fresh Index Iterations

As an interesting side note, I discovered an irregularity between two fresh index updates in Majestic. The updates were downloaded between the 24th June 2012 and the 27th June 2012. I found there were links missing by comparing the newer (larger) update to the older update. It’s really obvious that there’s an age related cut off point, where links older than a certain number of days (around 90?) get removed from the fresh index. At this point they’re added to the historic index (though it’s altogether possible they’re added much sooner than this and duplicated for a time).

I checked, and there were chunks of links missing from inside the 90 day window:

The red highlighted rows in the data table belong to a date range that no longer forms part of the fresh index. What’s really interesting is that the 26th (and onwards) exist in both exports – a like for like comparision reveals chunks of missind data.

I didn’t expect to find that links were missing from periods inside this update cycle – 280 to be exact, though small numbers on a daily basis. Of those, 149 responded with a 200 server header response, 103 were 301 or 302 and 27 were “proper” error codes.

To be fair, some data loss is hardly unavoidable – it took me long enough to crawl the 95,000 or so sum total links reported by all 4 tools! Crawling billions of URLs is no joke. It’s also important to point out that the fresh index had grown by some 1,000 links in this period. As a wild theory, I considered whether Majestic choose not to include blocks of links if they don’t receive data in that particular iteration, rather than attempting additional recrawl cycles between updates. In any case, I’m sure these links would be re-included in another iteration (which are extremely regular!).

Which Tool is The Best?

This after all, was the point of the article. Frankly, it’s down to Open Site Explorer, the Majestic Index and Google Webmaster Tools for pure play link data collation and analysis. If, like me you most frequently opt to analyse the data outside of the UIs provided by the vendors then your choice is simple. You need to work with data from all 3 as a bare minimum. The bottom line is this – I would consolidate and de-dupe the data from all 3 to get the most complete picture of my backlinks. While Majestic and Google Webmaster Tools have the “most” data, they’re not complete. Open Site Explorer is about on par with Majestic Fresh (it’s slightly better in this case) but the data is different.

They all have differing crawl depths, index compositions, user interfaces and additional features. I can’t see how any serious link analysis would omit data from any of these sources. On a product development note, I really wish Google Webmaster Tools would make their link data available via the API.

On a final note, since writing this post it’s important to point out that SEOmoz have rolled out another update (here’s the announcement) – I’d also like to give a special shout to Branko Rihtman, who carried out a fascinating in-depth analysis across MANY domains to come to his answers.



Stay Updated: Sign Up for Webinar & New Blog Alerts

16 thoughts on “Majestic SEO vs Moz Vs aHrefs vs Webmaster Tools

  1. Neil Hart says:

    I read the shootout article a few days ago with great interest, so it’s excellent to see a data-evidenced follow up. I really appreciate your efforts.

    As an in-house marketer at a relatively small company, my budget is limited to a few paid tools at any given time, so I have to pick and choose carefully those that we subscribe to. Interestingly enough, the three tools you conclude are the bare minimum are also the three I’ve come to rely on as my main sources of link data, Majestic, OSE and GWT. Whilst this decision was obviously based on my own experiences and hunches, it’s reassuring to see it played out in the data.

  2. Hi Neil,

    Absolutely – budget constraints exist everywhere. We’re pretty much the same, though we also use aHrefs regularly and of course, our own tools (http://tools.seogadget.co.uk)

  3. ketan raval says:

    Important of Investing on Link & Website Health Analysis is going to be more and more prolific .. For Small Businesses previously it was not that important. but now no matter how limited your budget is.. using these tools are important…

    Richard.. I think Bing Webmaster tool is also good one to have in Tool list ??

  4. Johnny says:

    This is very cool analysis about the various backlink companies. Although I’m not a big fan of including my websites into WMT and prefer Majestic SEO data, this was interesting to read. What software did you use to analysis the backlink data? I ran a few tests using your backlink analysis program, but noticed some major bugs, so I assume it was a different program or the inhouse program is better?? Off topic, but if you know of a good alternative to Cognitive SEO I would love to know. Keep up the great work, I respects your blog.

  5. Hi Johnny, I used a combination of SEO Tools for Excel & Screaming Frog.

    We’re scaling our tool to be able to cope with larger data sets, in the meantime if you’ve seen a bug, it would be nice if you could tell us what you saw so we can improve the platform.

  6. Nice review Richard! This makes me some clarification which tool is really the best when checking all of your backlinks! Well, I actually preferred SEO Majestics because there are lots of seo experts are really recommend this tool.. Thanks again!

  7. Tiggerito says:

    I did a similar study a few months back just as Yahoo Site Explorer was ending. Google “Finding the Best Backlink Explorer” to find it.

    One weakness in your study is that it’s based on a single domain that has a lot of backlinks. This helps Majestic score better than GWMT as it provides all the backlinks it knows and not just a subset. That is also why GWMT returns more domains as the subset it returns is spread across all the domains it has found backlinks from.

    I also analysed Bing WMT which scored quite well.

  8. Sigh. Must try harder.

  9. Ian McIntosh says:

    One of the best summary pieces I’ve read recently. A brief follow up summary of OSE taking into account of July’s update would be very interesting!

  10. Johannes says:

    Would be nice if you could include our link data as well. Sistrix is quite popular in Germany and I’m confident that we could provide another view to the whole link index.

    A short preview of your domain is available here: http://helios.sistrix.com/seogadget.png – the raw data here: http://helios.sistrix.com/links_seogadget-co-uk.csv.gz

    If anyone is interested in a free account, just drop me a mail: j.beus@sistrix.com

  11. Chris says:

    There is a new backlink database in germany at http://www.seokicks.de which provides very good data, at least for german domains. It would be very interesting to see how this tool performs for international domains, maybe you are going to test it as well? It has some nice features and the best one is that it’s complety free, including the xml api.

  12. Matthew Hunt says:

    I wish cemper tools was in this study too. Nice work. I use almost all of them, but should edit down on tools. Have way too many.

  13. I have to agree with Matthew Hunt.. I was pretty sure when I saw the headline, that you would have included Cemper Linkresearchtools…

  14. I’d really like to know whether those “international” tools would show the same results in German speaking countries like Austria, Germany and Switzerland, Germany being the largest market by far.
    Meaning: Do those tools including GWMT really beat local tools like sistrix and cemper?

  15. fashion says:

    I get this question asked quite a bit as many small businessowners just don like bookkeeping or don have the time.

  16. Spook SEO says:

    Hey Richard great post! Majestic SEO has so far been the best performing tool for me. Then again, it also depends on what data you need to so I can’t really say that there’s a one size fits all tool.

    Thanks for sharing your data. Cheers!

Comments are closed.