The top story today was Rupert Murdoch sort of saying that News Corp might start using robots.txt on Google to prevent its stuff from being indexed. Or that's how it was interpreted on the internets anyway. Nevermind that he probably meant something different -- that News Corp will erect pay walls around its online content the way it now does with the Wall Street Journal: a headline and a paragraph of text for free, and everything else is paid.
(Well, it's not how it actually works, but whatever, it's complicated. In the same interview, Murdoch says his problem is not with Google, who's been easy to deal with.)
I giggle like a schoolgirl every time people say something along the lines "The guy is stuck on stupid if you ask me. I think he may be still be living in “tangible newspaper land” also known as the year 1995" (a Techcrunch verbatim). When a "stuck on stupid" guy is worth four billion bucks he has made himself, you'd figure it is not too generous to assume that he might know a thing or two about the biz.
The general consensus seems to be that blocking off Google's spiders will result in a significant traffic drop to News Corp's online properties. I've seen a lot of web traffic reports with Google leading the referrer list, so this collective opinion made sense. Then Hitwise posted some stats showing WSJ.com gets 25% of its traffic from Google's regular and news searches, so that seemed settled.
But I was curious enough to login into Compete Pro and fish out a few numbers. What you see are the top three referrers to some of News Corp's online properties in the US along with their share of traffic among all referrers.
Top Referrer: Google
- nypost.com: google.com (13.33%), yahoo.com (7.48%), drudgereport.com (4.43%)
- foxnews.com: google.com (11.43%), facebook.com (8.34%), yahoo.com (7.59%)
- fox.com: google.com (22.87%), facebook.com (9.03%), yahoo.com (8.01%)
- askmen.com: google.com (32.99%), digg.com (14.73%), yahoo.com (6.31%)
- americanidol.com: google.com (41.22%), facebook.com (8.53%), yahoo.com (8.51%)
- ign.com: google.com (26.86%), yahoo.com (6.30%), facebook.com (5.89%)
- rottentomatoes.com: google.com (21.19%), yahoo.com (8.11%), ign.com (6.40%)
- harpercollins.com: google.com (26.51%), twitter.com (16.71%), yahoo.com (5.71%)
- hulu.com: google.com (13.82%), facebook.com (13.36%), yahoo.com (6.74%)
Top Referrer: Other
- wsj.com: msn.com (21.43%), yahoo.com (13.12%), google.com (11.24%)
- barrons.com: wsj.com (28.91%), msn.com (18.04%), yahoo.com (17.32%)
- dj.com: wsj.com (28.91%), msn.com (18.04%), yahoo.com (6.02%)
- newscorp.com (corporate site): fox.com (23.44%), google.com (14.69%), yahoo.com (4.83%)
- myspace.com: facebook.com (16.61% -- that's a headline in itself), yahoo.com (11.17%), google.com (8.78%)
- beliefnet.com: yahoo.com (29%), google.com (7.74%), live.com (5.39%)
- smartmoney.com: yahoo.com (14.92%), google.com (12.18%), financialadvisormatch.com (7.36%)
- marketwatch.com: wsj.net (15.03%), yahoo.com (11.90%), google.com (7.83%)
- foxbusiness.com: foxnews.com (27.18%), yahoo.com (11.45%), google.com (10.10%)
It appears that Google is the top referrer for most of the entertainment stuff but not so much for news. And Murdoch's Dow Jones empire seems to be much less dependent on Google compared to a few other top newspapers for every one of which Google is the top referrer:
- Boston.com (Boston Globe): Google.com (12.61%)
- BostonHerald.com: 15.21%
- NYTimes.com: 19.02%
- WashingtonPost.com: 13.38%
- LATimes.com: 30.28%
- ChicagoTribune.com: 15.74%