If this sites a Rockin’, Google comes a Knockin’ — How to use crawl information to your advantage


09.20.07 Posted in Google Analytics, Search Engine Optimisation by Barry

I’ve just come back from Digiweb’s Online Edge Sem­i­nar, where Damien Mul­ley raised some­thing inter­est­ing about how often Google indexed his blog con­tent, around 15 min­utes after con­tent was pub­lished, Google was live and on the scene index­ing Damien’s lat­est posts.

Damien blogs often, many times a day, so know­ing that his con­tent is indexed so often allows him to be able to respond very quickly to top­i­cal issues (Some­thing I’m sure he takes advan­tage of), but this can also be use­ful for sites that are indexed at a slower rate. By know­ing the fre­quency of Googlebot’s visit, you can make an informed deci­sion to push out content.

An exam­ple of this may be a Press Release or News Item on your web­site, if your site is being indexed at a slower rate, say every 7 days, get­ting that fresh con­tent out before Google­bot can be hugely impor­tant to see it being returned in the SERPs (Search Engine Results Pages)

Of course cre­at­ing fresh and inter­est­ing con­tent, will mean Google­bot likes you and will come back more often, like a free­loader to a beer sam­pling party.

Mea­sur­ing when Google­bot comes, and it’s fre­quency is pos­si­ble by analysing your web logs, or a much eas­ier method (and more pro­duc­tive) is by cre­at­ing a sitemap and upload­ing it for use with Google Web­mas­ter Tools

A sitemap allows you to tell Google when you have new con­tent, and cre­ates a read­able file con­tain­ing links and infor­ma­tion about the pages on your site.

Cre­at­ing sitemap files, ensures Google knows all about what pages are on your site, with Web­mas­ter Tools, you can also see lots of other cool infor­ma­tion about your website.

Using these bits of infor­ma­tion can give you a bet­ter insight into how Google views your site, and after all isn’t that what it’s all about?

Share and Enjoy:
  • Twitter
  • del.icio.us
  • Facebook
  • Google Bookmarks
  • StumbleUpon


blog comments powered by Disqus