How Fast Do Search Engines Index Fresh Content

posted by   techie (184)   16 months ago (labnol.blogspot.com)

Yesterday was a unique day in the blogosphere. Following the crackdown by Digg staff, the infamous hex key - 09 f9 11 02 9d 74 e3 5b d8 41 56 c5 63 56 88 c0 - was written all over the Internet from blogs to news portals to social websites.Legal issues apart, this mutiny at Digg gives us a great opportunity to compare the indexing behaviour of search engines and how frequently search bots scroll the web in pursuit of fresh content.We executed a search for 09 f9 11 02 9d 74 e3