Crawling Blogs
October 9th, 2008Through a period when my blog was updated only once, this is how Feedburner viewed bots.
Note that crawling blogs is an interesting problem:
- Recency is critical
- Ping servers are available, albeit with incomplete coverage
Crawling blogs is also highly resource intensive:
- Network latency
- Disk access/write latency
How do your numbers look?
October 10th, 2008 at 11:02 pm
[…] Crawling Blogs (tags: myposts) […]