cron job

This week I worked on lowering the number of queries that SemanticScuttle needs to deliver a bookmark listing page.

Just looking at the front page of a SemanticScuttle instance with 10 or more bookmarks, not logged in, caused 37 SQL queries to be fired to the database.

If you are logged in, doing the same action took SQL 54 queries!

In this new post from Abhinav Singh on how to use file locking to keep your cron jobs from trying to use the same resources.

Anemone is a free, multi-threaded Ruby web spider framework from Chris Kite, which is useful for collecting information about websites.

With Anemone you can write tasks to generate some interesting statistics on a site just by giving it the URL.