Buildbot is a project mainly written in ..., it's free.
Collection of scripts to run buildbots
Tutorial: How to use Buildbot, can be found at http://github.com/hpfem/hermes/wiki/Buildbot-HowTo