http://www.rabbitmq.com/ is a message broker which might be useful to use in implementing inter-process communication.
Ideally, as the frontend gets a job, it (or an intermediary) inspects an updated listed of available worker servers, and sends the job to the server with the most free resources.