This page illustrates techniques for running SPIDER using the Pubsub system on a cluster.
With Pubsub, SPIDER procedures can be run in parallel on a distributed cluster of computers or within a single cluster. The user places his SPIDER jobs in a shared que. Each of the subscriber machines can take jobs from the que. Each subscriber machine can specify when it will take jobs and how many jobs it can take at a time. If the machines vary greatly in processing power, it is best to partition the SPIDER jobs so that they will take a reasonable length of time (e.g. 20...60 minutes) so that the subscription process is most efficient. We have provided several master SPIDER procedures that handle the preparation of the parallel SPIDER procedures.
Source: spider/pubsub/pubsub.html Page updated: 6 Mar. 2009 ArDean Leith