Conductor

Features


Users

Create

Create user accounts for your team

Note

Register

Register worker machines for users

Schedule

Schedule

Create jobs to be scheduled on worker machines

What is Conductor?


Conductor is a distributed job scheduler and management system. The availability of cheap computing resources, often not even present in the same physical location, now means that many instances of a program one may want to run are no longer local to one's own personal computer. There exist systems to systematically distribute applications across servers, but these typically require a large amount of setup and are optimized for production systems with large loads (i.e. map-reduce systems) rather than manually triggered jobs consisting of smaller periodic tasks where an individual may want to check up on the status frequently.

Conductor allows you to manage jobs on a cluster of machines from a centralized web app and get notifications based on job status. The web format allows usage from any web connected device. Coordination is done in the cloud, so if a client disconnects, jobs will still execute properly. A user can view job output and logs from this web console and specify certain reactive behaviour based on the status of a job, such as notification or retrying of failed jobs.

Why Conductor?


  • Allows you to execute jobs on remote machines.
  • Allows you to specify retry logic on job failure.
  • Allows you to provide conditional execution of jobs, based on:
    • Time events (cron-like functionality)
    • Return codes
    • Output matches a regex
  • Allows you to provide notifications to users based on:
    • Job status
    • Output matching a regex
    • Control and monitor job execution through a user interface.