distributed-python-for-scripting

Very simple python code for distributing commands over ssh

Much distributed computing software is in the end, under many layers, a simple "ssh somewhere doSomething". This code shows that fact in as few layers as practicable. Uses Python's multiprocessing and subprocess modules to maintain a job queue and manage jobs on remote hosts. At the top level, you generate a list of command lines and simply request they be executed in parallel. Works in Python 2.6 and 3.

Project Information

The project was created on Jul 8, 2011.

Labels:
Academic Python Distributed SSH