Archive for June, 2010

PyMPI vs. mpi4py

Tuesday, June 29th, 2010

In PyMW 0.4 we decided to change from using pympi to mpi4py for the PyMW MPI interface. pympi has not been updated in six years, whereas mpi4py is part of the SciPy suite and very well supported. This also allows us to remove the MPI manager function from a separate file so the MPI interface is now entirely self contained. There may still be problems involving external data using MPI without a shared filesystem, though these will be fixed in the next release. The interface also correctly checks for mpi4py now, and gracefully quits if it is not available.

PyMW 0.4

Tuesday, June 29th, 2010

PyMW 0.4 has been released after work to update the interfaces and add support for Python 3.

Major Changes in 0.4

  • Added support for Python 3.0 (tested with Python 3.1)
  • Added Ganga interface (contributed by Wayne San)
  • Added helper methods to simplify application setup
  • Improved error detection and handling
  • Changed MPI interface to use mpi4py (included with SciPy) rather than pympi

Download

PyMW 0.4 (June 29, 2010)

Ganga Interface

Monday, June 14th, 2010

Big thanks to Wayne San for submitting the Ganga interface!

Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources.

Wayne’s Ganga interface will be included in the 0.4 release of PyMW.