Back to Volume
Paper: The Distributed Processing Library (DPL)
Volume: 101, Astronomical Data Analysis Software and Systems V
Page: 61
Authors: Allan, D. J.
Abstract: The Distributed Processing Library (DPL) provides multiple processing services across heterogeneous collections of UNIX workstations for the ASTERIX data analysis package. The DPL programmer provides a worker task to perform the units of parallel computation, and writes the flow control logic in the client using DPL to manage queues of jobs on multiple workers. DPL conceals the interprocess communication from the client and worker processes allowing existing sequential algorithms to be adapted easily. The system has been tested on a mixture of machines running Solaris and OSF, and has shown that the library is useful for units of computation taking as little as 50 milliseconds.
Back to Volume