Abstract:

D. Hutchinson, Parallel Algorithms in External Memory (research summary), Carleton Journal of Computer Science, No. 3, 1999, pp. 49-56.

External memory (EM) algorithms are designed for computational problems in which the size of the internal memory of the computer is only a small fraction of the problem size. In this work we develop simulation techniques which produce efficient EM algorithms from efficient algorithms developed under BSP-like parallel computing models. Our techniques can accommodate one or multiple processors on the EM target machine, each with one or more disks, and they also adapt to the disk blocking factor of the target machine. We propose a more comprehensive cost model for EM algorithms, which considers the total costs incurred by the algorithm including computation, input/output (I/O) and communication costs. We obtain parallel external memory algorithms for a large number of problems including sorting, permutation, matrix transpose, several geometric and GIS problems including 3D convex hulls (2D Voronoi diagrams), and various graph problems. All of the algorithms obtained via simulation are analyzed with respect to the computation time, communication time and I/O time. Our results answer to a challenge posed by the ACM working group on storage I/O for large-scale computing.



Last modified: Wed Oct 27 14:29:53 EDT 1999