Computational Gains Using RPVM on a Beowulf Cluster

Author(s)
Carson, B
Murison, RD
Mason, IA
Publication Date
2003
Abstract
The Beowulf cluster Becker et al. (1995); Scyld ComputingCorporation (1998) is a recent advance incomputing technology that harnesses the power ofa network of desktop computers using communicationsoftware such as PVM Geist et al. (1994) and MPIMessage Passing Interface Forum (1997). Whilst thepotential of a computing cluster is obvious, expertisein programming is still developing in the statisticalcommunity.Recent articles in R-news Li and Rossini (2001)and Yu (2002) entice statistical programmers to considerwhether their solutions could be effectively calculatedin parallel. Another R package, SNOW Tierney(2002); Rossini et al. (2003) aims to skillfullyprovide a wrapper interface to these packages, independentof the underlying cluster communicationmethod used in parallel computing. This article concentrateson RPVM and wishes to build upon the contributionof Li and Rossini (2001) by taking an examplewith obvious orthogonal components and detailingthe R code necessary to allocate the computationsto each node of the cluster. The statistical techniqueused to motivate our RPVM application is the geneshavingalgorithm Hastie et al. (2000b,a) for whichS-PLUS code has been written by Do andWen (2002)to perform the calculations serially.The first section is a brief description of the Beowulfcluster used to run the R programs discussedin this paper. This is followed by an explanation ofthe gene-shaving algorithm, identifying the opportunitiesfor parallel computing of bootstrap estimatesof the "strength" of a cluster and the rendering ofeach matrix row orthogonal to the "eigen-gene". Thecode for spawning child processes is then explainedcomprehensively and the conclusion compares thespeed of RPVM on the Beowulf to serial computing.
Citation
R News: The Newsletter of the R Project, 3(1), p. 21-26
ISSN
1609-3631
Link
Publisher
Technische Universitaet Wien, Institut fuer Statistik und Wahrscheinlichkeitstheorie
Title
Computational Gains Using RPVM on a Beowulf Cluster
Type of document
Journal Article
Entity Type
Publication

Files:

NameSizeformatDescriptionLink
administrative/PREMIS.xml 0.735 KB PREMIS.xml View document
closed/SOURCE01.pdf 71.571 KB application/pdf administrative View document
closed/SOURCE03.pdf 55.696 KB application/pdf administrative View document
administrative/JHOVE.xml 58.79 KB JHOVE.xml View document
administrative/MODS.xml 5.2 KB MODS.xml View document
open/SOURCE02.pdf 98.791 KB application/pdf Publisher version (open access) View document