hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "CUDA On Hadoop" by ChenHe
Date Mon, 14 Mar 2011 16:26:53 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "CUDA On Hadoop" page has been changed by ChenHe.
http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop?action=diff&rev1=11&rev2=12

--------------------------------------------------

  
  With all the parts ready, we developed a set of scripts for launching the experiment. Specifically,
we perform the following steps in the scripts for all programs:
  
- 1. Set up environment variables;
+     * Set up environment variables;
- 
- 2. Generate input data;
+     * Generate input data;
- 
- 3. Remove old data and upload new data to HDFS;
+     * Remove old data and upload new data to HDFS;
- 
- 4. Upload program binary onto HDFS (if changed);
+     * Upload program binary onto HDFS (if changed);
- 
- 5. Remove the output directory from the previous run;
+     * Remove the output directory from the previous run;
- 
- 6. Submit the program as a MapReduce Job and start timer;
+     * Submit the program as a MapReduce Job and start timer;
- 
- 7. Report the runtime measurements and timestamps.
+     * Report the runtime measurements and timestamps.
  
  Observing that the launching logic of all programs are very similar (only the arguments
to the input generators and program names differ), we have developed a common driver script
which is parameterized by each individual launch script and performs all the processing accordingly.
Thus, this modularization enables us to write launch scripts for new programs easily with
a few lines of code only.
  

Mime
View raw message