hama-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hama Wiki] Update of "GettingStartedYARN" by edwardyoon
Date Mon, 23 Mar 2015 03:52:04 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hama Wiki" for change notification.

The "GettingStartedYARN" page has been changed by edwardyoon:
https://wiki.apache.org/hama/GettingStartedYARN?action=diff&rev1=5&rev2=6

  This tutorial requires Hadoop 2.x already correctly installed. 
  If you haven't done this yet, please follow the official documentation https://hadoop.apache.org/docs/stable/
  
- == How to run the Hama-YARN example ==
- 
- TODO this must be revised once the example has moved the jar.
- 
- {{{
- bin/hama jar hama-yarn-0.7.0-SNAPSHOT.jar org.apache.hama.bsp.YarnSerializePrinting
- }}}
- 
- Once running, you should see in the spawned application master log that it is launching
containers.
- When the containers launched, you can see in the logs that there is a little "Hello World"
from the other tasks.
- 
  == How to write a Hama-YARN job ==
  
  The [[BSPModel]] hasn't changed, but the way to submit a job has.
@@ -35, +24 @@

  
  {{{
      HamaConfiguration conf = new HamaConfiguration();
-     conf.set("yarn.resourcemanager.address", "0.0.0.0:8040");
+     YARNBSPJob job = new YARNBSPJob(conf);
  
-     YARNBSPJob job = new YARNBSPJob(conf);
      job.setBspClass(HelloBSP.class);
      job.setJarByClass(HelloBSP.class);
      job.setJobName("Serialize Printing");
@@ -58, +46 @@

  
  There are some configuration values that the job needs to have in order to submit sucessfully
to YARN infrastructure.
  
- The importantest configuration is the {{{yarn.resourcemanager.address}}}. This should point
to the address (hostname+port) where your ResourceManager runs, for example {{{localhost:8040}}}.
+ The importantest configurations are the {{{yarn.resourcemanager.address}}} and {{{fs.default.name}}}.
This should point to the address (hostname+port) where your ResourceManager and HDFS Namonode
runs, for example {{{localhost:8040}}}, {{{hdfs://localhost:9000}}}.
  
  Another important configuration value is the amount of memory used by the BSPApplicationMaster.
You can configure a base amount of memory for the application master with this configuration
key
  {{{
@@ -123, +111 @@

  
  to submit a Hama job. You can just change the {{{BSPJob}}} to {{{YARNBSPJob}}}.
  
+ == Hama-YARN example ==
+ 
+ TODO this must be revised once the example has moved the jar.
+ 
+ {{{
+ bin/hama jar hama-yarn-0.7.0-SNAPSHOT.jar org.apache.hama.bsp.YarnSerializePrinting
+ }}}
+ 
+ Once running, you should see in the spawned application master log that it is launching
containers.
+ When the containers launched, you can see in the logs that there is a little "Hello World"
from the other tasks.
+ 

Mime
View raw message