hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Minho Kim (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-931) Make the HAMA base path configurable
Date Fri, 20 Mar 2015 05:14:38 GMT

    [ https://issues.apache.org/jira/browse/HAMA-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370744#comment-14370744
] 

Minho Kim edited comment on HAMA-931 at 3/20/15 5:13 AM:
---------------------------------------------------------

There are several YARN related properties that must be set in hama-site.xml:

{code}
<property>
    <name>bsp.framework.name</name>
    <value>yarn</value>
</property>
{code}

In order to run Hama on YARN, it must be set above value.
{code}
<property>
    <name>hama.zookeeper.quorum</name>
    <value>comma saparated list of servers</value>
</property>
{code}

If zookeeper is not runnning, ApplicationMaster starts the sync server to refer to property.
But There is a problem with running the sync server because of HAMA-935.
I'll fix it.

Thanks.


was (Author: conquestor):
There are several YARN related properties that must be set in hama-site.xml:

{code}
<property>
    <name>bsp.framework.name</name>
    <value>yarn</value>
</property>
{code}

In order to run Hama on YARN, it must be set above value.

<property>
    <name>hama.zookeeper.quorum</name>
    <value>comma saparated list of servers</value>
</property>

If zookeeper is not runnning, ApplicationMaster starts the sync server to refer to property.
But There is a problem with running the sync server because of HAMA-935.
I'll fix it.

Thanks.

> Make the HAMA base path configurable
> ------------------------------------
>
>                 Key: HAMA-931
>                 URL: https://issues.apache.org/jira/browse/HAMA-931
>             Project: Hama
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 0.6.4
>            Reporter: Edward J. Yoon
>            Assignee: Minho Kim
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HAMA-931.patch, HAMA-931_v01.patch
>
>
> I just noticed that the pathes of HAMA_HOME and dependencies are hard-coded and not configurable.
Please make this configurable.
> {code}
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: Got Cluster node info from ASM
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: Got node report from ASM for, nodeId=localhost:57768,
nodeAddresslocalhost:8042, nodeRackName/default-rack, nodeNumContainers0
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: Queue info, queueName=default, queueCurrentCapacity=0.0,
queueMaxCapacity=1.0, queueApplicationCount=0, queueChildQueueCount=0
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: User ACL Info for Queue, queueName=root,
userAcl=SUBMIT_APPLICATIONS
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: User ACL Info for Queue, queueName=root,
userAcl=ADMINISTER_QUEUE
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: User ACL Info for Queue, queueName=default,
userAcl=SUBMIT_APPLICATIONS
> 15/03/06 11:23:04 INFO bsp.YARNBSPJobClient: User ACL Info for Queue, queueName=default,
userAcl=ADMINISTER_QUEUE
> Exception in thread "main" java.io.FileNotFoundException: File /home/hadoop/hama-0.6.4.tar.gz
does not exist
>  at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:534)
>  at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:747)
>  at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:524)
>  at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:409)
>  at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
>  at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1905)
>  at org.apache.hama.bsp.YARNBSPJobClient.launchJob(YARNBSPJobClient.java:239)
>  at org.apache.hama.bsp.BSPJobClient.submitJobInternal(BSPJobClient.java:395)
>  at org.apache.hama.bsp.YARNBSPJob.submit(YARNBSPJob.java:74)
>  at org.apache.hama.bsp.YARNBSPJob.waitForCompletion(YARNBSPJob.java:90)
>  at org.apache.hama.bsp.YarnSerializePrinting.main(YarnSerializePrinting.java:74)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
>  at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>  at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message