hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsuyoshi OZAWA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster
Date Fri, 23 Jan 2015 15:12:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289355#comment-14289355
] 

Tsuyoshi OZAWA commented on YARN-3086:
--------------------------------------

{code}
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager 
{code}

Oops, maybe hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
 is better. 

{code}
cd hadoop # change directory to 
mvn clean install -DskipTests # compile and install related jars into local repository
cd hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager 
mvn test # launch test for hadoop-yarn-server-resourcemanager 
{code}

It can take 1 hour or more.If you suffer the waiting time, you can skip to launch the test
since I'll help you to submit Jenkins CI with your patch.

> Make NodeManager memory configurable in MiniYARNCluster
> -------------------------------------------------------
>
>                 Key: YARN-3086
>                 URL: https://issues.apache.org/jira/browse/YARN-3086
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: test
>            Reporter: Robert Metzger
>            Priority: Minor
>         Attachments: YARN-3086.patch
>
>
> Apache Flink has a build-in YARN client to deploy it to YARN clusters.
> Recently, we added more tests for the client, using the MiniYARNCluster.
> One of the tests is requesting more containers than available. This test works well on
machines with enough memory, but on travis-ci (our test environment), the available main memory
is limited to 3 GB. 
> Therefore, I want to set custom amount of memory for each NodeManager.
> Right now, the NodeManager memory is hardcoded to 4GB.
> As discussed on the yarn-dev list, I'm going to create a patch for this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message