hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Naganarasimha Garla <naganarasimha...@gmail.com>
Subject Re: [VOTE] Release Apache Hadoop 2.6.4 RC0
Date Mon, 08 Feb 2016 19:01:04 GMT
+1 (non binding)

* Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
install, and verified the MD5 checksum
* Did a Pseudo cluster and tested basic hdfs operations
* Ran sleep job and Pi job
* Added node label and ran job under the label by
configuring default-node-label-expression and it ran fine

Eric Payne,
Hope you tried adding/replacing the labels using NodeId/Node Address and
not the HTTP address!
I executed the following command to configure the label and node
  "./yarn rmadmin -replaceLabelsOnNode  "localhost:43795,test1"  "
After this was able to submit the job for a label

+ Naga

On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne <
eric.payne1000@yahoo.com.invalid> wrote:

> Hi Junping Du. Thank you for your work preparing this release.
> I did the following things to test release Hadoop 2.6.4 rc0:-
> Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
> install, and eclipse:eclipse- Set up a 3-node, unsecured cluster with 3
> queues, one of which has preemption enabled- Ran a successful test to
> ensure that preemption would happen to containers on the preemptable queue
> if they were needed for an application on another queue.- Ran successful
> streaming and yarn shell tests
> Junping, I did have a concern about labelled nodes and queues. Is full
> label support backported to 2.6.4? I see that the syntax for the rmadmin
> command lists label commands like -addToClusterNodeLabels
> and -replaceLabelsOnNode. I was able to add a label
> (using -addToClusterNodeLabels) and I was able to define a queue whose
> accessible node label was listed with my specified label. However, when I
> tried to set the node label to a specific node using -replaceLabelsOnNode,
> the label does not show up on the specified node in cluster nodes UI (
> http://RM:8088/cluster/nodes). I also confirmed that submitting a job to
> the labelled queue gets accepted but never runs, which is the behavior I
> would expect if no node had the specified label. I will also add that this
> procedure works fine in 2.7.
> Thanks,-Eric Payne
>       From: Junping Du <jdu@hortonworks.com>
>  To: "hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>; "
> yarn-dev@hadoop.apache.org" <yarn-dev@hadoop.apache.org>; "
> mapreduce-dev@hadoop.apache.org" <mapreduce-dev@hadoop.apache.org>; "
> common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
>  Sent: Wednesday, February 3, 2016 1:01 AM
>  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
> Hi community folks,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
> maintenance release to follow up 2.6.3.) according to email thread of
> release plan 2.6.4 [1]. Below is details of this release candidate:
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> <http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/>*
> The RC tag in git is: release-2.6.4-RC0
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
> <https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> >*
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> Please try the release and vote. The vote will run for the usual 5 days.
> Thanks!
> Cheers,
> Junping
> [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message