Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
Reply-To: varunsaxena@apache.org
In-Reply-To: <CAP4BK9SUFjQ+e+ffp=-eDYPb-NzsLROzK=fZzFcCAvjO_-XioQ@mail.gmail.com>
References: <1489481154988.12454@hortonworks.com> <1489742296302.98222@hortonworks.com>
 <CAPC70Q8QfJ=7NPYEwSnS_ebQwYmisoF6e61P_0U4AvQtUTZ5=Q@mail.gmail.com>
 <1490029375875.97974@hortonworks.com> <CAPC70Q9fWRWMLLOJ+re+0G-i7B=KwzTvcQsKH1Vb0TETn6gn3w@mail.gmail.com>
 <1490033919302.65278@hortonworks.com> <CAP4BK9SUFjQ+e+ffp=-eDYPb-NzsLROzK=fZzFcCAvjO_-XioQ@mail.gmail.com>
From: "varunsaxena@apache.org" <varun.saxena.apache@gmail.com>
Date: Thu, 23 Mar 2017 00:26:38 +0530
Message-ID: <CANyB6pvK1TWOt_jfNXqq6s3tGWy-iBz07TQA9XnjrDzY3D5RqA@mail.gmail.com>
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
To: jdu@hortonworks.com
Cc: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>,
	"hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>,
	"yarn-dev@hadoop.apache.org" <yarn-dev@hadoop.apache.org>,
	"mapreduce-dev@hadoop.apache.org" <mapreduce-dev@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a1143c65a06e7e1054b56528a
archived-at: Wed, 22 Mar 2017 18:56:47 -0000

--001a1143c65a06e7e1054b56528a
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Thanks Junping for creating the release.

+1 (non-binding)

* Verified signatures.
* Built from source.
* Set up a pseudo-distributed cluster.
* Successfully ran pi and wordcount jobs.
* Navigated the YARN RM and NM UI.

Regards,
Varun Saxena.

On Wed, Mar 22, 2017 at 12:13 AM, Haibo Chen <haibochen@cloudera.com> wrote=
:

> Thanks Junping for working on the new release!
>
> +1 non-binding
>
> 1) Downloaded the source, verified the checksum
> 2) Built natively from source, and deployed it to a pseudo-distributed
> cluster
> 3) Ran sleep and teragen job and checked both YARN and JHS web UI
> 4) Played with yarn + mapreduce command lines
>
> Best,
> Haibo Chen
>
> On Mon, Mar 20, 2017 at 11:18 AM, Junping Du <jdu@hortonworks.com> wrote:
>
> > ?Thanks for update, John. Then we should be OK with fixing this issue i=
n
> > 2.8.1.
> >
> > Mark the target version of HADOOP-14205 to 2.8.1 instead of 2.8.0 and
> bump
> > up to blocker in case we could miss this in releasing 2.8.1. :)
> >
> >
> > Thanks,
> >
> >
> > Junping
> >
> > ________________________________
> > From: John Zhuge <jzhuge@cloudera.com>
> > Sent: Monday, March 20, 2017 10:31 AM
> > To: Junping Du
> > Cc: common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
> > yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> >
> > Yes, it only affects ADL. There is a workaround of adding these 2
> > properties to core-site.xml:
> >
> >   <property>
> >     <name>fs.adl.impl</name>
> >     <value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
> >   </property>
> >
> >   <property>
> >     <name>fs.AbstractFileSystem.adl.impl</name>
> >     <value>org.apache.hadoop.fs.adl.Adl</value>
> >   </property>
> >
> > I have the initial patch ready but hitting these live unit test failure=
s:
> >
> > Failed tests:
> >   TestAdlFileSystemContractLive.runTest:60->FileSystemContract
> BaseTest.testListStatus:257
> > expected:<1> but was:<10>
> >
> > Tests in error:
> >   TestAdlFileContextMainOperationsLive>FileContextMainOperatio
> nsBaseTest.
> > testMkdirsFailsForSubdirectoryOfExistingFile:254 =C2=BB AccessControl
> >   TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
> > testMkdirsFailsForSubdirectoryOfExistingFile:190 =C2=BB AccessControl
> >
> >
> > Stay tuned...
> >
> > John Zhuge
> > Software Engineer, Cloudera
> >
> > On Mon, Mar 20, 2017 at 10:02 AM, Junping Du <jdu@hortonworks.com
> <mailto:
> > jdu@hortonworks.com>> wrote:
> >
> > Thank you for reporting the issue, John! Does this issue only affect AD=
L
> > (Azure Data Lake) which is a new feature for 2.8 rather than other
> existing
> > FS? If so, I think we can leave the fix to 2.8.1 to fix given this is
> not a
> > regression and just a new feature get broken.?
> >
> >
> > Thanks,
> >
> >
> > Junping
> >
> > ________________________________
> > From: John Zhuge <jzhuge@cloudera.com<mailto:jzhuge@cloudera.com>>
> > Sent: Monday, March 20, 2017 9:07 AM
> > To: Junping Du
> > Cc: common-dev@hadoop.apache.org<mailto:common-dev@hadoop.apache.org>;
> > hdfs-dev@hadoop.apache.org<mailto:hdfs-dev@hadoop.apache.org>;
> > yarn-dev@hadoop.apache.org<mailto:yarn-dev@hadoop.apache.org>;
> > mapreduce-dev@hadoop.apache.org<mailto:mapreduce-dev@hadoop.apache.org>
> > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> >
> > Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No
> > FileSystem for scheme: adl".
> >
> > The issue were caused by backporting HADOOP-13037 to branch-2 and
> earlier.
> > HADOOP-12666 should not be backported, but some changes are needed:
> > property fs.adl.impl in core-default.xml and hadoop-tools-dist/pom.xml.
> >
> > I am working on a patch.
> >
> >
> > John Zhuge
> > Software Engineer, Cloudera
> >
> > On Fri, Mar 17, 2017 at 2:18 AM, Junping Du <jdu@hortonworks.com<mailto=
:
> jd
> > u@hortonworks.com>> wrote:
> > Hi all,
> >      With fix of HDFS-11431 get in, I've created a new release candidat=
e
> > (RC3) for Apache Hadoop 2.8.0.
> >
> >      This is the next minor release to follow up 2.7.0 which has been
> > released for more than 1 year. It comprises 2,900+ fixes, improvements,
> and
> > new features. Most of these commits are released for the first time in
> > branch-2.
> >
> >       More information about the 2.8.0 release plan can be found here:
> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
> >
> >       New RC is available at: http://home.apache.org/~
> > junping_du/hadoop-2.8.0-RC3
> >
> >       The RC tag in git is: release-2.8.0-RC3, and the latest commit id
> > is: 91f2b7a13d1e97be65db92ddabc627cc29ac0009
> >
> >       The maven artifacts are available via repository.apache.org
> <http://
> > repository.apache.org> at: https://repository.apache.org/
> > content/repositories/orgapachehadoop-1057
> >
> >       Please try the release and vote; the vote will run for the usual =
5
> > days, ending on 03/22/2017 PDT time.
> >
> > Thanks,
> >
> > Junping
> >
> >
> >
>

--001a1143c65a06e7e1054b56528a--