hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Naganarasimha Garla <naganarasimha...@apache.org>
Subject Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Date Wed, 22 Mar 2017 18:46:56 GMT
Thanks Junping for putting this up,.

+1 (non-binding)

* downloaded verified signature and md5.
* Built from source & deployed  pseudo cluster with labels enabled
* ran some sample jobs with partitions specified.
* Navigate through YARN & MR UI's
* executed basic dfs cmds.

Regards,
+ Naga



On Wed, Mar 22, 2017 at 11:23 PM, Rakesh Radhakrishnan <rakeshr@apache.org>
wrote:

> Thanks Junping for getting this out.
>
> +1 (non-binding)
>
> * downloaded and built from source with jdk1.8.0_45
> * deployed HDFS-HA cluster
> * ran some sample jobs
> * run balancer
> * executed basic dfs cmds
>
>
> Rakesh
>
> On Wed, Mar 22, 2017 at 8:30 PM, Jian He <jhe@hortonworks.com> wrote:
>
> > +1 (binding)
> >
> > - built from source
> > - deployed a pseudo cluster
> > - ran basic example tests.
> > - Navigate the UI a bit, looks good.
> >
> > Jian
> >
> > > On Mar 22, 2017, at 9:03 PM, larry mccay <larry.mccay@gmail.com>
> wrote:
> > >
> > > +1 (non-binding)
> > >
> > > - verified signatures
> > > - built from source and ran tests
> > > - deployed pseudo cluster
> > > - ran basic tests for hdfs, wordcount, credential provider API and
> > related
> > > commands
> > > - tested webhdfs with knox
> > >
> > >
> > > On Wed, Mar 22, 2017 at 7:21 AM, Ravi Prakash <ravihadoop@gmail.com>
> > wrote:
> > >
> > >> Thanks for all the effort Junping!
> > >>
> > >> +1 (binding)
> > >> + Verified signature and MD5, SHA1, SHA256 checksum of tarball
> > >> + Verified SHA ID in git corresponds to RC3 tag
> > >> + Verified wordcount for one small text file produces same output as
> > >> hadoop-2.7.3.
> > >> + HDFS Namenode UI looks good.
> > >>
> > >> I agree none of the issues reported so far are blockers. Looking
> > forward to
> > >> another great release.
> > >>
> > >> Thanks
> > >> Ravi
> > >>
> > >> On Tue, Mar 21, 2017 at 8:10 PM, Junping Du <jdu@hortonworks.com>
> > wrote:
> > >>
> > >>> Thanks all for response with verification work and vote!
> > >>>
> > >>>
> > >>> Sounds like we are hitting several issues here, although none seems
> to
> > be
> > >>> blockers so far. Given the large commit set - 2000+ commits first
> > landed
> > >> in
> > >>> branch-2 release, we may should follow 2.7.0 practice that to claim
> > this
> > >>> release is not for production cluster, just like Vinod's suggestion
> in
> > >>> previous email. We should quickly come up with 2.8.1 release in next
> 1
> > >> or 2
> > >>> month for production deployment.
> > >>>
> > >>>
> > >>> We will close the vote in next 24 hours. For people who haven't vote,
> > >>> please keep on verification work and report any issues if founded -
I
> > >> will
> > >>> check if another round of RC is needed based on your findings.
> Thanks!
> > >>>
> > >>>
> > >>> Thanks,
> > >>>
> > >>>
> > >>> Junping
> > >>>
> > >>>
> > >>> ________________________________
> > >>> From: Kuhu Shukla <kshukla@yahoo-inc.com>
> > >>> Sent: Tuesday, March 21, 2017 3:17 PM
> > >>> Cc: Junping Du; common-dev@hadoop.apache.org;
> > hdfs-dev@hadoop.apache.org
> > >> ;
> > >>> yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> > >>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> > >>>
> > >>>
> > >>> +1 (non-binding)
> > >>>
> > >>> - Verified signatures.
> > >>> - Downloaded and built from source tar.gz.
> > >>> - Deployed a pseudo-distributed cluster on Mac Sierra.
> > >>> - Ran example Sleep job successfully.
> > >>> - Deployed latest Apache Tez 0.9 and ran sample Tez orderedwordcount
> > >>> successfully.
> > >>>
> > >>> Thank you Junping and everyone else who worked on getting this
> release
> > >> out.
> > >>>
> > >>> Warm Regards,
> > >>> Kuhu
> > >>> On Tuesday, March 21, 2017, 3:42:46 PM CDT, Eric Badger
> > >>> <ebadger@yahoo-inc.com.INVALID> wrote:
> > >>> +1 (non-binding)
> > >>>
> > >>> - Verified checksums and signatures of all files
> > >>> - Built from source on MacOS Sierra via JDK 1.8.0 u65
> > >>> - Deployed single-node cluster
> > >>> - Successfully ran a few sample jobs
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Eric
> > >>>
> > >>> On Tuesday, March 21, 2017 2:56 PM, John Zhuge <john.zhuge@gmail.com
> >
> > >>> wrote:
> > >>>
> > >>>
> > >>>
> > >>> +1. Thanks for the great effort, Junping!
> > >>>
> > >>>
> > >>>  - Verified checksums and signatures of the tarballs
> > >>>  - Built source code with Java 1.8.0_66-b17 on Mac OS X 10.12.3
> > >>>  - Built source and native code with Java 1.8.0_111 on Centos
> 7.2.1511
> > >>>  - Cloud connectors:
> > >>>      - s3a: integration tests, basic fs commands
> > >>>      - adl: live unit tests, basic fs commands. See notes below.
> > >>>  - Deployed a pseudo cluster, passed the following sanity tests in
> > >>>  both insecure and SSL mode:
> > >>>      - HDFS: basic dfs, distcp, ACL commands
> > >>>      - KMS and HttpFS: basic tests
> > >>>      - MapReduce wordcount
> > >>>      - balancer start/stop
> > >>>
> > >>>
> > >>> Needs the following JIRAs to pass all ADL tests:
> > >>>
> > >>>  - HADOOP-14205. No FileSystem for scheme: adl. Contributed by John
> > >> Zhuge.
> > >>>  - HDFS-11132. Allow AccessControlException in contract tests when
> > >>>  getFileStatus on subdirectory of existing files. Contributed by
> > >>> Vishwajeet
> > >>>  Dusane
> > >>>  - HADOOP-13928. TestAdlFileContextMainOperatio
> > >> nsLive.testGetFileContext1
> > >>>  runtime error. (John Zhuge via lei)
> > >>>
> > >>>
> > >>> On Mon, Mar 20, 2017 at 10:31 AM, John Zhuge <jzhuge@cloudera.com>
> > >> wrote:
> > >>>
> > >>>> Yes, it only affects ADL. There is a workaround of adding these
2
> > >>>> properties to core-site.xml:
> > >>>>
> > >>>> <property>
> > >>>>   <name>fs.adl.impl</name>
> > >>>>   <value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
> > >>>> </property>
> > >>>>
> > >>>> <property>
> > >>>>   <name>fs.AbstractFileSystem.adl.impl</name>
> > >>>>   <value>org.apache.hadoop.fs.adl.Adl</value>
> > >>>> </property>
> > >>>>
> > >>>> I have the initial patch ready but hitting these live unit test
> > >> failures:
> > >>>>
> > >>>> Failed tests:
> > >>>>
> > >>>> TestAdlFileSystemContractLive.runTest:60->
> FileSystemContractBaseTest.
> > >>>> testListStatus:257
> > >>>> expected:<1> but was:<10>
> > >>>>
> > >>>> Tests in error:
> > >>>>
> > >>>> TestAdlFileContextMainOperationsLive>FileContextMainOperationsBaseT
> > >> est.
> > >>>> testMkdirsFailsForSubdirectoryOfExistingFile:254
> > >>>> » AccessControl
> > >>>>
> > >>>> TestAdlFileSystemContractLive.runTest:60->
> FileSystemContractBaseTest.
> > >>>> testMkdirsFailsForSubdirectoryOfExistingFile:190
> > >>>> » AccessControl
> > >>>>
> > >>>>
> > >>>> Stay tuned...
> > >>>>
> > >>>> John Zhuge
> > >>>> Software Engineer, Cloudera
> > >>>>
> > >>>> On Mon, Mar 20, 2017 at 10:02 AM, Junping Du <jdu@hortonworks.com>
> > >>> wrote:
> > >>>>
> > >>>>> Thank you for reporting the issue, John! Does this issue only
> affect
> > >>> ADL
> > >>>>> (Azure Data Lake) which is a new feature for 2.8 rather than
other
> > >>>> existing
> > >>>>> FS? If so, I think we can leave the fix to 2.8.1 to fix given
this
> is
> > >>>> not a
> > >>>>> regression and just a new feature get broken.?
> > >>>>>
> > >>>>>
> > >>>>> Thanks,
> > >>>>>
> > >>>>>
> > >>>>> Junping
> > >>>>> ------------------------------
> > >>>>> *From:* John Zhuge <jzhuge@cloudera.com>
> > >>>>> *Sent:* Monday, March 20, 2017 9:07 AM
> > >>>>> *To:* Junping Du
> > >>>>> *Cc:* common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
> > >>>>> yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> > >>>>> *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> > >>>>>
> > >>>>> Discovered https://issues.apache.org/jira/browse/HADOOP-14205
"No
> > >>>>> FileSystem for scheme: adl".
> > >>>>>
> > >>>>> The issue were caused by backporting HADOOP-13037 to branch-2
and
> > >>>> earlier.
> > >>>>> HADOOP-12666 should not be backported, but some changes are
needed:
> > >>>>> property fs.adl.impl in core-default.xml and
> > >> hadoop-tools-dist/pom.xml.
> > >>>>>
> > >>>>> I am working on a patch.
> > >>>>>
> > >>>>>
> > >>>>> John Zhuge
> > >>>>> Software Engineer, Cloudera
> > >>>>>
> > >>>>> On Fri, Mar 17, 2017 at 2:18 AM, Junping Du <jdu@hortonworks.com>
> > >>> wrote:
> > >>>>>
> > >>>>>> Hi all,
> > >>>>>>     With fix of HDFS-11431 get in, I've created a new release
> > >>> candidate
> > >>>>>> (RC3) for Apache Hadoop 2.8.0.
> > >>>>>>
> > >>>>>>     This is the next minor release to follow up 2.7.0 which
has
> > >> been
> > >>>>>> released for more than 1 year. It comprises 2,900+ fixes,
> > >>> improvements,
> > >>>> and
> > >>>>>> new features. Most of these commits are released for the
first
> time
> > >> in
> > >>>>>> branch-2.
> > >>>>>>
> > >>>>>>     More information about the 2.8.0 release plan can be
found
> > >> here:
> > >>>>>> https://cwiki.apache.org/confluence/display/HADOOP/
> > >> Hadoop+2.8+Release
> > >>>>>>
> > >>>>>>     New RC is available at: http://home.apache.org/~junpin
> > >>>>>> g_du/hadoop-2.8.0-RC3
> > >>>>>>
> > >>>>>>     The RC tag in git is: release-2.8.0-RC3, and the latest
commit
> > >> id
> > >>>>>> is: 91f2b7a13d1e97be65db92ddabc627cc29ac0009
> > >>>>>>
> > >>>>>>     The maven artifacts are available via repository.apache.org
> > >> at:
> > >>>>>> https://repository.apache.org/content/repositories/
> > >>> orgapachehadoop-1057
> > >>>>>>
> > >>>>>>     Please try the release and vote; the vote will run
for the
> > >> usual
> > >>> 5
> > >>>>>> days, ending on 03/22/2017 PDT time.
> > >>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>>
> > >>>>>> Junping
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> John
> > >>>
> > >>>
> > >>> ------------------------------------------------------------
> ---------
> > >>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > >>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> > >>>
> > >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message