hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From larry mccay <larry.mc...@gmail.com>
Subject Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Date Wed, 22 Mar 2017 13:03:44 GMT
+1 (non-binding)

- verified signatures
- built from source and ran tests
- deployed pseudo cluster
- ran basic tests for hdfs, wordcount, credential provider API and related
commands
- tested webhdfs with knox


On Wed, Mar 22, 2017 at 7:21 AM, Ravi Prakash <ravihadoop@gmail.com> wrote:

> Thanks for all the effort Junping!
>
> +1 (binding)
> + Verified signature and MD5, SHA1, SHA256 checksum of tarball
> + Verified SHA ID in git corresponds to RC3 tag
> + Verified wordcount for one small text file produces same output as
> hadoop-2.7.3.
> + HDFS Namenode UI looks good.
>
> I agree none of the issues reported so far are blockers. Looking forward to
> another great release.
>
> Thanks
> Ravi
>
> On Tue, Mar 21, 2017 at 8:10 PM, Junping Du <jdu@hortonworks.com> wrote:
>
> > Thanks all for response with verification work and vote!
> >
> >
> > Sounds like we are hitting several issues here, although none seems to be
> > blockers so far. Given the large commit set - 2000+ commits first landed
> in
> > branch-2 release, we may should follow 2.7.0 practice that to claim this
> > release is not for production cluster, just like Vinod's suggestion in
> > previous email. We should quickly come up with 2.8.1 release in next 1
> or 2
> > month for production deployment.
> >
> >
> > We will close the vote in next 24 hours. For people who haven't vote,
> > please keep on verification work and report any issues if founded - I
> will
> > check if another round of RC is needed based on your findings. Thanks!
> >
> >
> > Thanks,
> >
> >
> > Junping
> >
> >
> > ________________________________
> > From: Kuhu Shukla <kshukla@yahoo-inc.com>
> > Sent: Tuesday, March 21, 2017 3:17 PM
> > Cc: Junping Du; common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org
> ;
> > yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> >
> >
> > +1 (non-binding)
> >
> > - Verified signatures.
> > - Downloaded and built from source tar.gz.
> > - Deployed a pseudo-distributed cluster on Mac Sierra.
> > - Ran example Sleep job successfully.
> > - Deployed latest Apache Tez 0.9 and ran sample Tez orderedwordcount
> > successfully.
> >
> > Thank you Junping and everyone else who worked on getting this release
> out.
> >
> > Warm Regards,
> > Kuhu
> > On Tuesday, March 21, 2017, 3:42:46 PM CDT, Eric Badger
> > <ebadger@yahoo-inc.com.INVALID> wrote:
> > +1 (non-binding)
> >
> > - Verified checksums and signatures of all files
> > - Built from source on MacOS Sierra via JDK 1.8.0 u65
> > - Deployed single-node cluster
> > - Successfully ran a few sample jobs
> >
> > Thanks,
> >
> > Eric
> >
> > On Tuesday, March 21, 2017 2:56 PM, John Zhuge <john.zhuge@gmail.com>
> > wrote:
> >
> >
> >
> > +1. Thanks for the great effort, Junping!
> >
> >
> >   - Verified checksums and signatures of the tarballs
> >   - Built source code with Java 1.8.0_66-b17 on Mac OS X 10.12.3
> >   - Built source and native code with Java 1.8.0_111 on Centos 7.2.1511
> >   - Cloud connectors:
> >       - s3a: integration tests, basic fs commands
> >       - adl: live unit tests, basic fs commands. See notes below.
> >   - Deployed a pseudo cluster, passed the following sanity tests in
> >   both insecure and SSL mode:
> >       - HDFS: basic dfs, distcp, ACL commands
> >       - KMS and HttpFS: basic tests
> >       - MapReduce wordcount
> >       - balancer start/stop
> >
> >
> > Needs the following JIRAs to pass all ADL tests:
> >
> >   - HADOOP-14205. No FileSystem for scheme: adl. Contributed by John
> Zhuge.
> >   - HDFS-11132. Allow AccessControlException in contract tests when
> >   getFileStatus on subdirectory of existing files. Contributed by
> > Vishwajeet
> >   Dusane
> >   - HADOOP-13928. TestAdlFileContextMainOperatio
> nsLive.testGetFileContext1
> >   runtime error. (John Zhuge via lei)
> >
> >
> > On Mon, Mar 20, 2017 at 10:31 AM, John Zhuge <jzhuge@cloudera.com>
> wrote:
> >
> > > Yes, it only affects ADL. There is a workaround of adding these 2
> > > properties to core-site.xml:
> > >
> > >  <property>
> > >    <name>fs.adl.impl</name>
> > >    <value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
> > >  </property>
> > >
> > >  <property>
> > >    <name>fs.AbstractFileSystem.adl.impl</name>
> > >    <value>org.apache.hadoop.fs.adl.Adl</value>
> > >  </property>
> > >
> > > I have the initial patch ready but hitting these live unit test
> failures:
> > >
> > > Failed tests:
> > >
> > > TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
> > > testListStatus:257
> > > expected:<1> but was:<10>
> > >
> > > Tests in error:
> > >
> > > TestAdlFileContextMainOperationsLive>FileContextMainOperationsBaseT
> est.
> > > testMkdirsFailsForSubdirectoryOfExistingFile:254
> > > » AccessControl
> > >
> > > TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
> > > testMkdirsFailsForSubdirectoryOfExistingFile:190
> > > » AccessControl
> > >
> > >
> > > Stay tuned...
> > >
> > > John Zhuge
> > > Software Engineer, Cloudera
> > >
> > > On Mon, Mar 20, 2017 at 10:02 AM, Junping Du <jdu@hortonworks.com>
> > wrote:
> > >
> > > > Thank you for reporting the issue, John! Does this issue only affect
> > ADL
> > > > (Azure Data Lake) which is a new feature for 2.8 rather than other
> > > existing
> > > > FS? If so, I think we can leave the fix to 2.8.1 to fix given this is
> > > not a
> > > > regression and just a new feature get broken.?
> > > >
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > Junping
> > > > ------------------------------
> > > > *From:* John Zhuge <jzhuge@cloudera.com>
> > > > *Sent:* Monday, March 20, 2017 9:07 AM
> > > > *To:* Junping Du
> > > > *Cc:* common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
> > > > yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> > > > *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> > > >
> > > > Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No
> > > > FileSystem for scheme: adl".
> > > >
> > > > The issue were caused by backporting HADOOP-13037 to branch-2 and
> > > earlier.
> > > > HADOOP-12666 should not be backported, but some changes are needed:
> > > > property fs.adl.impl in core-default.xml and
> hadoop-tools-dist/pom.xml.
> > > >
> > > > I am working on a patch.
> > > >
> > > >
> > > > John Zhuge
> > > > Software Engineer, Cloudera
> > > >
> > > > On Fri, Mar 17, 2017 at 2:18 AM, Junping Du <jdu@hortonworks.com>
> > wrote:
> > > >
> > > >> Hi all,
> > > >>      With fix of HDFS-11431 get in, I've created a new release
> > candidate
> > > >> (RC3) for Apache Hadoop 2.8.0.
> > > >>
> > > >>      This is the next minor release to follow up 2.7.0 which has
> been
> > > >> released for more than 1 year. It comprises 2,900+ fixes,
> > improvements,
> > > and
> > > >> new features. Most of these commits are released for the first time
> in
> > > >> branch-2.
> > > >>
> > > >>      More information about the 2.8.0 release plan can be found
> here:
> > > >> https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+2.8+Release
> > > >>
> > > >>      New RC is available at: http://home.apache.org/~junpin
> > > >> g_du/hadoop-2.8.0-RC3
> > > >>
> > > >>      The RC tag in git is: release-2.8.0-RC3, and the latest commit
> id
> > > >> is: 91f2b7a13d1e97be65db92ddabc627cc29ac0009
> > > >>
> > > >>      The maven artifacts are available via repository.apache.org
> at:
> > > >> https://repository.apache.org/content/repositories/
> > orgapachehadoop-1057
> > > >>
> > > >>      Please try the release and vote; the vote will run for the
> usual
> > 5
> > > >> days, ending on 03/22/2017 PDT time.
> >
> > > >>
> > > >> Thanks,
> > > >>
> > > >> Junping
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > John
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message