hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Subramaniam V K <subru...@gmail.com>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0 RC1
Date Wed, 13 Dec 2017 20:16:04 GMT
Thanks to everyone who pushed on this release, really great to see a
release coming off trunk.

+1 (binding).

Deployed the RC on a federated YARN cluster consisting of 8 sub-clusters on
CentOs 7.4 running Java 1.8.0_144.

Hit YARN-7652[1] which is not a blocker as I was able to run multiple jobs
successfully once I cleaned up the StateStore.

[1] https://issues.apache.org/jira/browse/YARN-7652

On Wed, Dec 13, 2017 at 11:25 AM, Wei-Chiu Chuang <weichiu@cloudera.com>
wrote:

> Thanks Andrew again,
>
> +1 (binding)
>
> * Downloaded source tarball, and compiled with native libs
> successfully: -Pdist,native -Drequire.isal -Drequire.snappy
> -Drequire.openssl -Drequire.zstd.
> * hadoop checknative ran successfully.
> * Upgraded a fsimage that was previously used in a Hadoop 2.6-based CDH
> production cluster (fsimage size: 7.3 GB) to Hadoop 3.0.0 RC1 successfully.
> (Command used: hdfs namenode -upgrade)
> Interestingly, after the upgrade, the fsimage grew from 7.3 GB to 7.5 GB.
> I'm not really sure what went into fsimage between 2.6 and 3.0, but this is
> definitely not a big problem.
>
> In addition,
> * Built HBase 2.0.0 alpha4 against Hadoop 3.0.0 RC1 successfully.
> * Built Hive master branch against Hadoop 3.0.0 RC1 successfully.
>
>
> On Tue, Dec 12, 2017 at 9:55 AM, Andrew Wang <andrew.wang@cloudera.com>
> wrote:
>
> > Hi Wei-Chiu,
> >
> > The patchprocess directory is left over from the create-release process,
> > and it looks empty to me. We should still file a create-release JIRA to
> fix
> > this, but I think this is not a blocker. Would you agree?
> >
> > Best,
> > Andrew
> >
> > On Tue, Dec 12, 2017 at 9:44 AM, Wei-Chiu Chuang <weichiu@cloudera.com>
> > wrote:
> >
> >> Hi Andrew, thanks the tremendous effort.
> >> I found an empty "patchprocess" directory in the source tarball, that is
> >> not there if you clone from github. Any chance you might have some
> leftover
> >> trash when you made the tarball?
> >> Not wanting to nitpicking, but you might want to double check so we
> don't
> >> ship anything private to you in public :)
> >>
> >>
> >>
> >> On Tue, Dec 12, 2017 at 7:48 AM, Ajay Kumar <ajay.kumar@hortonworks.com
> >
> >> wrote:
> >>
> >>> +1 (non-binding)
> >>> Thanks for driving this, Andrew Wang!!
> >>>
> >>> - downloaded the src tarball and verified md5 checksum
> >>> - built from source with jdk 1.8.0_111-b14
> >>> - brought up a pseudo distributed cluster
> >>> - did basic file system operations (mkdir, list, put, cat) and
> >>> confirmed that everything was working
> >>> - Run word count, pi and DFSIOTest
> >>> - run hdfs and yarn, confirmed that the NN, RM web UI worked
> >>>
> >>> Cheers,
> >>> Ajay
> >>>
> >>> On 12/11/17, 9:35 PM, "Xiao Chen" <xiao@cloudera.com> wrote:
> >>>
> >>>     +1 (binding)
> >>>
> >>>     - downloaded src tarball, verified md5
> >>>     - built from source with jdk1.8.0_112
> >>>     - started a pseudo cluster with hdfs and kms
> >>>     - sanity checked encryption related operations working
> >>>     - sanity checked webui and logs.
> >>>
> >>>     -Xiao
> >>>
> >>>     On Mon, Dec 11, 2017 at 6:10 PM, Aaron T. Myers <atm@apache.org>
> >>> wrote:
> >>>
> >>>     > +1 (binding)
> >>>     >
> >>>     > - downloaded the src tarball and built the source (-Pdist
> -Pnative)
> >>>     > - verified the checksum
> >>>     > - brought up a secure pseudo distributed cluster
> >>>     > - did some basic file system operations (mkdir, list, put, cat)
> and
> >>>     > confirmed that everything was working
> >>>     > - confirmed that the web UI worked
> >>>     >
> >>>     > Best,
> >>>     > Aaron
> >>>     >
> >>>     > On Fri, Dec 8, 2017 at 12:31 PM, Andrew Wang <
> >>> andrew.wang@cloudera.com>
> >>>     > wrote:
> >>>     >
> >>>     > > Hi all,
> >>>     > >
> >>>     > > Let me start, as always, by thanking the efforts of all the
> >>> contributors
> >>>     > > who contributed to this release, especially those who jumped
on
> >>> the
> >>>     > issues
> >>>     > > found in RC0.
> >>>     > >
> >>>     > > I've prepared RC1 for Apache Hadoop 3.0.0. This release
> >>> incorporates 302
> >>>     > > fixed JIRAs since the previous 3.0.0-beta1 release.
> >>>     > >
> >>>     > > You can find the artifacts here:
> >>>     > >
> >>>     > > http://home.apache.org/~wang/3.0.0-RC1/
> >>>     > >
> >>>     > > I've done the traditional testing of building from the source
> >>> tarball and
> >>>     > > running a Pi job on a single node cluster. I also verified
that
> >>> the
> >>>     > shaded
> >>>     > > jars are not empty.
> >>>     > >
> >>>     > > Found one issue that create-release (probably due to the mvn
> >>> deploy
> >>>     > change)
> >>>     > > didn't sign the artifacts, but I fixed that by calling mvn
one
> >>> more time.
> >>>     > > Available here:
> >>>     > >
> >>>     > > https://repository.apache.org/content/repositories/orgapache
> >>> hadoop-1075/
> >>>     > >
> >>>     > > This release will run the standard 5 days, closing on Dec
13th
> >>> at 12:31pm
> >>>     > > Pacific. My +1 to start.
> >>>     > >
> >>>     > > Best,
> >>>     > > Andrew
> >>>     > >
> >>>     >
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>>
> >>
> >>
> >>
> >>
> >
>
>
> --
> A very happy Clouderan
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message