hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wei-Chiu Chuang <weic...@cloudera.com>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0 RC1
Date Wed, 13 Dec 2017 19:25:49 GMT
Thanks Andrew again,

+1 (binding)

* Downloaded source tarball, and compiled with native libs
successfully: -Pdist,native -Drequire.isal -Drequire.snappy
-Drequire.openssl -Drequire.zstd.
* hadoop checknative ran successfully.
* Upgraded a fsimage that was previously used in a Hadoop 2.6-based CDH
production cluster (fsimage size: 7.3 GB) to Hadoop 3.0.0 RC1 successfully.
(Command used: hdfs namenode -upgrade)
Interestingly, after the upgrade, the fsimage grew from 7.3 GB to 7.5 GB.
I'm not really sure what went into fsimage between 2.6 and 3.0, but this is
definitely not a big problem.

In addition,
* Built HBase 2.0.0 alpha4 against Hadoop 3.0.0 RC1 successfully.
* Built Hive master branch against Hadoop 3.0.0 RC1 successfully.


On Tue, Dec 12, 2017 at 9:55 AM, Andrew Wang <andrew.wang@cloudera.com>
wrote:

> Hi Wei-Chiu,
>
> The patchprocess directory is left over from the create-release process,
> and it looks empty to me. We should still file a create-release JIRA to fix
> this, but I think this is not a blocker. Would you agree?
>
> Best,
> Andrew
>
> On Tue, Dec 12, 2017 at 9:44 AM, Wei-Chiu Chuang <weichiu@cloudera.com>
> wrote:
>
>> Hi Andrew, thanks the tremendous effort.
>> I found an empty "patchprocess" directory in the source tarball, that is
>> not there if you clone from github. Any chance you might have some leftover
>> trash when you made the tarball?
>> Not wanting to nitpicking, but you might want to double check so we don't
>> ship anything private to you in public :)
>>
>>
>>
>> On Tue, Dec 12, 2017 at 7:48 AM, Ajay Kumar <ajay.kumar@hortonworks.com>
>> wrote:
>>
>>> +1 (non-binding)
>>> Thanks for driving this, Andrew Wang!!
>>>
>>> - downloaded the src tarball and verified md5 checksum
>>> - built from source with jdk 1.8.0_111-b14
>>> - brought up a pseudo distributed cluster
>>> - did basic file system operations (mkdir, list, put, cat) and
>>> confirmed that everything was working
>>> - Run word count, pi and DFSIOTest
>>> - run hdfs and yarn, confirmed that the NN, RM web UI worked
>>>
>>> Cheers,
>>> Ajay
>>>
>>> On 12/11/17, 9:35 PM, "Xiao Chen" <xiao@cloudera.com> wrote:
>>>
>>>     +1 (binding)
>>>
>>>     - downloaded src tarball, verified md5
>>>     - built from source with jdk1.8.0_112
>>>     - started a pseudo cluster with hdfs and kms
>>>     - sanity checked encryption related operations working
>>>     - sanity checked webui and logs.
>>>
>>>     -Xiao
>>>
>>>     On Mon, Dec 11, 2017 at 6:10 PM, Aaron T. Myers <atm@apache.org>
>>> wrote:
>>>
>>>     > +1 (binding)
>>>     >
>>>     > - downloaded the src tarball and built the source (-Pdist -Pnative)
>>>     > - verified the checksum
>>>     > - brought up a secure pseudo distributed cluster
>>>     > - did some basic file system operations (mkdir, list, put, cat) and
>>>     > confirmed that everything was working
>>>     > - confirmed that the web UI worked
>>>     >
>>>     > Best,
>>>     > Aaron
>>>     >
>>>     > On Fri, Dec 8, 2017 at 12:31 PM, Andrew Wang <
>>> andrew.wang@cloudera.com>
>>>     > wrote:
>>>     >
>>>     > > Hi all,
>>>     > >
>>>     > > Let me start, as always, by thanking the efforts of all the
>>> contributors
>>>     > > who contributed to this release, especially those who jumped on
>>> the
>>>     > issues
>>>     > > found in RC0.
>>>     > >
>>>     > > I've prepared RC1 for Apache Hadoop 3.0.0. This release
>>> incorporates 302
>>>     > > fixed JIRAs since the previous 3.0.0-beta1 release.
>>>     > >
>>>     > > You can find the artifacts here:
>>>     > >
>>>     > > http://home.apache.org/~wang/3.0.0-RC1/
>>>     > >
>>>     > > I've done the traditional testing of building from the source
>>> tarball and
>>>     > > running a Pi job on a single node cluster. I also verified that
>>> the
>>>     > shaded
>>>     > > jars are not empty.
>>>     > >
>>>     > > Found one issue that create-release (probably due to the mvn
>>> deploy
>>>     > change)
>>>     > > didn't sign the artifacts, but I fixed that by calling mvn one
>>> more time.
>>>     > > Available here:
>>>     > >
>>>     > > https://repository.apache.org/content/repositories/orgapache
>>> hadoop-1075/
>>>     > >
>>>     > > This release will run the standard 5 days, closing on Dec 13th
>>> at 12:31pm
>>>     > > Pacific. My +1 to start.
>>>     > >
>>>     > > Best,
>>>     > > Andrew
>>>     > >
>>>     >
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>
>>
>>
>>
>


-- 
A very happy Clouderan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message