hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jian He <...@hortonworks.com>
Subject Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Date Wed, 22 Mar 2017 15:00:29 GMT
+1 (binding)

- built from source
- deployed a pseudo cluster
- ran basic example tests.
- Navigate the UI a bit, looks good.

Jian

> On Mar 22, 2017, at 9:03 PM, larry mccay <larry.mccay@gmail.com> wrote:
> 
> +1 (non-binding)
> 
> - verified signatures
> - built from source and ran tests
> - deployed pseudo cluster
> - ran basic tests for hdfs, wordcount, credential provider API and related
> commands
> - tested webhdfs with knox
> 
> 
> On Wed, Mar 22, 2017 at 7:21 AM, Ravi Prakash <ravihadoop@gmail.com> wrote:
> 
>> Thanks for all the effort Junping!
>> 
>> +1 (binding)
>> + Verified signature and MD5, SHA1, SHA256 checksum of tarball
>> + Verified SHA ID in git corresponds to RC3 tag
>> + Verified wordcount for one small text file produces same output as
>> hadoop-2.7.3.
>> + HDFS Namenode UI looks good.
>> 
>> I agree none of the issues reported so far are blockers. Looking forward to
>> another great release.
>> 
>> Thanks
>> Ravi
>> 
>> On Tue, Mar 21, 2017 at 8:10 PM, Junping Du <jdu@hortonworks.com> wrote:
>> 
>>> Thanks all for response with verification work and vote!
>>> 
>>> 
>>> Sounds like we are hitting several issues here, although none seems to be
>>> blockers so far. Given the large commit set - 2000+ commits first landed
>> in
>>> branch-2 release, we may should follow 2.7.0 practice that to claim this
>>> release is not for production cluster, just like Vinod's suggestion in
>>> previous email. We should quickly come up with 2.8.1 release in next 1
>> or 2
>>> month for production deployment.
>>> 
>>> 
>>> We will close the vote in next 24 hours. For people who haven't vote,
>>> please keep on verification work and report any issues if founded - I
>> will
>>> check if another round of RC is needed based on your findings. Thanks!
>>> 
>>> 
>>> Thanks,
>>> 
>>> 
>>> Junping
>>> 
>>> 
>>> ________________________________
>>> From: Kuhu Shukla <kshukla@yahoo-inc.com>
>>> Sent: Tuesday, March 21, 2017 3:17 PM
>>> Cc: Junping Du; common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org
>> ;
>>> yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
>>> 
>>> 
>>> +1 (non-binding)
>>> 
>>> - Verified signatures.
>>> - Downloaded and built from source tar.gz.
>>> - Deployed a pseudo-distributed cluster on Mac Sierra.
>>> - Ran example Sleep job successfully.
>>> - Deployed latest Apache Tez 0.9 and ran sample Tez orderedwordcount
>>> successfully.
>>> 
>>> Thank you Junping and everyone else who worked on getting this release
>> out.
>>> 
>>> Warm Regards,
>>> Kuhu
>>> On Tuesday, March 21, 2017, 3:42:46 PM CDT, Eric Badger
>>> <ebadger@yahoo-inc.com.INVALID> wrote:
>>> +1 (non-binding)
>>> 
>>> - Verified checksums and signatures of all files
>>> - Built from source on MacOS Sierra via JDK 1.8.0 u65
>>> - Deployed single-node cluster
>>> - Successfully ran a few sample jobs
>>> 
>>> Thanks,
>>> 
>>> Eric
>>> 
>>> On Tuesday, March 21, 2017 2:56 PM, John Zhuge <john.zhuge@gmail.com>
>>> wrote:
>>> 
>>> 
>>> 
>>> +1. Thanks for the great effort, Junping!
>>> 
>>> 
>>>  - Verified checksums and signatures of the tarballs
>>>  - Built source code with Java 1.8.0_66-b17 on Mac OS X 10.12.3
>>>  - Built source and native code with Java 1.8.0_111 on Centos 7.2.1511
>>>  - Cloud connectors:
>>>      - s3a: integration tests, basic fs commands
>>>      - adl: live unit tests, basic fs commands. See notes below.
>>>  - Deployed a pseudo cluster, passed the following sanity tests in
>>>  both insecure and SSL mode:
>>>      - HDFS: basic dfs, distcp, ACL commands
>>>      - KMS and HttpFS: basic tests
>>>      - MapReduce wordcount
>>>      - balancer start/stop
>>> 
>>> 
>>> Needs the following JIRAs to pass all ADL tests:
>>> 
>>>  - HADOOP-14205. No FileSystem for scheme: adl. Contributed by John
>> Zhuge.
>>>  - HDFS-11132. Allow AccessControlException in contract tests when
>>>  getFileStatus on subdirectory of existing files. Contributed by
>>> Vishwajeet
>>>  Dusane
>>>  - HADOOP-13928. TestAdlFileContextMainOperatio
>> nsLive.testGetFileContext1
>>>  runtime error. (John Zhuge via lei)
>>> 
>>> 
>>> On Mon, Mar 20, 2017 at 10:31 AM, John Zhuge <jzhuge@cloudera.com>
>> wrote:
>>> 
>>>> Yes, it only affects ADL. There is a workaround of adding these 2
>>>> properties to core-site.xml:
>>>> 
>>>> <property>
>>>>   <name>fs.adl.impl</name>
>>>>   <value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
>>>> </property>
>>>> 
>>>> <property>
>>>>   <name>fs.AbstractFileSystem.adl.impl</name>
>>>>   <value>org.apache.hadoop.fs.adl.Adl</value>
>>>> </property>
>>>> 
>>>> I have the initial patch ready but hitting these live unit test
>> failures:
>>>> 
>>>> Failed tests:
>>>> 
>>>> TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
>>>> testListStatus:257
>>>> expected:<1> but was:<10>
>>>> 
>>>> Tests in error:
>>>> 
>>>> TestAdlFileContextMainOperationsLive>FileContextMainOperationsBaseT
>> est.
>>>> testMkdirsFailsForSubdirectoryOfExistingFile:254
>>>> » AccessControl
>>>> 
>>>> TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
>>>> testMkdirsFailsForSubdirectoryOfExistingFile:190
>>>> » AccessControl
>>>> 
>>>> 
>>>> Stay tuned...
>>>> 
>>>> John Zhuge
>>>> Software Engineer, Cloudera
>>>> 
>>>> On Mon, Mar 20, 2017 at 10:02 AM, Junping Du <jdu@hortonworks.com>
>>> wrote:
>>>> 
>>>>> Thank you for reporting the issue, John! Does this issue only affect
>>> ADL
>>>>> (Azure Data Lake) which is a new feature for 2.8 rather than other
>>>> existing
>>>>> FS? If so, I think we can leave the fix to 2.8.1 to fix given this is
>>>> not a
>>>>> regression and just a new feature get broken.?
>>>>> 
>>>>> 
>>>>> Thanks,
>>>>> 
>>>>> 
>>>>> Junping
>>>>> ------------------------------
>>>>> *From:* John Zhuge <jzhuge@cloudera.com>
>>>>> *Sent:* Monday, March 20, 2017 9:07 AM
>>>>> *To:* Junping Du
>>>>> *Cc:* common-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
>>>>> yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
>>>>> *Subject:* Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
>>>>> 
>>>>> Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No
>>>>> FileSystem for scheme: adl".
>>>>> 
>>>>> The issue were caused by backporting HADOOP-13037 to branch-2 and
>>>> earlier.
>>>>> HADOOP-12666 should not be backported, but some changes are needed:
>>>>> property fs.adl.impl in core-default.xml and
>> hadoop-tools-dist/pom.xml.
>>>>> 
>>>>> I am working on a patch.
>>>>> 
>>>>> 
>>>>> John Zhuge
>>>>> Software Engineer, Cloudera
>>>>> 
>>>>> On Fri, Mar 17, 2017 at 2:18 AM, Junping Du <jdu@hortonworks.com>
>>> wrote:
>>>>> 
>>>>>> Hi all,
>>>>>>     With fix of HDFS-11431 get in, I've created a new release
>>> candidate
>>>>>> (RC3) for Apache Hadoop 2.8.0.
>>>>>> 
>>>>>>     This is the next minor release to follow up 2.7.0 which has
>> been
>>>>>> released for more than 1 year. It comprises 2,900+ fixes,
>>> improvements,
>>>> and
>>>>>> new features. Most of these commits are released for the first time
>> in
>>>>>> branch-2.
>>>>>> 
>>>>>>     More information about the 2.8.0 release plan can be found
>> here:
>>>>>> https://cwiki.apache.org/confluence/display/HADOOP/
>> Hadoop+2.8+Release
>>>>>> 
>>>>>>     New RC is available at: http://home.apache.org/~junpin
>>>>>> g_du/hadoop-2.8.0-RC3
>>>>>> 
>>>>>>     The RC tag in git is: release-2.8.0-RC3, and the latest commit
>> id
>>>>>> is: 91f2b7a13d1e97be65db92ddabc627cc29ac0009
>>>>>> 
>>>>>>     The maven artifacts are available via repository.apache.org
>> at:
>>>>>> https://repository.apache.org/content/repositories/
>>> orgapachehadoop-1057
>>>>>> 
>>>>>>     Please try the release and vote; the vote will run for the
>> usual
>>> 5
>>>>>> days, ending on 03/22/2017 PDT time.
>>> 
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> Junping
>>>>>> 
>>>>> 
>>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> --
>>> John
>>> 
>>> 
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>> 
>> 

Mime
View raw message