Return-Path: X-Original-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B1BC710AAC for ; Mon, 17 Nov 2014 20:02:58 +0000 (UTC) Received: (qmail 6952 invoked by uid 500); 17 Nov 2014 20:02:55 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 6871 invoked by uid 500); 17 Nov 2014 20:02:55 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 6803 invoked by uid 99); 17 Nov 2014 20:02:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Nov 2014 20:02:54 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yzhang@cloudera.com designates 209.85.216.181 as permitted sender) Received: from [209.85.216.181] (HELO mail-qc0-f181.google.com) (209.85.216.181) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Nov 2014 20:02:50 +0000 Received: by mail-qc0-f181.google.com with SMTP id m20so4146338qcx.40 for ; Mon, 17 Nov 2014 12:00:14 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to:cc :content-type; bh=VnAypUqJ4ea4EKS9P2785wSObFkcd60XOKswYNYYW4g=; b=G0byuL8N5UgDe7V2Dq/9gRc07c+nk3dHTh0+AnVnPBk21Odrm+WToeOGjXEn1/vlV7 07llEprMYHTTjSYm8ZOk5HadNlu46hNS70uLxuZmNazEwGx8QdNJ8j79S6k2iX0vGOxn Mby0Y3FQxHuwaxlYrr+C0Dikp3++gEonl9H+X/nz5RubuAuT9cEZ0hKOlpYdxBh03f3i gHNdfJ8EugvQx/SaXDyW8jclnWRzJRxOZVZ3Xr1NFesvIxPVmdcXxhogEGEYJfwipeUi +FmUn6chmksrCS8bGiGDpOigzxcGBkPWZquKFgo+x/otEX6b5lRJeYlXgVtbUPsWL3z3 5cKQ== X-Gm-Message-State: ALoCoQnNlfCPfQX2w2tDffQZSzTjVKmW3qijaso6OY3GjoIdjlUb9eXoFuXpaNrdt2IEf7p3w5bb MIME-Version: 1.0 X-Received: by 10.140.49.107 with SMTP id p98mr36586701qga.20.1416254412463; Mon, 17 Nov 2014 12:00:12 -0800 (PST) Received: by 10.140.33.226 with HTTP; Mon, 17 Nov 2014 12:00:12 -0800 (PST) Date: Mon, 17 Nov 2014 12:00:12 -0800 Message-ID: Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 From: Yongjun Zhang To: common-dev@hadoop.apache.org Cc: "yarn-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1135234e2ac1150508136dbf X-Virus-Checked: Checked by ClamAV on apache.org --001a1135234e2ac1150508136dbf Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Suresh, I did review HDFS-6833 and the patch Shinichi provided a while back. It's not really directly related to replication factor. The problem reported there is, DirectoryScanner tries to register with NN blocks already scheduled to be deleted as regular blocks, due to the delay in block removal at DN side. This is wrong, and caused extra cycle/bandwidth and it should not happen. And the patch tries to fix that. I think it's a good fix to have, but probably targetting at 2.6.1 would be fine. Given that the fix is still pending a committer's review, it will take some time and we should push on that. I do hope the fix can get in as soon as possible though. Would you please share with us the timeframe for 2.6.1, and I hope the schedule will work with Tsuyoshi. Thanks. --Yongjun On Mon, Nov 17, 2014 at 10:03 AM, Suresh Srinivas wrote: > Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a bounda= ry > condition (and should not cause issues when for files with replication > factor 3), we should perhaps target this into 2.6.1 and not block this > release. Thoughts? > > On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA > wrote: > > > +0(non-binding) > > > > HDFS-6833 is critical issue for us - could you help us to merge it into > > 2.6? > > > > Thanks, > > - Tsuyoshi > > > > On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah wrote: > > > +1 (binding) > > > > > > Built Hadoop from source, compiled Tez against the hadoop jars pushed > to > > staging repo and ran a few example Tez jobs on a single node cluster. > > > > > > =E2=80=94 HItesh > > > > > > > > > On Nov 13, 2014, at 3:08 PM, Arun C Murthy > wrote: > > > > > >> Folks, > > >> > > >> I've created another release candidate (rc1) for hadoop-2.6.0 based = on > > the feedback. > > >> > > >> The RC is available at: > > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1 > > >> The RC tag in git is: release-2.6.0-rc1 > > >> > > >> The maven artifacts are available via repository.apache.org at > > https://repository.apache.org/content/repositories/orgapachehadoop-1013= . > > >> > > >> Please try the release and vote; the vote will run for the usual 5 > days. > > >> > > >> thanks, > > >> Arun > > >> > > >> > > >> -- > > >> CONFIDENTIALITY NOTICE > > >> NOTICE: This message is intended for the use of the individual or > > entity to > > >> which it is addressed and may contain information that is > confidential, > > >> privileged and exempt from disclosure under applicable law. If the > > reader > > >> of this message is not the intended recipient, you are hereby notifi= ed > > that > > >> any printing, copying, dissemination, distribution, disclosure or > > >> forwarding of this communication is strictly prohibited. If you have > > >> received this communication in error, please contact the sender > > immediately > > >> and delete it from your system. Thank You. > > > > > > > > > > > -- > > - Tsuyoshi > > > > > > -- > http://hortonworks.com/download/ > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity = to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified th= at > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediate= ly > and delete it from your system. Thank You. > --001a1135234e2ac1150508136dbf--