Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CC86D102E2 for ; Sat, 15 Mar 2014 03:24:34 +0000 (UTC) Received: (qmail 86736 invoked by uid 500); 15 Mar 2014 03:24:22 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 86506 invoked by uid 500); 15 Mar 2014 03:24:17 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 86484 invoked by uid 99); 15 Mar 2014 03:24:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Mar 2014 03:24:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of acm@hortonworks.com designates 209.85.160.46 as permitted sender) Received: from [209.85.160.46] (HELO mail-pb0-f46.google.com) (209.85.160.46) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Mar 2014 03:24:08 +0000 Received: by mail-pb0-f46.google.com with SMTP id rq2so3380149pbb.5 for ; Fri, 14 Mar 2014 20:23:47 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:message-id:mime-version:subject:date :references:to:in-reply-to:content-type; bh=aFGAJ5Uq/cnjvVkqgFygbo5T8Yg1TsoBgSteqfEo/ic=; b=nNmTr6YKYpBhEuXNBmlYz0ZwAgZRrF8APw9r4uzCPNQY7njSoU+4jVWSpYik/LEC2f rNi3IqxiE9PVqxKbE5ERc8cSPnEXz1MuMwLxlWb+5suW+Y/usDuTvpHO4xwdCztrcqLm HXC4aHJWCgDpcout6tr9rLz7/++mUEHHOXGtBg8mrajTvc6r/tZVHbRhTNRcG1PCaqT7 z3boR0Rd9JlWGi6LuhFS04jZ1/BRtnSiCrYfSxJhM6wUMqQq+g2QnnWq3IWCKNMR9RaA CkQVSK8g85haifMFmTy4H/LYnONbed7/Tec/puKQZQEniIKWZ//49sTLxyWcIMCk3oJS TzgQ== X-Gm-Message-State: ALoCoQmLwZ4uepcO8diZFye0Lj7vNXcPweH0sLZ0PS1ozYzEjG9aKvkOuuCnyqlz7z3HpJRS/qmgsYAiqLJedA/thHWlAhCfPrYq95gb8HDv3VbBkJKGrVs= X-Received: by 10.66.136.229 with SMTP id qd5mr12869169pab.118.1394853826906; Fri, 14 Mar 2014 20:23:46 -0700 (PDT) Received: from [10.11.2.247] ([192.175.27.2]) by mx.google.com with ESMTPSA id yj1sm34375399pab.30.2014.03.14.20.23.44 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 14 Mar 2014 20:23:45 -0700 (PDT) From: Arun C Murthy Message-Id: <7499D9F4-235D-4F58-B8D4-AC43DB8B9CE6@hortonworks.com> Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) Subject: Re: Thinking ahead to 2.4 Date: Fri, 14 Mar 2014 20:23:41 -0700 References: <4801989B-2C3D-4407-8954-F0654326E960@hortonworks.com>

<971BD72B-7F5C-4943-92B2-4801025B1DBB@hortonworks.com> <7BB9ECED-9CBE-450F-8BF1-AA7FAA234192@hortonworks.com> To: hdfs-dev@hadoop.apache.org, "yarn-dev@hadoop.apache.org" , "common-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" In-Reply-To: X-Mailer: Apple Mail (2.1510) Content-Type: multipart/alternative; boundary="Apple-Mail=_46F75C2E-3919-40C8-AD8C-163856FAA474" X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_46F75C2E-3919-40C8-AD8C-163856FAA474 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Update: We are now down to just 8 blockers of which 4 are already PA. I know it's getting in good shape per our QE gang too. If things go well, I= plan to create an RC later half of next week. thanks, Arun On Mar 11, 2014, at 7:11 AM, Arun C Murthy wrote: > Sorry, the previous link had a bug, the correct one is: http://s.apache.o= rg/hadoop-2.4.0-blockers. >=20 > We are currently down to 12 blockers; with several PA. >=20 > thanks, > Arun >=20 > On Mar 6, 2014, at 1:40 PM, Arun C Murthy wrote: >=20 >> Gang, >>=20 >> Most of the big-ticket items are already in, awesome! >>=20 >> I'm thinking we could roll out a 2.4 RC in the next 2-3 weeks after we = get through the list of blockers. Here is a handy link: http://s.apache.org= /hadoop-2.4-blockers >>=20 >> If you find more, please set Target Version to 2.4.0 and mark it a bloc= ker. I'll try nudging people to start closing these soon, appreciate any he= lp! >>=20 >> thanks, >> Arun >>=20 >> =20 >> On Feb 20, 2014, at 3:45 PM, Arun C Murthy wrote: >>=20 >>> Thanks Azuryy & Suresh. I've updated the roadmap wiki to reflect this. >>>=20 >>> Arun >>>=20 >>> On Feb 20, 2014, at 2:01 PM, Suresh Srinivas w= rote: >>>=20 >>>> Arun, >>>>=20 >>>> Some of the previously 2.4 targeted features were made available in 2.= 3: >>>> - Heterogeneous storage support >>>> - Datanode cache >>>>=20 >>>> The following are being targeted for 2.4: >>>> - Use protobuf for fsimge (already in) >>>> - ACLs (in trunk. In a week or so, this will be merged to branch-2.4) >>>> - Rolling upgrades (last bunch of jiras being worked in feature branch= . >>>> Will be in 2.4 in around two weeks. Currently testing is in progress) >>>>=20 >>>> So HDFS features should be ready in two weeks. >>>>=20 >>>>=20 >>>> On Sat, Feb 15, 2014 at 4:47 PM, Azuryy wrote: >>>>=20 >>>>> Hi=EF=BC=8C >>>>> I think you omit some key pieces in 2.4 >>>>>=20 >>>>> Protobuf fsimage, rolling upgrade are also targeting 2.4 >>>>>=20 >>>>>=20 >>>>>=20 >>>>> Sent from my iPhone5s >>>>>=20 >>>>>> On 2014=E5=B9=B42=E6=9C=8816=E6=97=A5, at 6:59, Arun C Murthy wrote: >>>>>>=20 >>>>>> Folks, >>>>>>=20 >>>>>> With hadoop-2.3 nearly done, I think it's time to think ahead to >>>>> hadoop-2.4. I think it was a good idea to expedite release of 2.3 whi= le we >>>>> finished up pieces that didn't make it in such as HDFS Caching & Supp= ort >>>>> for Heterogenous Storage. >>>>>>=20 >>>>>> Now, most of the key pieces incl. Resource Manager Automatic Failove= r >>>>> (YARN-149), Application History Server (YARN-321) & Application Timel= ine >>>>> Server (YARN-1530) are either complete or very close to done, and I t= hink >>>>> we will benefit with an extended test-cycle for 2.4 - similar to what >>>>> happened with 2.2. To provide some context: 2.2 went through nearly 6= weeks >>>>> of extended testing and it really helped us push out a very stable re= lease. >>>>>>=20 >>>>>> I think it will be good to create a 2.4 branch ASAP and start testin= g. >>>>> As such, I plan to cut the branch early next week. With this, we shou= ld be >>>>> good shape sometime to release 2.4 in mid-March. >>>>>>=20 >>>>>> I've updated https://wiki.apache.org/hadoop/Roadmap to reflect this. >>>>>>=20 >>>>>> Also, we should start thinking ahead to 2.5 and what folks would lik= e to >>>>> see in it. If we continue our 6-week cycles, we could shoot to get th= at out >>>>> in April. >>>>>>=20 >>>>>> Thoughts? >>>>>>=20 >>>>>> thanks, >>>>>> Arun >>>>>>=20 >>>>>>=20 >>>>>> -- >>>>>> Arun C. Murthy >>>>>> Hortonworks Inc. >>>>>> http://hortonworks.com/ >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> -- >>>>>> CONFIDENTIALITY NOTICE >>>>>> NOTICE: This message is intended for the use of the individual or en= tity >>>>> to >>>>>> which it is addressed and may contain information that is confidenti= al, >>>>>> privileged and exempt from disclosure under applicable law. If the r= eader >>>>>> of this message is not the intended recipient, you are hereby notifi= ed >>>>> that >>>>>> any printing, copying, dissemination, distribution, disclosure or >>>>>> forwarding of this communication is strictly prohibited. If you have >>>>>> received this communication in error, please contact the sender >>>>> immediately >>>>>> and delete it from your system. Thank You. >>>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>> --=20 >>>> http://hortonworks.com/download/ >>>>=20 >>>> --=20 >>>> CONFIDENTIALITY NOTICE >>>> NOTICE: This message is intended for the use of the individual or enti= ty to=20 >>>> which it is addressed and may contain information that is confidential= ,=20 >>>> privileged and exempt from disclosure under applicable law. If the rea= der=20 >>>> of this message is not the intended recipient, you are hereby notified= that=20 >>>> any printing, copying, dissemination, distribution, disclosure or=20 >>>> forwarding of this communication is strictly prohibited. If you have= =20 >>>> received this communication in error, please contact the sender immedi= ately=20 >>>> and delete it from your system. Thank You. >>>=20 >>> -- >>> Arun C. Murthy >>> Hortonworks Inc. >>> http://hortonworks.com/ >>>=20 >>>=20 >>=20 >> -- >> Arun C. Murthy >> Hortonworks Inc. >> http://hortonworks.com/ >>=20 >>=20 >=20 > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ >=20 >=20 -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ --=20 CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to= =20 which it is addressed and may contain information that is confidential,=20 privileged and exempt from disclosure under applicable law. If the reader= =20 of this message is not the intended recipient, you are hereby notified that= =20 any printing, copying, dissemination, distribution, disclosure or=20 forwarding of this communication is strictly prohibited. If you have=20 received this communication in error, please contact the sender immediately= =20 and delete it from your system. Thank You. --Apple-Mail=_46F75C2E-3919-40C8-AD8C-163856FAA474--