Return-Path: X-Original-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 350AA10EC2 for ; Thu, 20 Feb 2014 22:02:27 +0000 (UTC) Received: (qmail 41500 invoked by uid 500); 20 Feb 2014 22:02:14 -0000 Delivered-To: apmail-hadoop-yarn-dev-archive@hadoop.apache.org Received: (qmail 41447 invoked by uid 500); 20 Feb 2014 22:02:13 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-dev@hadoop.apache.org Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 41165 invoked by uid 99); 20 Feb 2014 22:02:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Feb 2014 22:02:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of suresh@hortonworks.com designates 209.85.192.51 as permitted sender) Received: from [209.85.192.51] (HELO mail-qg0-f51.google.com) (209.85.192.51) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Feb 2014 22:02:04 +0000 Received: by mail-qg0-f51.google.com with SMTP id q108so5405230qgd.10 for ; Thu, 20 Feb 2014 14:01:43 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=lTOHyY+Ej2q9+/uNkvCsLhKdP9yghVRn0nzlhy098hc=; b=chMPchE2+rfEPcRU4jKkDE6v4Q23zOkIQJo0LI4c1Hwq5B+DKlOSPwXaVNKo5WTF0R Gan3Sz5EJxBtkWHE1UR2tyKp21da7msl1yzE+KbJci1fPO+9+kELDi85w3Gz7IBrLFar xht7GyhXc9L1ISIqdUMO5eccUjgZ3xepOp3nZQbPnHz0n5Sv8pKXfIcjPTNliEvccyPv nPUd37XT559gdwxE5TXwljx1irZuD9hhktsoXO34P7OEykvt6NV6hNJ7Yb1NMVsoZNvw pdFPVqfBlavFFIyEBGgRn6DczlPZ0ya5Iddu7jTmXqhYflVuC+20P6nxJekDD1sYd3tC 78JQ== X-Gm-Message-State: ALoCoQmvBL4R3qah512nlq5HKTE3r66OmcH+NiiUWou8TtZKBk3szqe62FbSafFKUHG6zj7CKeYNqcA8IiXVQ8YrS1VAWFvId/34Z16Hy8ygTwuwkkKKBxU= MIME-Version: 1.0 X-Received: by 10.140.98.203 with SMTP id o69mr4676567qge.102.1392933703652; Thu, 20 Feb 2014 14:01:43 -0800 (PST) Received: by 10.96.23.65 with HTTP; Thu, 20 Feb 2014 14:01:43 -0800 (PST) In-Reply-To: References: <4801989B-2C3D-4407-8954-F0654326E960@hortonworks.com> Date: Thu, 20 Feb 2014 14:01:43 -0800 Message-ID: Subject: Re: Thinking ahead to 2.4 From: Suresh Srinivas To: "hdfs-dev@hadoop.apache.org" Cc: "yarn-dev@hadoop.apache.org" , "common-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1139849c9b07d504f2dda688 X-Virus-Checked: Checked by ClamAV on apache.org --001a1139849c9b07d504f2dda688 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Arun, Some of the previously 2.4 targeted features were made available in 2.3: - Heterogeneous storage support - Datanode cache The following are being targeted for 2.4: - Use protobuf for fsimge (already in) - ACLs (in trunk. In a week or so, this will be merged to branch-2.4) - Rolling upgrades (last bunch of jiras being worked in feature branch. Will be in 2.4 in around two weeks. Currently testing is in progress) So HDFS features should be ready in two weeks. On Sat, Feb 15, 2014 at 4:47 PM, Azuryy wrote: > Hi=EF=BC=8C > I think you omit some key pieces in 2.4 > > Protobuf fsimage, rolling upgrade are also targeting 2.4 > > > > Sent from my iPhone5s > > > On 2014=E5=B9=B42=E6=9C=8816=E6=97=A5, at 6:59, Arun C Murthy wrote: > > > > Folks, > > > > With hadoop-2.3 nearly done, I think it's time to think ahead to > hadoop-2.4. I think it was a good idea to expedite release of 2.3 while w= e > finished up pieces that didn't make it in such as HDFS Caching & Support > for Heterogenous Storage. > > > > Now, most of the key pieces incl. Resource Manager Automatic Failover > (YARN-149), Application History Server (YARN-321) & Application Timeline > Server (YARN-1530) are either complete or very close to done, and I think > we will benefit with an extended test-cycle for 2.4 - similar to what > happened with 2.2. To provide some context: 2.2 went through nearly 6 wee= ks > of extended testing and it really helped us push out a very stable releas= e. > > > > I think it will be good to create a 2.4 branch ASAP and start testing. > As such, I plan to cut the branch early next week. With this, we should b= e > good shape sometime to release 2.4 in mid-March. > > > > I've updated https://wiki.apache.org/hadoop/Roadmap to reflect this. > > > > Also, we should start thinking ahead to 2.5 and what folks would like t= o > see in it. If we continue our 6-week cycles, we could shoot to get that o= ut > in April. > > > > Thoughts? > > > > thanks, > > Arun > > > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > > > > > -- > > CONFIDENTIALITY NOTICE > > NOTICE: This message is intended for the use of the individual or entit= y > to > > which it is addressed and may contain information that is confidential, > > privileged and exempt from disclosure under applicable law. If the read= er > > of this message is not the intended recipient, you are hereby notified > that > > any printing, copying, dissemination, distribution, disclosure or > > forwarding of this communication is strictly prohibited. If you have > > received this communication in error, please contact the sender > immediately > > and delete it from your system. Thank You. > --=20 http://hortonworks.com/download/ --=20 CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to= =20 which it is addressed and may contain information that is confidential,=20 privileged and exempt from disclosure under applicable law. If the reader= =20 of this message is not the intended recipient, you are hereby notified that= =20 any printing, copying, dissemination, distribution, disclosure or=20 forwarding of this communication is strictly prohibited. If you have=20 received this communication in error, please contact the sender immediately= =20 and delete it from your system. Thank You. --001a1139849c9b07d504f2dda688--