Return-Path: X-Original-To: apmail-incubator-general-archive@www.apache.org Delivered-To: apmail-incubator-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ED1A710C64 for ; Thu, 9 Jan 2014 17:30:35 +0000 (UTC) Received: (qmail 5367 invoked by uid 500); 9 Jan 2014 17:29:53 -0000 Delivered-To: apmail-incubator-general-archive@incubator.apache.org Received: (qmail 5241 invoked by uid 500); 9 Jan 2014 17:29:49 -0000 Mailing-List: contact general-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@incubator.apache.org Delivered-To: mailing list general@incubator.apache.org Received: (qmail 5178 invoked by uid 99); 9 Jan 2014 17:29:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Jan 2014 17:29:44 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tucu@cloudera.com designates 209.85.160.54 as permitted sender) Received: from [209.85.160.54] (HELO mail-pb0-f54.google.com) (209.85.160.54) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Jan 2014 17:29:39 +0000 Received: by mail-pb0-f54.google.com with SMTP id un15so3309898pbc.27 for ; Thu, 09 Jan 2014 09:29:19 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=vsOPVoP1r/k8itC8LH6kk9edBCC3EWDS74v2i43q/Yw=; b=D9GqZY3z370WqEAxN65Ak7441JLwY+yDk0mKg/qXqid06jYxjbgZyRMLoiNVb5GoBG 51Y13RBdP+4ppMZ7kkRqdHlzbRG2s7pV7BNPBEZKd0nysW+aF4fjGRUAW54a9ngaZ/fl B95R/+LCXSqV7CyXSG0N5IeG0Rz2tYEmbKWjk9xE5Vtg34DCaT1iEj6XqMV1LfiRKWcf YYcPIU+9QPxmJuhY3SrT4zkhPQIz/SFfM11fEhpiuuUpTycsR+N+cfUwG+jf9pevZDnD 8InO9BxU1Rrm3K1ugOiBoVKJ0OTx6E2+r8IsS2Yqf8cREaFLDz8GMm/X0HNW2eeGkIBY 3vWg== X-Gm-Message-State: ALoCoQneVENyMwzxl327xOCsXLNUJCJclfZ0bITOtUKwY/UPCQ0/1OzntOj8CYFtg/OiTn8SnTlU X-Received: by 10.68.252.5 with SMTP id zo5mr5246883pbc.10.1389288559178; Thu, 09 Jan 2014 09:29:19 -0800 (PST) Received: from [172.21.3.131] ([65.50.196.130]) by mx.google.com with ESMTPSA id jn12sm11337612pbd.37.2014.01.09.09.29.17 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 09 Jan 2014 09:29:17 -0800 (PST) References: Mime-Version: 1.0 (1.0) In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: Cc: "general@incubator.apache.org" X-Mailer: iPhone Mail (11B554a) From: Alejandro Abdelnur Subject: Re: Hoya Proposal Date: Thu, 9 Jan 2014 09:29:18 -0800 To: "general@incubator.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org argh, gmail trying to be extra smart collapsed his comment on that and i mis= sed. sorry thx=20 Alejandro (phone typing) > On Jan 9, 2014, at 9:23, larry mccay wrote: >=20 > Hi Alejandro - >=20 > I believe that Steve has already acknowledged that a package rename is > required and that the project is likely not appropriate for Hadoop proper.= >=20 > thanks, >=20 > --larry >=20 >=20 > On Thu, Jan 9, 2014 at 11:46 AM, Alejandro Abdelnur wro= te: >=20 >> I may have not been clear enough, I was referring to using >> 'org.apache.hadoop' as package prefix for a project other than hadoop. >>=20 >> Thanks >>=20 >>=20 >> On Thu, Jan 9, 2014 at 8:36 AM, Benson Margulies >> wrote: >>=20 >>> If you can work out a plan to do this directly in Hadoop, there's no >>> need for the incubator. You just build and and contribute it in >>> cahoots with them, and earn commit over there as you go. >>>=20 >>> On Thu, Jan 9, 2014 at 11:14 AM, Alejandro Abdelnur >>> wrote: >>>> Mmmh, if i recall correctly this has come up in the past with other >>> projects and it was decided against it. Could you please check with the >>> hadoop folks about it? >>>>=20 >>>> Thx >>>>=20 >>>>> On Jan 9, 2014, at 1:19 AM, Steve Loughran >>> wrote: >>>>>=20 >>>>> no its wrong, it should all be under org.apache.hoya. >>>>>=20 >>>>> I had the hadoop prefix so that I could perhaps put it straight into >> the >>>>> hadoop code as another tools module -no need for incubation. But as >> the >>>>> actual providers and all tests are related to the deployment of hbase >>> and >>>>> accumulo, it really comes downstream of those. >>>>>=20 >>>>> so a rename is needed. >>>>>=20 >>>>> but yes, ASF headers everywhere >>>>>=20 >>>>>=20 >>>>>> On 8 January 2014 22:48, Henry Saputra >>> wrote: >>>>>>=20 >>>>>> I like how the initial code already put under " >>>>>> org.apache.hadoop.hoya" with correct ASF header =3D) >>>>>>=20 >>>>>> - Henry >>>>>>=20 >>>>>> On Wed, Jan 8, 2014 at 7:08 AM, Steve Loughran < >> stevel@hortonworks.com >>>>=20 >>>>>> wrote: >>>>>>> I'm starting to put together the incubation proposal for Hoya: a >> tool >>> to >>>>>>> dynamically deploy applications such as HBase or Accumulo on YARN >>>>>>>=20 >>>>>>> https://wiki.apache.org/incubator/HoyaProposal >>>>>>>=20 >>>>>>> It does already work to the extent that it can bring up either >>>>>> application, >>>>>>> run different clusters of different versions, and remember where >>>>>> containers >>>>>>> were allocated so that on application restart it can ask for them >>> back. >>>>>>> That increases data locality and makes a big difference with HBase. >>>>>>>=20 >>>>>>> It also needs a lot more work -YARN-896 is adding YARN features that= >>>>>> help, >>>>>>> but there's lots of fun to be had in Hoya including >>>>>>> -leading edge work in failure handling, modelling cluster >>> unreliability >>>>>>> and reacting to it. Can we move beyond simple blacklisting to >>>>>>> "greylisting", accepting unreliable boxes if we have no altenatives >>>>>>>=20 >>>>>>> Then there's adding more providers, to support different application= >>>>>>> installations -I'm starting to write a functional test framework >> which >>>>>> need >>>>>>> provider-specific workload generations >>>>>>>=20 >>>>>>> Other features: AM should have a web ui that redirects to the live >>>>>>> endpoints to all the app-specific UIs (e.g. HBase Master GUI), as >>> well as >>>>>>> displaying cluster state itself, for people and for management >>> tools.... >>>>>>>=20 >>>>>>> To summarise: lots of fun to be had >>>>>>>=20 >>>>>>> -steve >>>>>>>=20 >>>>>>> -- >>>>>>> CONFIDENTIALITY NOTICE >>>>>>> NOTICE: This message is intended for the use of the individual or >>> entity >>>>>> to >>>>>>> which it is addressed and may contain information that is >>> confidential, >>>>>>> privileged and exempt from disclosure under applicable law. If the >>> reader >>>>>>> of this message is not the intended recipient, you are hereby >> notified >>>>>> that >>>>>>> any printing, copying, dissemination, distribution, disclosure or >>>>>>> forwarding of this communication is strictly prohibited. If you have= >>>>>>> received this communication in error, please contact the sender >>>>>> immediately >>>>>>> and delete it from your system. Thank You. >>>>>>=20 >>>>>> ---------------------------------------------------------------------= >>>>>> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org >>>>>> For additional commands, e-mail: general-help@incubator.apache.org >>>>>=20 >>>>> -- >>>>> CONFIDENTIALITY NOTICE >>>>> NOTICE: This message is intended for the use of the individual or >>> entity to >>>>> which it is addressed and may contain information that is >> confidential, >>>>> privileged and exempt from disclosure under applicable law. If the >>> reader >>>>> of this message is not the intended recipient, you are hereby notified= >>> that >>>>> any printing, copying, dissemination, distribution, disclosure or >>>>> forwarding of this communication is strictly prohibited. If you have >>>>> received this communication in error, please contact the sender >>> immediately >>>>> and delete it from your system. Thank You. >>>>=20 >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org >>>> For additional commands, e-mail: general-help@incubator.apache.org >>>=20 >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org >>> For additional commands, e-mail: general-help@incubator.apache.org >>=20 >>=20 >> -- >> Alejandro >>=20 --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org For additional commands, e-mail: general-help@incubator.apache.org