Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B490110195 for ; Mon, 9 Feb 2015 22:22:26 +0000 (UTC) Received: (qmail 9695 invoked by uid 500); 9 Feb 2015 22:22:19 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 9594 invoked by uid 500); 9 Feb 2015 22:22:19 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 9584 invoked by uid 99); 9 Feb 2015 22:22:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Feb 2015 22:22:19 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jayunit100.apache@gmail.com designates 209.85.216.173 as permitted sender) Received: from [209.85.216.173] (HELO mail-qc0-f173.google.com) (209.85.216.173) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Feb 2015 22:22:15 +0000 Received: by mail-qc0-f173.google.com with SMTP id m20so25349745qcx.4 for ; Mon, 09 Feb 2015 14:21:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:references:in-reply-to:to; bh=VeEIjXELXMzVAVx+u058zU2k+Rk56Q7JKJNNoJ9ka1o=; b=X8uoeL2x5ODjQSF5b2qQ3mVgJknFiRzyWj9bWCkqP3JPZtLnJQiz4aNRh9KUyKCI/U /vJOYisL+CrlJ8yWFJbd7pa2OPzGmYa2QPrJppf0fulSsIucMhHvWKzXamNDikbZQ2fx jao1HS298tUkNb4GC/GzB3pZlYWupuJf7Zq3WMSFyHthZd/yrnt7oRUd8LVpoq0ffmqj ratVID26OMFj5FYf8w6QOnR61buYU3GxUvydRbl+yYe6IvwNrVzUD5D3BimxuYstANIg pKg793M9MkCD3v1j5UZ7cwKW1j4gqPXQeKCn261JhVtRdSztVJtxEhJwvQ8DtVwlL/bd xeuw== X-Received: by 10.140.31.246 with SMTP id f109mr6733876qgf.23.1423520514504; Mon, 09 Feb 2015 14:21:54 -0800 (PST) Received: from [192.168.1.120] ([73.17.95.215]) by mx.google.com with ESMTPSA id e5sm543393qaq.16.2015.02.09.14.21.53 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 09 Feb 2015 14:21:53 -0800 (PST) From: Jay Vyas Content-Type: multipart/alternative; boundary=Apple-Mail-DCE96C51-56A4-453D-9D7D-AF6E95AE45B4 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Subject: Re: Home for Apache Big Data Solutions? Message-Id: Date: Mon, 9 Feb 2015 17:21:49 -0500 References: <54D8B278.5030006@nanthrax.net> In-Reply-To: To: "user@hadoop.apache.org" X-Mailer: iPhone Mail (12B466) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-DCE96C51-56A4-453D-9D7D-AF6E95AE45B4 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Bigtop.. Yup! Mr Asanjar : why don't you post an email about what your doing on the Apache= bigtop list, we'd love to hear from you. There could possibly be some overlap and our goal is to plumb the hadoop ec= osystem as well > On Feb 9, 2015, at 4:41 PM, Artem Ervits wrote: >=20 > I believe Apache Bigtop is what you're looking for. >=20 > Artem Ervits >=20 >> On Feb 9, 2015 8:15 AM, "Jean-Baptiste Onofr=C3=A9" wro= te: >> Hi Amir, >>=20 >> thanks for the update. >>=20 >> Please, let me know if you need some help on the proposal and to "qualify= " your ideas. >>=20 >> Regards >> JB >>=20 >>> On 02/09/2015 02:05 PM, MrAsanjar . wrote: >>> Hi Chris, >>> thanks for the information, will get on it ... >>>=20 >>> Hi JB >>> Glad that you are familiar with Juju, however my personal goal is not to= >>> promote any tool but >>> to take the next step, which is to build a community for apache big data= >>> solutions. >>>=20 >>> >>do you already have a kind of proposal/description of your projects ?= >>> working on it :) I got the idea while flying back from South Africa on >>> Saturday. During my trip I noticed most of the communities spending >>> their precious resources on solution plumbing, without much of emphasis >>> on solution best practices due to the lack of expertise. By the time >>> Big Data solution framework becomes operational, funding has diminished >>> enough to limit solution activity (i.e data analytic payload >>> development). I am sure we could find >>> similar scenarios with other institutions and SMB (small and >>> medium-size businesses) anywhere. >>> In the nutshell my goals are as follow: >>> 1) Make Big Data solutions available to everyone >>> 2) Encapsulate the best practices >>> 3) All Orchestration tools are welcomed - Some solutions could have >>> hybrid tooling model >>> 4) Enforce automated testing and quality control. >>> 5) Share analytic payloads (i.e mapreduce apps, storm topology, Pig >>> scripts,...) >>>=20 >>>=20 >>> >>Is it like distribution, or tooling ? >>> Good question, I envision to have a distribution model as it has >>> dependency on Apache hadoop projects distributions. >>>=20 >>> >>What's the current license ? >>> Charms/Bundles are moving to Apache 2.0 license, target data 2/27. >>>=20 >>> Regards >>> Amir Sanjar >>> Big Data Solution Lead >>> Canonical >>>=20 >>> On Sun, Feb 8, 2015 at 10:46 AM, Mattmann, Chris A (3980) >>> > >>> wrote: >>>=20 >>> Dear Amir, >>>=20 >>> Thank you for your interest in contributing these projects >>> to the ASF! Sincerely appreciate it. >>>=20 >>> My suggestion would be to look into the Apache Incubator, >>> which is the home for incoming projects at the ASF. The >>> TL;DR answer is: >>>=20 >>> 1. You=E2=80=99ll need to create a proposal for each project >>> that you would like to bring in using: >>> http://incubator.apache.org/guides/proposal.html >>>=20 >>>=20 >>> 2. You should put your proposal up on a public wiki >>> for each project: >>> http://wiki.apache.org/incubator/ >>> create a new page e.g., YourProjectProposal, which would in >>> turn become http://wiki.apache.org/incubator/YouProjectProposal >>> You will need to request permissions to add the page on the >>> wiki >>>=20 >>> 3. Recruit at least 3 IPMC/ASF members to mentor your project: >>> http://people.apache.org/committers-by-project.html#incubator-pmc >>>=20 >>> http://people.apache.org/committers-by-project.html#member >>>=20 >>>=20 >>> 4. Submit your proposal for consideration at the Incubator >>> 5. Enjoy! >>>=20 >>> Cheers and good luck. >>>=20 >>> Cheers, >>> Chris >>>=20 >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>> Chris Mattmann, Ph.D. >>> Chief Architect >>> Instrument Software and Science Data Systems Section (398) >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>> Office: 168-519, Mailstop: 168-527 >>> Email: chris.a.mattmann@nasa.gov >>> WWW: http://sunset.usc.edu/~mattmann/ >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>> Adjunct Associate Professor, Computer Science Department >>> University of Southern California, Los Angeles, CA 90089 USA >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>> -----Original Message----- >>> From: "MrAsanjar ." >= >>> Reply-To: "user@hadoop.apache.org " >>> > >>> Date: Sunday, February 8, 2015 at 8:36 AM >>> To: "user@hadoop.apache.org " >>> >, >>> "dev-info@bigtop.apache.org " >>> > >>> Subject: Home for Apache Big Data Solutions? >>>=20 >>> >Hi all, >>> >My name is Amir Sanjar, Big Data Solution Development Lead at >>> Canonical. >>> >My team has been developing various Big Data solutions build on to= p of >>> >Apache Hadoop projects (i.e. Hadoop, Hive, Pig,..) . We would like= to >>> >contribute these pure open source solutions >>> > to the Apache community. I wish to propose creating an apache >>> project to >>> >house all big data solutions regardless of orchestration tool >>> (i.e. Juju, >>> >Ambari, Chef, ClouderaManager, Docker, ...), any suggestions ? >>> > >>> > >>> > >>> > >>> >Regards >>> >Amir Sanjar >>> >Big Data Solution Lead >>> >Canonical >>> > >>> > >>=20 >> --=20 >> Jean-Baptiste Onofr=C3=A9 >> jbonofre@apache.org >> http://blog.nanthrax.net >> Talend - http://www.talend.com --Apple-Mail-DCE96C51-56A4-453D-9D7D-AF6E95AE45B4 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Bigtop.. Yup!

Mr Asanjar : why don't you post an email about what your doing on the Apach= e bigtop list, we'd love to hear from you.

There co= uld possibly  be some overlap and our goal is to plumb the hadoop ecosy= stem as well



On Feb 9, 2015, at 4= :41 PM, Artem Ervits <artemervit= s@gmail.com> wrote:

I believe Apache Bigtop is what you're looking for.

Artem Ervits

On Feb 9, 2015 8:15 AM, "Jean-Baptiste Onofr=C3=A9= " <jb@nanthrax.net> wrote:
Hi Amir,

thanks for the update.

Please, let me know if you need some help on the proposal and to "qualify" y= our ideas.

Regards
JB

On 02/09/2015 02:05 PM, MrAsanjar . wrote:
Hi Chris,
thanks for the information, will get on it ...

Hi JB
Glad that you are familiar with Juju, however my personal goal is not to
= promote any tool but
to take the next step, which is to build a community for apache big data
= solutions.

 >>do you already have a kind of proposal/description of your pro= jects ?
working on it :) I got the idea while flying back from South Africa on
Saturday. During my trip I noticed most of the communities spending
their precious resources on solution plumbing, without much of emphasis
on solution best practices due to the lack of expertise. By the time
Big Data solution framework becomes operational, funding has diminished
enough to limit solution activity (i.e data analytic payload
development). I am sure we could find
similar scenarios with  other institutions and SMB (small and
medium-size businesses) anywhere.
In the nutshell my goals are as follow:
1) Make Big Data solutions available to everyone
2) Encapsulate the best practices
3) All Orchestration tools are welcomed - Some solutions could have
hybrid tooling model
4) Enforce automated testing and quality control.
5) Share analytic payloads (i.e mapreduce apps, storm topology, Pig
scripts,...)


 >>Is it like distribution, or tooling ?
Good question, I envision to have a distribution model as it has
dependency on Apache hadoop projects distributions.

 >>What's the current license ?
Charms/Bundles are moving to Apache 2.0 license, target data 2/27.

Regards
Amir Sanjar
Big Data Solution Lead
Canonical

On Sun, Feb 8, 2015 at 10:46 AM, Mattmann, Chris A (3980)
<chris= .a.mattmann@jpl.nasa.gov <mailto:chris.a.mattmann@jpl.nasa.gov>&= gt;
wrote:

    Dear Amir,

    Thank you for your interest in contributing these projects
=     to the ASF! Sincerely appreciate it.

    My suggestion would be to look into the Apache Incubator,
    which is the home for incoming projects at the ASF. The
    TL;DR answer is:

    1. You=E2=80=99ll need to create a proposal for each project     that you would like to bring in using:
    http://incubator.apache.org/guides/proposal.html=


    2. You should put your proposal up on a public wiki
    for each project:
    http://wiki.apache.org/incubator/
    create a new page e.g., YourProjectProposal, which would in     turn become http://wiki.apache.org/incubator/YouP= rojectProposal
    You will need to request permissions to add the page on the     wiki

    3. Recruit at least 3 IPMC/ASF members to mentor your project:=
    http://people.apache.org/committers= -by-project.html#incubator-pmc

    http://people.apache.org/committers-by-pro= ject.html#member


    4. Submit your proposal for consideration at the Incubator
=     5. Enjoy!

    Cheers and good luck.

    Cheers,
    Chris

    +++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++++++++++
    Chris Mattmann, Ph.D.
    Chief Architect
    Instrument Software and Science Data Systems Section (398)
=     NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
    Office: 168-519, Mailstop: 168-527
    Email: chris.a.mattmann@nasa.gov <mailto:chris.a.mattmann@nasa.gov>=
    WWW: http://sunset.usc.edu/~mattmann/
    +++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++++++++++
    Adjunct Associate Professor, Computer Science Department
    University of Southern California, Los Angeles, CA 90089 USA     +++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++++++++++






    -----Original Message-----
    From: "MrAsanjar ." <afsanjar@gmail.com <mailto:afsanjar@gmail.com>>
    Reply-To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>"
    <user@hadoop.apache.org <mailto:user@hadoop.apache.org>>
    Date: Sunday, February 8, 2015 at 8:36 AM
    To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>"
    <user@hadoop.apache.org <mailto:user@hadoop.apache.org>>,
    "dev-info@bigtop.apache.org <mailto:dev-info@bigtop.apache.org>"<= br>     <dev-info@bigtop.apache.org <mailto:dev-info@bigtop.apache.org>= ;>
    Subject: Home for Apache Big Data Solutions?

     >Hi all,
     >My name is Amir Sanjar, Big Data Solution Developmen= t Lead at
    Canonical.
     >My team has been developing various Big Data solutio= ns build on top of
     >Apache Hadoop projects (i.e. Hadoop, Hive, Pig,..) .= We would like to
     >contribute these pure open source solutions
     > to the Apache community. I wish to propose creating= an apache
    project to
     >house all big data solutions regardless of orchestra= tion tool
    (i.e. Juju,
     >Ambari, Chef, ClouderaManager, Docker, ...), any sug= gestions ?
     >
     >
     >
     >
     >Regards
     >Amir Sanjar
     >Big Data Solution Lead
     >Canonical
     >
     >



--
Jean-Baptiste Onofr=C3=A9
jbonofre@apache.org=
http://blog.nanthrax.= net
Talend - http://www.tale= nd.com
= --Apple-Mail-DCE96C51-56A4-453D-9D7D-AF6E95AE45B4--