Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BBE21200B4A for ; Wed, 20 Jul 2016 21:07:41 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BA44D160A64; Wed, 20 Jul 2016 19:07:41 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DCA44160A5B for ; Wed, 20 Jul 2016 21:07:40 +0200 (CEST) Received: (qmail 78795 invoked by uid 500); 20 Jul 2016 19:07:38 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 78783 invoked by uid 99); 20 Jul 2016 19:07:38 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Jul 2016 19:07:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E945518887B for ; Wed, 20 Jul 2016 19:07:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.198 X-Spam-Level: ** X-Spam-Status: No, score=2.198 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id KUzir9X4yuPg for ; Wed, 20 Jul 2016 19:07:35 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BD9845F4E5 for ; Wed, 20 Jul 2016 19:07:34 +0000 (UTC) Received: by mail-io0-f173.google.com with SMTP id 38so56300821iol.0 for ; Wed, 20 Jul 2016 12:07:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=s2VFFYmJWMujLzV+XKSf/jiNGHoSX5jKkXHU43HXpw0=; b=GW4c0KX5CBGrcUD3jZeC/EJVMFO1jhpHF3HodZjer8UUhLIoV5xPpr6003k3ozXkCR y/TiNwIlsP+ioPGaH5rXUYB63rSK385qV8SPpWpO3LG6ymvJUgt9a/Qqm1pLQ+4t2npa N522dIA/7eGi24iqNPogl7DfQh5D2kIRZG+QxU3tIZEieAEu+SA2deKs+sldG0fytkIr FFOyDMs/PfDc0MPeCOajEfxB0c0/z8TSw1zhW57bcCIMaWDZ1Y2aTy513yXHDB7NKnOX xaj3LLBceBrBBDpp5fR8/V5Hx+3B6M7btw9NiDCtrGat9r+gcsB0n/aEIejqyRF7Oujl XYSg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=s2VFFYmJWMujLzV+XKSf/jiNGHoSX5jKkXHU43HXpw0=; b=IYpYi42X8iAp+zNgun3VCgLnKyBgLjcpkkHFdKrlYHmptSFkNjVf0260vTQ0gVMBE6 XjR++ASXglchpfPIQged4e2GPjm3Notq8nEXg+OE/D78j4qTB9/UBDGwdGP0mKf5Rcs5 7uu6OMWSErsw/Vxtlh9KQw1eBUh1mxDVLxOGQQhmapwLyfQsQwgCrOrIEZX/KzE+ewN0 QNieDAU7PiW70otLrimwRRr2VciwnCVb5exqRD+IXSZke/HqsJmKZA/KG55+m3YHzz2m zfPHcaPmDBScw0wMcB7OdVv3T5uwS80Cy/pzBmK0Un3oNC3kb1Fb77GKwjjs4nVNNzT4 050g== X-Gm-Message-State: ALyK8tIMEBaiZF0DytlUnY4yLNoWxncmk7pk+fnsIfPbkOCZ03PV4FDOBQJZF0zVOflkAGApu0cWceP02UNFug== X-Received: by 10.107.137.102 with SMTP id l99mr47390533iod.177.1469041647788; Wed, 20 Jul 2016 12:07:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.9.70 with HTTP; Wed, 20 Jul 2016 12:07:27 -0700 (PDT) In-Reply-To: References: <344537837.1822736.1468936552072.JavaMail.yahoo.ref@mail.yahoo.com> <344537837.1822736.1468936552072.JavaMail.yahoo@mail.yahoo.com> From: Ravi Prakash Date: Wed, 20 Jul 2016 12:07:27 -0700 Message-ID: Subject: Re: Where's official Docker image for Hadoop? To: Klaus Ma Cc: Deepak Vohra , "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a113ec87c93a710053815e9ba archived-at: Wed, 20 Jul 2016 19:07:41 -0000 --001a113ec87c93a710053815e9ba Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Would something like this be useful as a starting point? https://github.com/apache/hadoop/tree/trunk/dev-support/docker (this is checked into apache/trunk) The DockerContainerExecutor was an alpha feature that didn't really get much traction and is not what you think it is. (If configured on the cluster, it enables users to launch yarn applications that spawn docker containers for tasks). On Tue, Jul 19, 2016 at 5:05 PM, Klaus Ma wrote: > HI Deepak, > > This image still need to manually configure which did not meet the > requirement. And I=E2=80=99d suggest Hadoop community provide a set of Do= ckerfile > as example instead of vendor. > > And where=E2=80=99s the dockerfile in source code? Here=E2=80=99s the out= put of 2.7.2. > > Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$ pwd > /Users/klaus/Workspace/hadoop-2.7.2-src > Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$ find . | grep Dockerfile > Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$ > > If any comments, please let me know. > > =E2=80=94=E2=80=94 > Da (Klaus) Ma (=E9=A9=AC=E8=BE=BE), PMP=C2=AE | Software Architect > IBM Spectrum, STG, IBM GCG > +86-10-8245 4084 | klaus1982.cn@gmail.com | http://k82.me > > On Jul 19, 2016, at 21:55, Deepak Vohra wrote: > > Apache Hadoop develops the Hadoop software, not related technologies such > as Docker image. But a Docker image could be developed using a Dockerfile > that downloads and installs a Apache Hadoop distribution. > > > --001a113ec87c93a710053815e9ba Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Would something like this be useful as a starting poi= nt? https://github.com/apache/hadoop/tree/trunk/dev-support/docker (thi= s is checked into apache/trunk)

The DockerContainerExecutor wa= s an alpha feature that didn't really get much traction and is not what= you think it is. (If configured on the cluster, it enables users to launch= yarn applications that spawn docker containers for tasks).

On Tue, Jul 19, 2016 at= 5:05 PM, Klaus Ma <klaus1982.cn@hotmail.com> wrote:<= br>
HI Deepak,

This image still need to manually configure which did not meet the req= uirement. And I=E2=80=99d suggest Hadoop community provide a set of Dockerf= ile as example instead of vendor.

And where=E2=80=99s the dockerfile in source code? Here=E2=80=99s the = output of 2.7.2.

Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$ pwd
/Users/klaus/Workspace/hadoop-2.7.2-src
Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$ find . | grep Dockerfile
Klauss-MacBook-Pro:hadoop-2.7.2-src klaus$

If any comments, please let me know.

=E2=80=94=E2=80=94
Da (Klaus) Ma (=E9=A9=AC=E8=BE=BE), PMP=C2=AE | Software =C2=A0Architect IBM Spectrum,=C2=A0STG, IBM GCG
+86-10-8245 4084 |=C2=A0klaus1982.cn@gmail.com=C2=A0|=C2=A0http://k82.me

On Jul 19, 2016, at 21:55, Deepak Vohra <dvohra10@yahoo.com> wrote:

Apache Hadoop develops the Hadoop software, not related technologies such as Dock= er image. But a Docker image could be developed using a Dockerfile that dow= nloads and installs a Apache Hadoop distribution.


--001a113ec87c93a710053815e9ba--