hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Vohra <dvohr...@yahoo.com.INVALID>
Subject Re: Where's official Docker image for Hadoop?
Date Tue, 19 Jul 2016 03:29:19 GMT
A custom implementation would have to be developed using some container orchestration service
such as Kubernetes. Create a cluster of Pods (container sets) with different daemons running
in different Pods and scale the Pods. For example, start ResourceManager on one instance and
NodeManager on multiple instances in the cluster. The following blog runs a cluster with NodeManager
on multiple instances. Kubernetes cluster manager could be added.


The Docker image used is https://hub.docker.com/r/sequenceiq/hadoop-docker/

But any Docker image could be used.

On Mon, 7/18/16, Klaus Ma <klaus1982.cn@gmail.com> wrote:

 Subject: Re: Where's official Docker image for Hadoop?
 To: "Roman Shaposhnik" <roman@shaposhnik.org>, "Deepak Vohra" <dvohra10@yahoo.com>
 Cc: "user@hadoop.apache.org" <user@hadoop.apache.org>
 Received: Monday, July 18, 2016, 7:00 PM
 #yiv9491280873 -- .yiv9491280873EmailQuote
 {margin-left:1pt;padding-left:4pt;border-left:#800000 2px
 #yiv9491280873 #yiv9491280873 --
 Thanks for your info.
 It seems all daemon are running in one container in
 cloudera/quickstart; I'd like to run resourcemanager,
 nodemanager in different containter, so I can scale
 nodemanager out.
 Da (Klaus), Ma (马达), PMP®|
 Software Architect
 Platform DCOS Development &
 Support, STG, IBM GCG
 +86-10-8245 4084 |
 madaxa@cn.ibm.com | http://k82.me
 From: Deepak Vohra
 Sent: Tuesday, July 19, 2016 1:44:34 AM
 To: Roman Shaposhnik
 Cc: user@hadoop.apache.org
 Subject: Re: Where's official Docker image for
 The   cloudera/quickstart
 is the Docker image for Hadoop.
 Also refer,
 On Mon, 7/18/16, Roman Shaposhnik
 <roman@shaposhnik.org> wrote:
  Subject: Re: Where's official Docker image for
  To: "Klaus Ma"
  Cc: "user@hadoop.apache.org"
  Received: Monday, July 18, 2016, 5:57 PM
  On Mon, Jul 18, 2016 at 5:34 PM,
  Klaus Ma <klaus1982.cn@hotmail.com>
  > Hi team,
  > Does anyone know where's official docker images?
  not, I'd like to
  > contribute the Dockefile for it.
  I am just curious, what's your use case?
  Also, you may want to look at the following "prior
 art" in
  the area
  of Hadoop/Docker:
  > BTW, do we have official docker hub account for
  It was suggested that it may be useful for ASF to have
  official account,
  but nothing materialized AFAIK.
  To unsubscribe, e-mail:
  For additional commands, e-mail:

To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

View raw message