hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13397) Add dockerfile for Hadoop
Date Tue, 09 Aug 2016 01:31:20 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412801#comment-15412801
] 

Allen Wittenauer commented on HADOOP-13397:
-------------------------------------------

A few things:
* need to be able to replace how Hadoop gets installed:  tar ball vs rpm vs deb vs ....
* need to be able to replace how Hadoop gets configured: single node vs multi-node vs. config
management vs ...
* need a raw dockerfile because they want their pre-existing frameworks to manage the installation
(e.g., Kubernetes mentioned above)

That last one is key: there are plenty of other tools already in existence that can manage
containers (even Jenkins can do it!).  There's no real value in re-inventing that for a large
segment of users.

HBASE-12721 looks great if one doesn't have anything else to manage or just wants a quick
up 'n' down for something like testing.  But that's not the reality for a large chunk of docker-ized
environments.  They want to plug the file in and go.

> Add dockerfile for Hadoop
> -------------------------
>
>                 Key: HADOOP-13397
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13397
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Klaus Ma
>            Assignee: Allen Wittenauer
>         Attachments: HADOOP-13397.DNC001.patch
>
>
> For now, there's no community version Dockerfile in Hadoop; most of docker images are
provided by vendor, e.g. 
> 1. Cloudera's image: https://hub.docker.com/r/cloudera/quickstart/
> 2.  From HortonWorks sequenceiq: https://hub.docker.com/r/sequenceiq/hadoop-docker/
> 3. MapR provides the mapr-sandbox-base: https://hub.docker.com/r/maprtech/mapr-sandbox-base/
> The proposal of this JIRA is to provide a community version Dockerfile in Hadoop, and
here's some requirement:
> 1. Seperated docker image for master & agents, e.g. resource manager & node manager
> 2. Default configuration to start master & agent instead of configurating manually
> 3. Start Hadoop process as no-daemon
> Here's my dockerfile to start master/agent: https://github.com/k82cn/outrider/tree/master/kubernetes/imgs/yarn
> I'd like to contribute it after polishing :).
> Email Thread : http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629.apcprd04.prod.outlook.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message