hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3835) Develop scripts to create rpm package to facilitate deployment of hadoop on Linux machines
Date Mon, 28 Jul 2008 12:35:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617414#action_12617414

Steve Loughran commented on HADOOP-3835:

As someone who has done RPMs for other OSS projects, I should warn this is a major undertaking

* you need to understand all the rules of where to place things in a well-managed linux system,
else rpmlint will complain.
* you need to select which linux distros to support and create real/virtual machines that
contain these 
* to test, you need to automate RPM upload install and then operations
* the RPM upgrade model is, well, wierd. you get your install script run before the next version
is uninstalled. 
* You need to decide if farm configuration goes into the RPMs, in which case you have to give
downstream people the tools to create their own custom RPMs. If not, you need to make it easy
to push out the configuration as a separate RPM (or do configuration in some other manner)
* Dont try doing anything clever like stopping hadoop during uninstall, because it is very
hard to have this work in all situations.
* You have to be prepared to field all the support calls related to installs, upgrades, alien
installs on debian, etc.

I do think RPMs are useful, especially for big farm rollouts, But they are also surprisingly
hard work, as in "full time for some weeks" kind of hard work

Some example code to build RPMs and test them over ssh installations. 


.spec file (prior to being pushed through Ant property expansion)

> Develop scripts to create rpm package to facilitate deployment of hadoop on Linux machines
> ------------------------------------------------------------------------------------------
>                 Key: HADOOP-3835
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3835
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: build
>            Reporter: dhruba borthakur
>            Priority: Minor
> A rpm-like packing scheme to package and then install hadoop binaries is very helpful,
especially when the number of machines in the cluster is huge. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message