hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joep Rottinghuis (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-6846) Scripts for building Hadoop 0.22.0 release
Date Tue, 20 Sep 2011 23:34:13 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Joep Rottinghuis updated HADOOP-6846:

    Attachment: hadoop-install.tar.gz

I used a slightly different approach.
My requirements were
1) Build everything from source
2) build everything together into one bundle (did not want to have to deal with this machine
has that version of such rpm, can that be compatible with that other version, etc. etc.)
3) Ability to push deployment to machine and stage w/o taking down cluster
4) Ability to have multiple installations on a server in parallel
5) Ship configuration from source control
6) have a simple install script that create appropriate symlinks
7) Avoid /etc/alternatives and other indirections (see 4)
8) Do not rely on existing environment variables.

What I did is to create a Jenkins job for each component. That includes the hadoop-config.
This is simply a tarball with config directories wrapped in a nice Eclipse project. The installer
will link server or client config in. Sample provided.

Then one assembly build pulls all tarballs from the jenkins server, untars, places jars in
proper location, generates bin templates (injects variable names where needed).

See attached for an example.

> Scripts for building Hadoop 0.22.0 release
> ------------------------------------------
>                 Key: HADOOP-6846
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6846
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: build
>    Affects Versions: 0.22.0
>            Reporter: Tom White
>            Assignee: Tom White
>             Fix For: 0.22.0
>         Attachments: HADOOP-6846.patch, hadoop-install.tar.gz, release-scripts.tar.gz

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message