hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joep Rottinghuis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2211) Build does not pass along properties to contrib builds
Date Thu, 28 Jul 2011 17:49:09 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072441#comment-13072441
] 

Joep Rottinghuis commented on HDFS-2211:
----------------------------------------

To build hdfs without Internet connectivity:
1) First do a build with connectivity or copy ~/.ivy2 from a machine where such build did
succeed.
2) Set up a hand-full of files in a local repo to avoid download from Maven repo:
and have three files available:
/home/user/buildrepo/dist/commons/daemon/binaries/1.0.2/linux/commons-daemon-1.0.2-bin-linux-i386.tar.gz
/home/user/buildrepo/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar
/home/user/buildrepo/org/apache/maven/maven-ant-tasks/2.0.10/maven-ant-tasks-2.0.10.jar
3) Before the build run these commands to copy the jars in place for ant to resolve (otherwise
you have a bootstrap problem):
cp ${HOME}/buildrepo/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar ${WORKSPACE}/hdfs/ivy/
cp ${HOME}/buildrepo/org/apache/maven/maven-ant-tasks/2.0.10/maven-ant-tasks-2.0.10.jar ${WORKSPACE}/hdfs/ivy/

3) Do a build of common (using similar tricks to this if needed) on common. Exectute the mvn-install
target to publish your own version to the local Maven repo (~/.m2/repository).
4) Set these properties in your build.properties (version can be passed in from Jenkins as
a parameter instead when this patch is applied. Build.properties can sit in user's home directory
or in hdfs directory.

# Ivy dependency resolution instruction:
resolvers=internal

#you can increment this number as you see fit and/or pass the ${BUILD_NUMBER} from Jenkins
build.number=0
version=0.22-coolname-${build.number}
project.version=${version}
hadoop.version=${version}

# Note that hadoop-core from 0.20* branches is renamed to hadoop-common
hadoop-common.version=${version}
hadoop-hdfs.version=${version}

# Specify to not download ivy. When used, must provide ivy jar ourselves.
offline=true

# Instead of reaching out to Internet, pull ivy jar from local 
mvnrepo=file:${user.home}/buildrepo
# User by hadoop-common/hdfs and hadoop-common/mapreduce
mvn.repo=file:${user.home}/buildrepo

> Build does not pass along properties to contrib builds
> ------------------------------------------------------
>
>                 Key: HDFS-2211
>                 URL: https://issues.apache.org/jira/browse/HDFS-2211
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.22.0
>         Environment: RHEL 6.1 & Ubuntu 11.04
> Sun JRE 1.6
> Ant 1.8.2
>            Reporter: Joep Rottinghuis
>            Priority: Minor
>         Attachments: HDFS-2211.patch
>
>
> Subant call to compile contribs do not pass along parameters from parent build.
> Properties such as hadoop-common.version, asfrepo, offline, etc. are not passed along.
> Result is that build not connected to Internet fails, hdfs proxy refuses to build against
own recently built common but rather downloads 0.22-SNAPSHOT from apache again.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message