falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-106) Falcon compilation fails for hadoop-2 profile
Date Tue, 10 Sep 2013 06:28:51 GMT

    [ https://issues.apache.org/jira/browse/FALCON-106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762778#comment-13762778
] 

Suresh Srinivas commented on FALCON-106:
----------------------------------------

bq. mvn clean assembly:assembly -P distributed
In the above case distributed package build failed because when you specify a profile, the
default profile hadoop-1 is no longer used. So the right command to use is {{mvn clean assembly:assembly
-P distributed, hadoop-1}}

Here is a new patch. It addresses several issues:
# Profiles are defined both in the parent and child pom.xml. Profiles are inherited by the
children from the parent (run some experiments with {{maven help:active-profiles}}. I have
removed duplicate of definition of profiles from all the children. As a part of this, all
dependencies have to have scope=compile.
# I have moved all hadoop-1 and hadoop-2 jars to the corresponding profiles section.

With this, the following commands work:
{noformat}
mvn -DskipTests -DskipCheck=true clean install 
mvn clean assembly:assembly -DskipTests
mvn -DskipTests -DskipCheck=true clean install -Phadoop-1
mvn clean assembly:assembly -DskipTests -Phadoop-1
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Phadoop-1
mvn clean assembly:assembly -DskipTests -Pdistributed -Phadoop-1
mvn -DskipTests -DskipCheck=true clean install -Phadoop-2
mvn clean assembly:assembly -DskipTests -Phadoop-2
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Phadoop-2
mvn clean assembly:assembly -DskipTests -Pdistributed -Phadoop-2
mvn -DskipTests -DskipCheck=true clean install -Dhadoop.profile=1
mvn clean assembly:assembly -DskipTests -Dhadoop.profile=1
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Dhadoop.profile=1
mvn clean assembly:assembly -DskipTests -Pdistributed -Dhadoop.profile=1
{noformat}


Following commands fail:
{noformat}
mvn -DskipTests -DskipCheck=true clean install -Pdistributed failed
mvn clean assembly:assembly -DskipTests -Pdistributed failed
// Above fails because default hadoop-1 profile also must be specified with distributed profile

mvn -DskipTests -DskipCheck=true clean install -Dhadoop.profile=2 failed
mvn clean assembly:assembly -DskipTests -Dhadoop.profile=2 failed
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Dhadoop.profile=2 failed
mvn clean assembly:assembly -DskipTests -Pdistributed -Dhadoop.profile=2 failed
// I am not sure why the above fails. My recommendation is to stick to running builds profiles
instead of hadoop.version parameter.
{noformat}


                
> Falcon compilation fails for hadoop-2 profile
> ---------------------------------------------
>
>                 Key: FALCON-106
>                 URL: https://issues.apache.org/jira/browse/FALCON-106
>             Project: Falcon
>          Issue Type: Bug
>          Components: build-tools
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: falcon-build-2.x.patch, falcon-build-2.x.v2.patch
>
>
> Mainly due to hadoop-core and hadoop-test artifacts not being available in hadoop 2.x.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message