hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vikram Dixit K (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5755) Fix hadoop2 execution environment
Date Thu, 14 Nov 2013 21:49:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822962#comment-13822962
] 

Vikram Dixit K commented on HIVE-5755:
--------------------------------------

Hi Brock,

The issue here seems to be caused by the activeByDefault in the hadoop-1 maven profile which
includes the hadoop-1 jars and shim jars in the test classpath even when -Phadoop-2 is used.
I read the documentation on maven and it feels like what is done here is right but, when I
remove those and use -Phadoop-2 (along with some changes to the way shims are included), I
am able to see hadoop-2 tests being run correctly. I think that might be a maven bug.

Also, I looked into the hbase maven build as well since they have hadoop-1 and hadoop-2 specific
builds. Their approach is to use a -Dhadoop.profile on the maven command line to choose a
particular profile. Their default is hadoop-1 as well controlled by the absence of the -Dhadoop.profile
flag. Let me know your thoughts on this approach. I can quickly provide a patch for this.

Thanks
Vikram.

> Fix hadoop2 execution environment
> ---------------------------------
>
>                 Key: HIVE-5755
>                 URL: https://issues.apache.org/jira/browse/HIVE-5755
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Brock Noland
>            Assignee: Brock Noland
>
> It looks like the hadoop2 execution environment isn't exactly correct post mavenization.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message