falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-691) Build issues - Hadoop-2 profile
Date Mon, 08 Sep 2014 17:29:30 GMT

    [ https://issues.apache.org/jira/browse/FALCON-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14125781#comment-14125781
] 

Venkatesh Seetharam commented on FALCON-691:
--------------------------------------------

I thought I had this fixed, may be internally. Darn!

We should move to support 4.x going forward, doubt if anyone is using 3.x anymore.

> Build issues - Hadoop-2 profile
> -------------------------------
>
>                 Key: FALCON-691
>                 URL: https://issues.apache.org/jira/browse/FALCON-691
>             Project: Falcon
>          Issue Type: Bug
>          Components: build-tools, oozie
>    Affects Versions: 0.5, 0.6
>            Reporter: Srikanth Sundarrajan
>            Assignee: Srikanth Sundarrajan
>            Priority: Blocker
>              Labels: build-failure
>             Fix For: 0.5, 0.6
>
>
> Unable to compile falcon code in Hadoop-2 profile.
> The issue is hadoop 2.4 depends on httpcomponents:httpclient 4.2.5, while hive-10 depends
on httpcomponents:httpclient 4.1.3 and the two versions of httpclient aren't compatible and
oozie builds with hive-10 by default and falcon builds with hive-13 by default, resulting
in both 4.1.3 & 4.2.5 jars of httpclient being in classpath. Result is that the build
isn't predictable.
> Errors observed during build:
> {noformat}
> Running org.apache.falcon.cli.FalconCLIIT
> 2014-09-02 09:49:34.297:WARN::Error for /falcon-webapp/api/options
> java.lang.NoSuchMethodError: org.apache.http.client.utils.URLEncodedUtils.parse(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/util/List;
> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.getUserName(PseudoAuthenticationHandler.java:124)
> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:160)
> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:357)
> 	at org.apache.falcon.security.BasicAuthFilter.doFilter(BasicAuthFilter.java:221)
> 	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> {noformat}
> {noformat}
> Running org.apache.falcon.cli.FalconCLIIT
> 2014-09-02 16:45:21.367:WARN::Error for /oozie/versions
> java.lang.NoSuchMethodError: org.apache.http.client.utils.URLEncodedUtils.parse(Ljava/lang/String;Ljava/nio/charset/Charset;)Ljava/util/List;
> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.getUserName(PseudoAuthenticationHandler.java:124)
> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:160)
> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:357)
> 	at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:131)
> {noformat}
> The issue is apparent in the snippet below when hadoop-webapp is being built the oozie.war
is shown to have both versions of hive besides both version of httpcomponents.
> {noformat}
> main:
> fileset: Setup scanner in dir /projects/incubator-falcon/hadoop-webapp/target/oozie with
patternSet{ includes: [] excludes: [] }
>       [jar] Building jar: /projects/incubator-falcon/hadoop-webapp/target/oozie.war
>       [jar] adding directory META-INF/
>       [jar] adding entry META-INF/MANIFEST.MF
>       [jar] adding directory META-INF/maven/
>       [jar] adding directory META-INF/maven/org.apache.oozie/
>       [jar] adding directory META-INF/maven/org.apache.oozie/oozie-webapp/
>       [jar] adding directory WEB-INF/
>       [jar] adding directory WEB-INF/classes/
>       [jar] adding directory WEB-INF/lib/
> ...
>       [jar] adding entry WEB-INF/lib/hive-ant-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-builtins-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-cli-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-cli-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-common-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-common-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-exec-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-exec-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-hcatalog-core-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-metastore-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-metastore-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-pdk-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-serde-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-serde-0.13.0.jar
>       [jar] adding entry WEB-INF/lib/hive-service-0.10.0.jar
>       [jar] adding entry WEB-INF/lib/hive-service-0.13.0.jar
> ...
>       [jar] adding entry WEB-INF/lib/httpclient-4.1.3.jar
>       [jar] adding entry WEB-INF/lib/httpcore-4.1.3.jar
> ...
> {noformat}
> The fix is to exclude httpcomponents from hive-metastore, hive-webhcat and oozie-webapp
dependencies besides bumping up the version of hive by default when oozie is built.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message