spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6687) In the hadoop 0.23 profile, hadoop pulls in an older version of netty which conflicts with akka's netty
Date Fri, 03 Apr 2015 09:59:52 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394265#comment-14394265
] 

Sean Owen commented on SPARK-6687:
----------------------------------

Does this cause any problem? I expect a lot of things to be different. This is also a very
old version of Hadoop.

> In the hadoop 0.23 profile, hadoop pulls in an older version of netty which conflicts
with akka's netty 
> --------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-6687
>                 URL: https://issues.apache.org/jira/browse/SPARK-6687
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.3.0
>            Reporter: Sai Nishanth Parepally
>
> excerpt from mvn -Dverbose dependency:tree of spark-core, note the org.jboss.netty:netty
dependency:
> [INFO] |  |  +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:0.23.10:compile
> [INFO] |  |  |  +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:0.23.10:compile
> [INFO] |  |  |  |  +- (org.apache.hadoop:hadoop-yarn-common:jar:0.23.10:compile - omitted
for duplicate)
> [INFO] |  |  |  |  +- (org.apache.hadoop:hadoop-mapreduce-client-core:jar:0.23.10:compile
- omitted for duplicate)
> [INFO] |  |  |  |  +- org.apache.hadoop:hadoop-yarn-server-common:jar:0.23.10:compile
> [INFO] |  |  |  |  |  +- (org.apache.hadoop:hadoop-yarn-common:jar:0.23.10:compile -
omitted for duplicate)
> [INFO] |  |  |  |  |  +- (org.apache.zookeeper:zookeeper:jar:3.4.5:compile - version
managed from 3.4.2; omitted for duplicate)
> [INFO] |  |  |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  |  +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version managed
from 1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  |  +- (org.jboss.netty:netty:jar:3.2.4.Final:compile - omitted for
duplicate)
> [INFO] |  |  |  |  |  +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile - omitted
for duplicate)
> [INFO] |  |  |  |  |  +- (commons-io:commons-io:jar:2.1:compile - omitted for duplicate)
> [INFO] |  |  |  |  |  +- (com.google.inject:guice:jar:3.0:compile - omitted for duplicate)
> [INFO] |  |  |  |  |  +- (com.sun.jersey.jersey-test-framework:jersey-test-framework-grizzly2:jar:1.8:compile
- omitted for duplicate)
> [INFO] |  |  |  |  |  +- (com.sun.jersey:jersey-server:jar:1.8:compile - omitted for
duplicate)
> [INFO] |  |  |  |  |  \- (com.sun.jersey.contribs:jersey-guice:jar:1.8:compile - omitted
for duplicate)
> [INFO] |  |  |  |  +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile - omitted
for duplicate)
> [INFO] |  |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  +- (org.apache.hadoop:hadoop-hdfs:jar:1.23.10:compile - omitted for
duplicate)
> [INFO] |  |  |  |  \- (org.jboss.netty:netty:jar:3.2.4.Final:compile - omitted for duplicate)
> [INFO] |  |  |  +- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:0.23.10:compile
> [INFO] |  |  |  |  +- (org.apache.hadoop:hadoop-mapreduce-client-core:jar:0.23.10:compile
- omitted for duplicate)
> [INFO] |  |  |  |  +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile - omitted
for duplicate)
> [INFO] |  |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  |  +- (org.apache.hadoop:hadoop-hdfs:jar:0.23.10:compile - omitted for
duplicate)
> [INFO] |  |  |  |  \- (org.jboss.netty:netty:jar:3.2.4.Final:compile - omitted for duplicate)
> [INFO] |  |  |  +- (com.google.protobuf:protobuf-java:jar:2.4.0a:compile - omitted for
duplicate)
> [INFO] |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.10:compile - version managed from 1.6.1;
omitted for duplicate)
> [INFO] |  |  |  +- (org.slf4j:slf4j-log4j12:jar:1.7.10:compile - version managed from
1.6.1; omitted for duplicate)
> [INFO] |  |  |  +- (org.apache.hadoop:hadoop-hdfs:jar:0.23.10:compile - omitted for duplicate)
> [INFO] |  |  |  \- org.jboss.netty:netty:jar:3.2.4.Final:compile



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message