spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-4807) Add support for hadoop-2.5 + bump jets3t version
Date Wed, 10 Dec 2014 06:28:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240715#comment-14240715
] 

Sean Owen commented on SPARK-4807:
----------------------------------

This has been discussed a few times - the hadoop-2.4 profile covers 2.4+. You don't need a
new profile. I think the goal is to match jets3t distributed with Hadoop. It might be fine
to update from 0.9.0 to 0.9.2 but if it's not actually a problem, might not be worth touching
it just now.

> Add support for hadoop-2.5 + bump jets3t version
> ------------------------------------------------
>
>                 Key: SPARK-4807
>                 URL: https://issues.apache.org/jira/browse/SPARK-4807
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>    Affects Versions: 1.2.0
>            Reporter: Andy Zhang
>            Priority: Minor
>              Labels: build, maven
>             Fix For: 1.2.0
>
>   Original Estimate: 0.5h
>  Remaining Estimate: 0.5h
>
> Spark's top level POM currently has no profile support for hadoop-2.5. I've tested this
a bit on my own, and it seems to work well. I also discovered that you had to bump to the
newest version of jets3t in order to avoid a dependency conflict when using the java aws-sdk.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message