hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8136) Enhance hadoop to use a newer version (0.8.1) of the jets3t library
Date Mon, 18 Nov 2013 10:09:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825240#comment-13825240
] 

Steve Loughran commented on HADOOP-8136:
----------------------------------------

Superceded by the HADOOP-9623 patch to move up to 0.9.0

> Enhance hadoop to use a newer version (0.8.1) of the jets3t library
> -------------------------------------------------------------------
>
>                 Key: HADOOP-8136
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8136
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>    Affects Versions: 1.0.0, 0.22.0, 0.23.3
>         Environment: Ubuntu 11.04, 64 bit, JDK 1.6.0_30
>            Reporter: Jagane Sundar
>         Attachments: HADOOP-8136-0-for_branch_1_0.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Hadoop is built against, and includes, an older version of the Jets3t library - version
0.6.1.
> The current version of the Jets3t library(as of March 2012) is 0.8.1. This new version
includes many improvements such as support for "Requester-Pays" buckets.
> Since hadoop includes a copy of the version 0.6.1 jets3t library, and since this version
ends up early in the CLASSPATH, any Map Reduce application that wants to use the jets3t library
ends up getting version 0.6.1 of the jets3t library. The MR application fails, usually with
an error stating that the method signature of some method in the Jets3t library does not match.
> It would be useful to enhance Jets3tNativeFileSystemStore.java to use the API published
by the 0.8.1 version of the jets3t library.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message