avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-867) Allow tools to read files via hadoop FileSystem class
Date Tue, 23 Apr 2013 02:49:16 GMT

    [ https://issues.apache.org/jira/browse/AVRO-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638734#comment-13638734
] 

Hudson commented on AVRO-867:
-----------------------------

Integrated in AvroJava #363 (See [https://builds.apache.org/job/AvroJava/363/])
    AVRO-867. Java: Enable command-line tools to read data files from any Hadoop FileSystem
implementation.  Contributed by Vincenz Priesnitz. (Revision 1470691)

     Result = SUCCESS
cutting : 
Files : 
* /avro/trunk/CHANGES.txt
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/BinaryFragmentToJsonTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/DataFileGetMetaTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/DataFileGetSchemaTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/DataFileReadTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/DataFileWriteTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/JsonToBinaryFragmentTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/RecodecTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/ToTextTool.java
* /avro/trunk/lang/java/tools/src/main/java/org/apache/avro/tool/Util.java

                
> Allow tools to read files via hadoop FileSystem class
> -----------------------------------------------------
>
>                 Key: AVRO-867
>                 URL: https://issues.apache.org/jira/browse/AVRO-867
>             Project: Avro
>          Issue Type: New Feature
>          Components: java
>    Affects Versions: 1.7.5
>            Reporter: Joe Crobak
>            Assignee: Vincenz Priesnitz
>             Fix For: 1.7.5
>
>         Attachments: addedHadoopFileSupport.diff, AVRO-867.patch
>
>
> It would be great if I could use the various tools to read/parse files that are in HDFS,
S3, etc via the [FileSystem|http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/fs/FileSystem.html]
api. We could retain backwards compatibility by assuming that unqualified urls are "file://"
but allow reading of files from fully qualified urls such as hdfs://. The required apis are
already part of the avro-tools uber jar to support the TetherTool.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message