orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charles Pritchard (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ORC-17) Support HDFS as a plug-in module
Date Wed, 24 Jun 2015 22:18:04 GMT
Charles Pritchard created ORC-17:

             Summary: Support HDFS as a plug-in module
                 Key: ORC-17
                 URL: https://issues.apache.org/jira/browse/ORC-17
             Project: Orc
          Issue Type: Improvement
            Reporter: Charles Pritchard

Continuing from: https://github.com/hortonworks/orc/issues/149

There are C/C++ modules for reading from and writing to HDFS. There (may be) additional use
cases for HTTP-based protocols like WebHDFS and S3.

As omalley states: "The C++ API has a pluggable interface for where to get the bytes. It already
has a binding the local file system and it would be easy to extend it to other file systems
or object stores.".

It would be nice to see a build of C++ ORC which includes HDFS support, as a build flag or
otherwise provided as a module/separate repository.

I'd also like to see WebHDFS/S3 supported, once that baseline has been met.

This message was sent by Atlassian JIRA

View raw message