commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roger Whitcomb (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (VFS-586) Add more ways to specify alternate HDFS configuration information
Date Tue, 17 Nov 2015 20:36:10 GMT

    [ https://issues.apache.org/jira/browse/VFS-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009447#comment-15009447
] 

Roger Whitcomb commented on VFS-586:
------------------------------------

Also, I just realized that the doc says that the setter methods can accept null inputs, but
they don't handle it very well.  I will change that and upload a new diff.

> Add more ways to specify alternate HDFS configuration information
> -----------------------------------------------------------------
>
>                 Key: VFS-586
>                 URL: https://issues.apache.org/jira/browse/VFS-586
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.1
>
>         Attachments: hdfs-config.diffs
>
>
> In trying to resolve some customer issues we were experiencing, it was necessary to specify
some alternate HDFS configuration information from some places other than resources in the
current classpath, plus needing to specify multiple configurations (such as a local copy of
"core-site.xml" and "hdfs-site.xml").  To accomplish this I have proposed some changes to
HdfsFileSystemConfigBuilder.java and HdfsFileSystem.java to be able to specify alternate configurations
from all the possible sources (as defined in org.apache.hadoop.fs.Configuration), namely from
a named resource, from a local file Path, from an InputStream and from another Configuration
object.  For resource names and local files, multiple entries are allowed so that multiple
configuration files can be specified as needed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message