commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roger Whitcomb (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (VFS-586) Add more ways to specify alternate HDFS configuration information
Date Tue, 15 Dec 2015 17:39:46 GMT

    [ https://issues.apache.org/jira/browse/VFS-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058391#comment-15058391
] 

Roger Whitcomb commented on VFS-586:
------------------------------------

I have looked through the HDFS tests and can't really see a place where unit tests for this
change would be feasible.

Would it be acceptable to commit these changes, since there have been no objections?  I'd
like to have this code in the release version, since I'm using it ....

Thanks.

> Add more ways to specify alternate HDFS configuration information
> -----------------------------------------------------------------
>
>                 Key: VFS-586
>                 URL: https://issues.apache.org/jira/browse/VFS-586
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.1
>
>         Attachments: hdfs-config-2.diffs
>
>
> In trying to resolve some customer issues we were experiencing, it was necessary to specify
some alternate HDFS configuration information from some places other than resources in the
current classpath, plus needing to specify multiple configurations (such as a local copy of
"core-site.xml" and "hdfs-site.xml").  To accomplish this I have proposed some changes to
HdfsFileSystemConfigBuilder.java and HdfsFileSystem.java to be able to specify alternate configurations
from all the possible sources (as defined in org.apache.hadoop.fs.Configuration), namely from
a named resource, from a local file Path, from an InputStream and from another Configuration
object.  For resource names and local files, multiple entries are allowed so that multiple
configuration files can be specified as needed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message