commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gary Gregory (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (VFS-586) Add more ways to specify alternate HDFS configuration information
Date Fri, 06 Oct 2017 19:22:00 GMT

     [ https://issues.apache.org/jira/browse/VFS-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gary Gregory updated VFS-586:
-----------------------------
    Fix Version/s:     (was: 2.2)
                   2.2.1

> Add more ways to specify alternate HDFS configuration information
> -----------------------------------------------------------------
>
>                 Key: VFS-586
>                 URL: https://issues.apache.org/jira/browse/VFS-586
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.2.1
>
>         Attachments: hdfs-config-2.diffs
>
>
> In trying to resolve some customer issues we were experiencing, it was necessary to specify
some alternate HDFS configuration information from some places other than resources in the
current classpath, plus needing to specify multiple configurations (such as a local copy of
"core-site.xml" and "hdfs-site.xml").  To accomplish this I have proposed some changes to
HdfsFileSystemConfigBuilder.java and HdfsFileSystem.java to be able to specify alternate configurations
from all the possible sources (as defined in org.apache.hadoop.fs.Configuration), namely from
a named resource, from a local file Path, from an InputStream and from another Configuration
object.  For resource names and local files, multiple entries are allowed so that multiple
configuration files can be specified as needed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message