hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15973) Configuration: Included properties are not cached if resource is a stream
Date Tue, 18 Dec 2018 19:44:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724419#comment-16724419

Gera Shegalov commented on HADOOP-15973:

Thanks [~eepayne] for the patches, not that it's part of your change but since you are already
touching this code; it's not necessary to do call getPath for local files in:
// Can't use FileSystem API or we get an infinite loop
// since FileSystem uses Configuration API. Use java.io.File instead.
File file = new File(((Path)resource).toUri().getPath())

> Configuration: Included properties are not cached if resource is a stream
> -------------------------------------------------------------------------
>                 Key: HADOOP-15973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15973
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Eric Payne
>            Assignee: Eric Payne
>            Priority: Critical
>         Attachments: HADOOP-15973.001.patch, HADOOP-15973.002.patch, HADOOP-15973.003.patch
> If a configuration resource is a bufferedinputstream and the resource has an included
xml file, the properties from the included file are read and stored in the properties of the
configuration, but they are not stored in the resource cache. So, if a later resource is added
to the config and the properties are recalculated from the first resource, the included properties
are lost.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message