hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8054) NPE with FilterFileSystem
Date Fri, 17 Feb 2012 16:53:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210374#comment-13210374

Daryn Sharp commented on HADOOP-8054:

I'd like to echo that the issue is not specific to hive so I recommend it for 23.1.  Hive
happened to expose the issue with one of their filesystems, but the issue may break other
non-core filesystems.  This is a trivial patch to restore former questionable behavior to
avoid more unforeseen incompatibility issues.

Arguably it's a mistake for some filesystems to have exposed their default ctors because it
creates an un-configed & thus unusable fs instance.  I feel a fs should always be instantiated
with a conf.  FFS hid the problem by re-initing the embedded fs, albeit with its own uri which
is wrong.  Ie. if the uris don't match and/or the init performs what should be one-time operations.
> NPE with FilterFileSystem
> -------------------------
>                 Key: HADOOP-8054
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8054
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.1
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>         Attachments: HADOOP-8054.patch, HADOOP-8054.patch, HADOOP-8054.patch, HADOOP-8054.patch
> While running Hive tests, I'm seeing the following exception with 0.23.1,
> {noformat}
> ava.lang.NullPointerException
>         at org.apache.hadoop.fs.FileSystem.getDefaultBlockSize(FileSystem.java:1901)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:447)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.ProxyFileSystem.getFileStatus(ProxyFileSystem.java:247)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1165)
>         at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:390)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:242)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:232)
> {noformat}
> Did not see this with 0.23.0, though.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message