hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8054) NPE with RawLocalFileSystem
Date Wed, 15 Feb 2012 05:30:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208237#comment-13208237
] 

Amareshwari Sriramadasu commented on HADOOP-8054:
-------------------------------------------------

bq. The change as Daryn stated was intentional, and was made to allow viewfs to work properly
in connection with FilterFileSystem.
I would like to better understand what has broken and how it was broken so we can fix the
correct thing. 

What was broken - "The contained FileSystem is no more initialized after the patch". The change
makes all the sub classes of FilterFileSystem call initialize for contained FileSystem - making
it incompatible. 

bq. why is it that after this patch is applied that no unit tests fail on our side in common?
Because LocalFileSystem was changed to initialize the contained FileSystem in HADOOP-8013.
So, no tests were failing. Added the failing test in the attached patch.  

                
> NPE with RawLocalFileSystem
> ---------------------------
>
>                 Key: HADOOP-8054
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8054
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.1
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>            Priority: Critical
>         Attachments: HADOOP-8054.patch
>
>
> While running Hive tests, I'm seeing the following exception with 0.23.1,
> {noformat}
> ava.lang.NullPointerException
>         at org.apache.hadoop.fs.FileSystem.getDefaultBlockSize(FileSystem.java:1901)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:447)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.ProxyFileSystem.getFileStatus(ProxyFileSystem.java:247)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1165)
>         at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:390)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:242)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:232)
> {noformat}
> Did not see this with 0.23.0, though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message