hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-973) NPE in FSDataset during heavy Namenode load
Date Fri, 16 Feb 2007 21:16:06 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Doug Cutting updated HADOOP-973:
--------------------------------

       Resolution: Fixed
    Fix Version/s: 0.12.0
           Status: Resolved  (was: Patch Available)

I committed this.  Thanks, Dhruba.

Please note that this doesn't actually fix the issue, but should enable us to better understand
it.

> NPE in FSDataset during heavy Namenode load
> -------------------------------------------
>
>                 Key: HADOOP-973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.10.1, 0.11.0
>            Reporter: Nigel Daley
>         Assigned To: dhruba borthakur
>             Fix For: 0.12.0
>
>         Attachments: invalidDeletion.patch
>
>
> Running namenode delete benchmark, I saw many of these NPE's traces in a datanode log:
> ...
> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_-949112377379974621
> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_748220495971269869
> 2007-02-04 16:17:54,619 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_658746956471887871
> 2007-02-04 16:17:56,752 ERROR org.apache.hadoop.dfs.DataNode: Exception: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:519)
>         at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:410)
>         at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1033)
>         at java.lang.Thread.run(Thread.java:595)
> 2007-02-04 16:18:01,754 INFO org.apache.hadoop.dfs.DataNode: using BLOCKREPORT_INTERVAL
of 3329089msec
> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_1657305102826276927
> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_589129256174830133
> ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message