hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-973) NPE in FSDataset during heavy Namenode load
Date Wed, 14 Feb 2007 17:26:06 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

dhruba borthakur updated HADOOP-973:
------------------------------------

    Status: Patch Available  (was: Open)

I agree with Raghu's comments that a few of these exception cases are expected whereas a few
others are real error conditions. This patch will identify the cause why this exception is
occuring.


> NPE in FSDataset during heavy Namenode load
> -------------------------------------------
>
>                 Key: HADOOP-973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-973
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0, 0.10.1
>            Reporter: Nigel Daley
>         Assigned To: dhruba borthakur
>         Attachments: invalidDeletion.patch
>
>
> Running namenode delete benchmark, I saw many of these NPE's traces in a datanode log:
> ...
> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_-949112377379974621
> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_748220495971269869
> 2007-02-04 16:17:54,619 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_658746956471887871
> 2007-02-04 16:17:56,752 ERROR org.apache.hadoop.dfs.DataNode: Exception: java.lang.NullPointerException
>         at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:519)
>         at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:410)
>         at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1033)
>         at java.lang.Thread.run(Thread.java:595)
> 2007-02-04 16:18:01,754 INFO org.apache.hadoop.dfs.DataNode: using BLOCKREPORT_INTERVAL
of 3329089msec
> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_1657305102826276927
> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_589129256174830133
> ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message