hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nigel Daley <nda...@yahoo-inc.com>
Subject Re: [jira] Updated: (HADOOP-973) NPE in FSDataset during heavy Namenode load
Date Tue, 13 Feb 2007 18:50:26 GMT
Perhaps a good time to add some javadoc describing the conditions  
that cause an IOException to be thrown?

On Feb 13, 2007, at 10:30 AM, dhruba borthakur (JIRA) wrote:

>
>      [ https://issues.apache.org/jira/browse/HADOOP-973? 
> page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> dhruba borthakur updated HADOOP-973:
> ------------------------------------
>
>     Attachment: invalidDeletion.patch
>
> Here is a patch that substitutes the null-pointer exception with a  
> self-explanatory exception message.
>
>> NPE in FSDataset during heavy Namenode load
>> -------------------------------------------
>>
>>                 Key: HADOOP-973
>>                 URL: https://issues.apache.org/jira/browse/HADOOP-973
>>             Project: Hadoop
>>          Issue Type: Bug
>>          Components: dfs
>>    Affects Versions: 0.10.1, 0.11.0
>>            Reporter: Nigel Daley
>>         Attachments: invalidDeletion.patch
>>
>>
>> Running namenode delete benchmark, I saw many of these NPE's  
>> traces in a datanode log:
>> ...
>> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode:  
>> Deleting block blk_-949112377379974621
>> 2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode:  
>> Deleting block blk_748220495971269869
>> 2007-02-04 16:17:54,619 INFO org.apache.hadoop.dfs.DataNode:  
>> Deleting block blk_658746956471887871
>> 2007-02-04 16:17:56,752 ERROR org.apache.hadoop.dfs.DataNode:  
>> Exception: java.lang.NullPointerException
>>         at org.apache.hadoop.dfs.FSDataset.invalidate 
>> (FSDataset.java:519)
>>         at org.apache.hadoop.dfs.DataNode.offerService 
>> (DataNode.java:410)
>>         at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1033)
>>         at java.lang.Thread.run(Thread.java:595)
>> 2007-02-04 16:18:01,754 INFO org.apache.hadoop.dfs.DataNode: using  
>> BLOCKREPORT_INTERVAL of 3329089msec
>> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode:  
>> Deleting block blk_1657305102826276927
>> 2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode:  
>> Deleting block blk_589129256174830133
>> ...
>
> -- 
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>


Mime
View raw message