hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3635) Uncaught exception in DataBlockScanner
Date Wed, 25 Jun 2008 21:34:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608206#action_12608206
] 

Tsz Wo (Nicholas), SZE commented on HADOOP-3635:
------------------------------------------------

DataBlockScanner object reads log files "dncp_block_verification.log.curr" and "dncp_block_verification.log.prev".
These log files contain lines like
{noformat}
date="2008-06-18 11:44:38,984" time="1213814678984" genstamp="1001" id="-969938011182314584"
{noformat}
>From the error message in the description, it seems to me that the log file was corrupted.
("121195228080date=": the number looks like a timestamp but it is somehow followed by another
line.) Could you check your log files? They can be found in your datanode directory .../hadoop-SYSTEM/dfs/data/current

> Uncaught exception in DataBlockScanner
> --------------------------------------
>
>                 Key: HADOOP-3635
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3635
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.17.0
>         Environment: 17.0 + H1979-H2159-H3442
>            Reporter: Koji Noguchi
>         Attachments: jstack.H3635.txt
>
>
> I see bunch of datanodes stop verifying local blocks.
> ".out" showed 
> {noformat}
> -rw-r--r--  1 hdfs users 614 Jun 23 10:24 datanode.out
> Exception in thread "org.apache.hadoop.dfs.DataBlockScanner@aadc97" java.lang.NumberFormatException:
For input string: "121195228080date="
>         at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
>         at java.lang.Long.parseLong(Long.java:412)
>         at java.lang.Long.valueOf(Long.java:518)
>         at org.apache.hadoop.dfs.DataBlockScanner$LogEntry.parseEntry(DataBlockScanner.java:351)
>         at org.apache.hadoop.dfs.DataBlockScanner.assignInitialVerificationTimes(DataBlockScanner.java:481)
>         at org.apache.hadoop.dfs.DataBlockScanner.run(DataBlockScanner.java:534)
>         at java.lang.Thread.run(Thread.java:619)
> {noformat}
> Namenode log also showed 
> {noformat}
> 2008-06-23 10:24:12,831 WARN org.apache.hadoop.dfs.DataBlockScanner: RuntimeException
during DataBlockScanner.run() : java.lang.NumberFormatException: For input string: "121195228080date="
>         at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
>         at java.lang.Long.parseLong(Long.java:412)
>         at java.lang.Long.valueOf(Long.java:518)
>         at org.apache.hadoop.dfs.DataBlockScanner$LogEntry.parseEntry(DataBlockScanner.java:351)
>         at org.apache.hadoop.dfs.DataBlockScanner.assignInitialVerificationTimes(DataBlockScanner.java:481)
>         at org.apache.hadoop.dfs.DataBlockScanner.run(DataBlockScanner.java:534)
>         at java.lang.Thread.run(Thread.java:619)
> {noformat}
> Datanode was still up and running but no verification.
> Jstack didn't show DataBlockScanner.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message