hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3033) Datanode fails write to DFS file with exception message "Trying to change block file offset"
Date Tue, 18 Mar 2008 03:47:24 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12579714#action_12579714
] 

Raghu Angadi commented on HADOOP-3033:
--------------------------------------


Earlier in the same log file for another block :

{noformat}
2008-03-17 20:03:06,945 INFO org.apache.hadoop.dfs.DataNode: Changing block file offset of
block blk_-8611433653592759099 from 84869120 to 84934656 meta file offset to 663559
2008-03-17 20:03:08,128 INFO org.apache.hadoop.dfs.DataNode: Changing block file offset of
block blk_-8611433653592759099 from 114294784 to114360320 meta file offset to 893447
2008-03-17 20:03:09,057 INFO org.apache.hadoop.dfs.DataNode: Received block blk_-8611433653592759099
of size 134217728 from /a.b.c.79
{noformat}

This is strange too. The BlockReceiver thread calls {{out.write()}} then the above 'Changing
...' message is logged. But the check inside setChannelPosition() and it did not result in
an exception. So something changed the channels position in the mean time (during this, there
were no writes to 'out').  

> Datanode fails write to DFS file with exception message "Trying to change block file
offset"
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3033
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3033
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.16.1
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>         Attachments: badnode.patch
>
>
> A write to a DFS block failed with the lastdatanode in the pipeline reporting this error:
> Receiving block blk_-7279084187433655573 src: /xx.xx.xx.xx:xx dest: /xx.xx.xx.xx:50010
> Changing block file offset of block blk_-7279084187433655573 from 9043968 to 9043968
meta file offset to 70663
> Changing block file offset of block blk_-7279084187433655573 from 111935488 to 112001024
meta file offset to 875015
> Exception in receiveBlock for block blk_-7279084187433655573 java.io.IOException: Trying
to change block file offset of block blk_-7279084187433655573 to 112001024 but actual size
of file is 111935488
> PacketResponder 0 for block blk_-7279084187433655573 Interrupted.
> PacketResponder 0 for block blk_-7279084187433655573 terminating
> writeBlock blk_-7279084187433655573 received exception java.io.IOException: Trying to
change block file offset of block blk_-7279084187433655573 to 112001024 but actual size of
file is 111935488
> DataXceiver: java.io.IOException: Trying to change block file offset of block blk_-7279084187433655573
to 112001024 but actual size of file is 111935488

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message