hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5286) DFS client blocked for a long time reading blocks of a file on the JobTracker
Date Thu, 19 Feb 2009 12:38:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12674984#action_12674984
] 

Hemanth Yamijala commented on HADOOP-5286:
------------------------------------------

The NameNode log for the block blk_2044238107768440002_840946 shows the following:

2009-02-19 09:52:50,952 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: commitBlockSynchronization(blk_2044238107768440002_840946)
successful
2009-02-19 09:52:50,975 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Inconsistent
size for block blk_2044238107768440002_840946 reported from <ip>:<port> current
size is 195072 reported size is 1318567
2009-02-19 09:52:50,975 WARN org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
Redundant addStoredBlock request received for blk_2044238107768440002_840946 on <ip>:<port>
size 1318567
2009-02-19 09:57:41,786 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* ask <ip>:<port>
to replicate blk_2044238107768440002_840946 to datanode(s) <ip>:<port>
2009-02-19 10:11:00,267 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* ask <ip>:<port>
to replicate blk_2044238107768440002_840946 to datanode(s) <ip>:<port>
2009-02-19 11:27:00,030 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* ask <ip>:<port>
to replicate blk_2044238107768440002_840946 to datanode(s) <ip>:<port>


> DFS client blocked for a long time reading blocks of a file on the JobTracker
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-5286
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5286
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.20.0
>            Reporter: Hemanth Yamijala
>         Attachments: jt-log-for-blocked-reads.txt
>
>
> On a large cluster, we've observed that DFS client was blocked on reading a block of
a file for almost 1 and half hours. The file was being read by the JobTracker of the cluster,
and was a split file of a job. On the NameNode logs, we observed that the block had a message
as follows:
> Inconsistent size for block blk_2044238107768440002_840946 reported from <ip>:<port>
current size is 195072 reported size is 1318567
> Details follow.
>  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message