hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently
Date Wed, 30 May 2012 21:57:23 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286108#comment-13286108
] 

Eli Collins commented on HDFS-3194:
-----------------------------------

Here's the DN log from a recent trunk build with just one block, we start a new period and
re-scan the block every 5 seconds:

2012-05-30 14:53:46,380 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Starting a new period : work left in prev period : 0.00%
2012-05-30 14:53:46,380 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-279320499-127.0.1.1-1338414133947:blk_6750362468537267405_1002
2012-05-30 14:53:*51*,381 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Starting a new period : work left in prev period : 0.00%
2012-05-30 14:53:56,383 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Starting a new period : work left in prev period : 0.00%
2012-05-30 14:53:56,385 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-279320499-127.0.1.1-1338414133947:blk_6750362468537267405_1002
2012-05-30 14:54:01,386 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Starting a new period : work left in prev period : 0.00%
2012-05-30 14:54:06,388 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Starting a new period : work left in prev period : 0.00%
2012-05-30 14:54:06,389 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-279320499-127.0.1.1-1338414133947:blk_6750362468537267405_1002

                
> DataNode block scanner is running too frequently
> ------------------------------------------------
>
>                 Key: HDFS-3194
>                 URL: https://issues.apache.org/jira/browse/HDFS-3194
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 2.0.0-alpha
>            Reporter: suja s
>            Assignee: amith
>         Attachments: HDFS-3194.patch, HDFS-3194_1.patch, HDFS-3194_2.patch, HDFS-3194_4.patch,
HDFS-3194_6.patch
>
>
> Block scanning interval by default should be taken as 21 days(3 weeks) and each block
scanning should happen once in 21 days.
> Here the block is being scanned continuosly.
> 2012-04-03 10:44:47,056 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:02,064 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:17,071 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:32,079 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message