hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently
Date Tue, 21 Aug 2012 20:24:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439009#comment-13439009
] 

Uma Maheswara Rao G commented on HDFS-3194:
-------------------------------------------

Hi Andy,
Thanks for handling this issue.
I am really sorry If you disappointed. I am here to explain you the actual problem. please
refer the [comment|https://issues.apache.org/jira/browse/HDFS-3194?focusedCommentId=13436166&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13436166]
That comment is explaining the same problem what you got after reading the patch.

Some how I did not get the meaning from your any of the comment that you are asking for the
explanation of HDFS-3194_7.patch description.

If we plan to address the actual issue, I am fine to close this JIRA.
Please file a separate JIRA or address here, I am ok for either cases.
I did not ran any test with multiple BPs. 
How logs are cleaned in single bp case? (Also you can observe the behavior of the single dir
case in branch-1), as per the fix, there should not be any difference I think.(Not sure if
we miss something)

Also worth editing the title also 'DataNode block scanner is running too frequently'. Because
DataBlockScanner will run for every 5secs. The issue is mainly about frequent logging.
Also description also different than logging issue. Please consider edditing if you plan to
file separate JIRA.

Thanks a lot guys for understanding the actual bug now.







                
> DataNode block scanner is running too frequently
> ------------------------------------------------
>
>                 Key: HDFS-3194
>                 URL: https://issues.apache.org/jira/browse/HDFS-3194
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 2.0.0-alpha
>            Reporter: suja s
>            Assignee: Andy Isaacson
>             Fix For: 2.2.0-alpha
>
>         Attachments: HDFS-3194_1.patch, hdfs-3194-1.txt, HDFS-3194_2.patch, HDFS-3194_4.patch,
HDFS-3194_6.patch, HDFS-3194_7.patch, HDFS-3194.patch
>
>
> Block scanning interval by default should be taken as 21 days(3 weeks) and each block
scanning should happen once in 21 days.
> Here the block is being scanned continuosly.
> 2012-04-03 10:44:47,056 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:02,064 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:17,071 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473_1003
> 2012-04-03 10:45:32,079 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner:
Verification succeeded for BP-241703115-xx.xx.xx.55-1333086229434:blk_-2666054955039014473

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message