hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4224) The dncp_block_verification log can be compressed
Date Thu, 23 May 2013 04:38:22 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664846#comment-13664846
] 

Brahma Reddy Battula commented on HDFS-4224:
--------------------------------------------

Hi Harsha,

Any update on this issue..? Recently I had seen this issue in one of my enviroment..

I also want to know why it's growing in only some machines..?

is it disk problem/os problem..?

Please let me know..thanks in advance..
                
> The dncp_block_verification log can be compressed
> -------------------------------------------------
>
>                 Key: HDFS-4224
>                 URL: https://issues.apache.org/jira/browse/HDFS-4224
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.0.0-alpha
>            Reporter: Harsh J
>            Priority: Minor
>
> On some systems, I noticed that when the scanner runs, the dncp_block_verification.log.curr
file under the block pool gets quite large (several GBs). Although this is rolled away, we
could also configure compression upon it (a codec that may work without natives, would be
a good default) and save on I/O and space.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message