hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4224) The dncp_block_verification log can be compressed
Date Thu, 23 May 2013 17:03:28 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13665356#comment-13665356
] 

Harsh J commented on HDFS-4224:
-------------------------------

I only noticed the large file issue on 2.0.0 and maybe earlier builds. One of the fixes in
the later releases resolved the trouble, but I don't have it on hand yet. This ticket was
filed as an aside idea, should the file demand more space in future generally.
                
> The dncp_block_verification log can be compressed
> -------------------------------------------------
>
>                 Key: HDFS-4224
>                 URL: https://issues.apache.org/jira/browse/HDFS-4224
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.0.0-alpha
>            Reporter: Harsh J
>            Priority: Minor
>
> On some systems, I noticed that when the scanner runs, the dncp_block_verification.log.curr
file under the block pool gets quite large (several GBs). Although this is rolled away, we
could also configure compression upon it (a codec that may work without natives, would be
a good default) and save on I/O and space.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message