hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4122) Cleanup HDFS logs and reduce the size of logged messages
Date Mon, 29 Oct 2012 17:24:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486171#comment-13486171
] 

Suresh Srinivas commented on HDFS-4122:
---------------------------------------

bq. This should be considered an incompatible change, right? 

I did think about it. But our logs do not promise compatibility. In fact if there is a way
to annotate our logs, I would annotate it as unstable.

While this is inconvenient for tools to deal with, I would like to keep the option open for
cleaning up logs, deleting them, fixing typos and adding new ones. I will update the Release
Note about change log format.
                
> Cleanup HDFS logs and reduce the size of logged messages
> --------------------------------------------------------
>
>                 Key: HDFS-4122
>                 URL: https://issues.apache.org/jira/browse/HDFS-4122
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, hdfs client, name-node
>    Affects Versions: 1.0.0, 2.0.0-alpha
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>             Fix For: 1.2.0, 3.0.0
>
>         Attachments: log.chatty.cleanup.branch1.patch, log.chatty.cleanup.branch1.patch,
log.chatty.cleanup.branch1.patch, log.chatty.cleanup.trunk.patch, log.chatty.cleanup.trunk.patch,
log.chatty.cleanup.trunk.patch
>
>
> I have attached the patch that removes unnecessary information from the log such as "Namesystem."
and prefixing file information with "file" and block information with "block" etc.
> On a branch-1 log I saw it reduce the log size by ~10%.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message