hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4486) Add log category for long-running DFSClient notices
Date Fri, 08 Feb 2013 21:57:12 GMT
Todd Lipcon created HDFS-4486:

             Summary: Add log category for long-running DFSClient notices
                 Key: HDFS-4486
                 URL: https://issues.apache.org/jira/browse/HDFS-4486
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Todd Lipcon
            Priority: Minor

There are a number of features in the DFS client which are transparent but can make a fairly
big difference for performance -- two in particular are short circuit reads and native checksumming.
Because we don't want log spew for clients like "hadoop fs -cat" we currently log only at
DEBUG level when these features are disabled. This makes it difficult to troubleshoot/verify
for long-running perf-sensitive clients like HBase.

One simple solution is to add a new log category - eg o.a.h.h.DFSClient.PerformanceAdvisory
- which long-running clients could enable at DEBUG level without getting the full debug spew.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message