hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1455) Record DFS client/cli id with username/kerbros session token in audit log or hdfs client trace log
Date Wed, 13 Oct 2010 20:23:36 GMT
Record DFS client/cli id with username/kerbros session token in audit log or hdfs client trace
log
--------------------------------------------------------------------------------------------------

                 Key: HDFS-1455
                 URL: https://issues.apache.org/jira/browse/HDFS-1455
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Eric Yang


HDFS usage calculation is commonly calculated by running dfs -dus and group directory usage
by user at fix interval.  This approach does not show accurate HDFS usage if a lot of read/write
activity of equivalent amount of data happen at fix interval.  In order to identify usage
of such pattern, the usage calculation could be measured by the bytes read and bytes written
in the hdfs client trace log.  There is currently no association of DFSClient ID or CLI ID
to the user or session token emitted by Hadoop hdfs client trace log files.  This JIRA is
to record DFS Client ID/CLI ID with user name/session token in appropriate place for more
precious measuring of HDFS usage.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message