hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-1455) Record DFS client/cli id with username/kerbros session token in audit log or hdfs client trace log
Date Thu, 31 Jul 2014 18:23:39 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer resolved HDFS-1455.
------------------------------------

    Resolution: Fixed

kerb name is stored in audit log now. Closing as fixed.

> Record DFS client/cli id with username/kerbros session token in audit log or hdfs client
trace log
> --------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-1455
>                 URL: https://issues.apache.org/jira/browse/HDFS-1455
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Eric Yang
>
> HDFS usage calculation is commonly calculated by running dfs -dus and group directory
usage by user at fix interval.  This approach does not show accurate HDFS usage if a lot of
read/write activity of equivalent amount of data happen at fix interval.  In order to identify
usage of such pattern, the usage calculation could be measured by the bytes read and bytes
written in the hdfs client trace log.  There is currently no association of DFSClient ID or
CLI ID to the user or session token emitted by Hadoop hdfs client trace log files.  This JIRA
is to record DFS Client ID/CLI ID with user name/session token in appropriate place for more
precious measuring of HDFS usage.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message