hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HDFS-1043) Benchmark overhead of server-side group resolution of users
Date Thu, 18 Mar 2010 00:38:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Konstantin Shvachko updated HDFS-1043:

    Attachment: UGCRefresh.patch

I modified NNThroughputBenchmark. A new input argument -UGCacheRefreshCount specifies after
how many operation the benchmark should reset the name-node's user group cache. When set to
1 it will refresh the cache for every operation. By default it never resets the cache. Using
this option one can evaluate the overhead of UG resolution for any operation available in
For the 0.20 branch comparison NNThroughputBenchmark can be run was is, since there was no
server side UG resolution at the time.

> Benchmark overhead of server-side group resolution of users
> -----------------------------------------------------------
>                 Key: HDFS-1043
>                 URL: https://issues.apache.org/jira/browse/HDFS-1043
>             Project: Hadoop HDFS
>          Issue Type: Test
>    Affects Versions: 0.22.0
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>             Fix For: 0.22.0
>         Attachments: UGCRefresh.patch
> Server-side user group resolution was introduced in HADOOP-4656. 
> The benchmark should repeatedly request the name-node for user group resolution, and
reset NN's user group cache periodically.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message