hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-12858) Reduce UGI getGroups overhead
Date Mon, 29 Feb 2016 23:17:18 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daryn Sharp updated HADOOP-12858:
---------------------------------
    Attachment: HADOOP-12858.patch

Pushed all the group list massaging into the groups cache loader instead of being performed
for every group lookup.  Also eliminates need for double conversion from a list to array and
back to test for group membership.

Part of a larger set of internal 2.7 performance patches.  Subsequent hdfs change will require
this patch.

> Reduce UGI getGroups overhead
> -----------------------------
>
>                 Key: HADOOP-12858
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12858
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: performance
>    Affects Versions: 2.0.0-alpha
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-12858.patch
>
>
> Group lookup generates excessive garbage with multiple conversions between collections
and arrays.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message