hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2246) Shortcut a local client reads to a Datanodes files directly
Date Wed, 21 Sep 2011 01:19:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109165#comment-13109165
] 

Suresh Srinivas commented on HDFS-2246:
---------------------------------------

OOME I saw was related to creating a large number of RPC proxy and not related to the cache.
I ran bunch of experiments:
# Create DN RPC proxy every time - this caused OOME (with or without cache). I did not dig
deep into how many objects are created per RPC proxy.
# Tried disabling cache - this resulted in loss of perf gains.

> Shortcut a local client reads to a Datanodes files directly
> -----------------------------------------------------------
>
>                 Key: HDFS-2246
>                 URL: https://issues.apache.org/jira/browse/HDFS-2246
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Sanjay Radia
>         Attachments: 0001-HDFS-347.-Local-reads.patch, HDFS-2246.20s.1.patch, HDFS-2246.20s.2.txt,
HDFS-2246.20s.3.txt, HDFS-2246.20s.patch, localReadShortcut20-security.2patch
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message