hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier
Date Tue, 06 Feb 2018 11:34:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353750#comment-16353750
] 

Rakesh R commented on HDFS-13110:
---------------------------------

Note: Attached patch [^HDFS-13110-HDFS-10285-00.patch], is prepared on top of HDFS-13097 ,
as latter reduces my coding effort. Please apply [^HDFS-13097-HDFS-10285.02.patch] first an
then apply this jira patch. Sorry for the inconvenience.

> [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-13110
>                 URL: https://issues.apache.org/jira/browse/HDFS-13110
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Rakesh R
>            Priority: Major
>         Attachments: HDFS-13110-HDFS-10285-00.patch
>
>
> This task is to address the following [~daryn]'s comments. Please refer HDFS-10285 to
see more detailed discussion.
> *Comment-10)*
> {quote}
> NamenodeProtocolTranslatorPB
> Most of the api changes appear unnecessary.
> IntraSPSNameNodeContext#getFileInfo swallows all IOEs, based on assumption that any and
all IOEs means FNF which probably isn’t the intention during rpc exceptions.
> {quote}
>  *Comment-13)*
> {quote}
> StoragePolicySatisfier
>  It appears to make back-to-back calls to hasLowRedundancyBlocks and getFileInfo for
every file. Haven’t fully groked the code, but if low redundancy is not the common case,
then it shouldn’t be called unless/until needed. It looks like files that are under replicated
are re-queued again?
> {quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message