hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6750) The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale
Date Fri, 25 Jul 2014 23:24:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075124#comment-14075124
] 

Arpit Agarwal commented on HDFS-6750:
-------------------------------------

+1 for the patch. iiuc the added call to {{slot.clear();}} is an unrelated change?

> The DataNode should use its shared memory segment to mark short-circuit replicas that
have been unlinked as stale
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-6750
>                 URL: https://issues.apache.org/jira/browse/HDFS-6750
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode, hdfs-client
>    Affects Versions: 2.4.0
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: HDFS-6750.001.patch
>
>
> The DataNode should mark short-circuit replicas that have been unlinked as stale.  This
would prevent replicas that had been deleted from lingering in the DFSClient cache.  (At least
for DFSClients that use shared memory; those without shared memory will still have to use
the timeout method.)
> Note that when a replica is stale, any ongoing reads or mmaps can still complete.  But
stale replicas will be removed from the DFSClient cache once they're no longer in use.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message