hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Virajith Jalaparti (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HDFS-12093) [READ] Share remoteFS between ProvidedReplica instances.
Date Mon, 14 Aug 2017 17:32:01 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Virajith Jalaparti reassigned HDFS-12093:

    Assignee: Virajith Jalaparti

> [READ] Share remoteFS between ProvidedReplica instances.
> --------------------------------------------------------
>                 Key: HDFS-12093
>                 URL: https://issues.apache.org/jira/browse/HDFS-12093
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Ewan Higgs
>            Assignee: Virajith Jalaparti
>         Attachments: HDFS-12093-HDFS-9806.001.patch, HDFS-12093-HDFS-9806.002.patch
> When a Datanode comes online using Provided storage, it fills the {{ReplicaMap}} with
the known replicas. With Provided Storage, this includes {{ProvidedReplica}} instances. Each
of these objects, in their constructor, will construct an FileSystem using the Service Provider.
This can result in contacting the remote file system and checking that the credentials are
correct and that the data is there. For large systems this is a prohibitively expensive operation
to perform per replica.
> Instead, the {{ProvidedVolumeImpl}} should own the reference to the {{remoteFS}} and
should share it with the {{ProvidedReplica}} objects on their creation.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message