hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system
Date Sat, 13 Feb 2016 01:36:18 GMT
Chris Douglas created HDFS-9806:
-----------------------------------

             Summary: Allow HDFS block replicas to be provided by an external storage system
                 Key: HDFS-9806
                 URL: https://issues.apache.org/jira/browse/HDFS-9806
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Chris Douglas


In addition to heterogeneous media, many applications work with heterogeneous storage systems.
The guarantees and semantics provided by these systems are often similar, but not identical
to those of [HDFS|https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/index.html].
Any client accessing multiple storage systems is responsible for reasoning about each system
independently, and must propagate/and renew credentials for each store.

Remote stores could be mounted under HDFS. Block locations could be mapped to immutable file
regions, opaque IDs, or other tokens that represent a consistent view of the data. While correctness
for arbitrary operations requires careful coordination between stores, in practice we can
provide workable semantics with weaker guarantees.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message