hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Genmao Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15038) Abstract {{MetadataStore}} in {{S3Guard}} into a common module.
Date Tue, 14 Nov 2017 07:21:00 GMT
Genmao Yu created HADOOP-15038:
----------------------------------

             Summary: Abstract {{MetadataStore}} in {{S3Guard}} into a common module.
                 Key: HADOOP-15038
                 URL: https://issues.apache.org/jira/browse/HADOOP-15038
             Project: Hadoop Common
          Issue Type: New Feature
          Components: fs
    Affects Versions: 3.0.0-beta1
            Reporter: Genmao Yu


Open this JIRA to discuss if we should move {{MetadataStore}} in {{S3Guard}} into a common
module. Based on this work, other filesystem or object store can implement their own metastore
for optimization (known issues like consistency problem and metadata operation performance).
[~stevel@apache.org] and other guys have done many base and great works in {{S3Guard}}. It
is very helpful to start work. I did some perf test in HADOOP-14098, and started related work
for Aliyun OSS.  Indeed there are still works to do for {{S3Guard}}, like metadata cache inconsistent
with S3 and so on. It also will be a problem for other object store. However, we can do these
works in parallel.

cc [~drankye]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


Mime
View raw message