hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wujinhu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15027) Improvements for Hadoop read from AliyunOSS
Date Fri, 10 Nov 2017 06:23:01 GMT
wujinhu created HADOOP-15027:
--------------------------------

             Summary: Improvements for Hadoop read from AliyunOSS
                 Key: HADOOP-15027
                 URL: https://issues.apache.org/jira/browse/HADOOP-15027
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/oss
            Reporter: wujinhu


Currently, read performance is poor when Hadoop reads from AliyunOSS. It needs about 1min
to read 1GB from OSS.
Class AliyunOSSInputStream uses single thread to read data from AliyunOSS,  so we can refactor
this by using multi-thread pre read to improve this.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message