hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13293) add a special 0 byte input stream for empty blobs
Date Thu, 07 Sep 2017 09:19:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steve Loughran updated HADOOP-13293:
------------------------------------
    Parent Issue: HADOOP-14831  (was: HADOOP-13204)

> add a special 0 byte input stream for empty blobs
> -------------------------------------------------
>
>                 Key: HADOOP-13293
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13293
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> S3a (and the other object stores) have a lot of IO going on, even for 0 byte files. They
don't need to: that's a special case which can be handled locally. A special ZeroByteInputStream
class could handle this for all the object stores.
> This isn't much of an optimization: code shouldn't normally need to go through 0 byte
files, but we see evidence it does sometimes happen.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message