hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13293) add a special 0 byte input stream for empty blobs
Date Mon, 12 Feb 2018 15:30:02 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Steve Loughran updated HADOOP-13293:
    Parent: HADOOP-15220  (was: HADOOP-14831)

> add a special 0 byte input stream for empty blobs
> -------------------------------------------------
>                 Key: HADOOP-13293
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13293
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
> S3a (and the other object stores) have a lot of IO going on, even for 0 byte files. They
don't need to: that's a special case which can be handled locally. A special ZeroByteInputStream
class could handle this for all the object stores.
> This isn't much of an optimization: code shouldn't normally need to go through 0 byte
files, but we see evidence it does sometimes happen.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message