hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11006) Ozone: support setting chunk size in streaming API
Date Thu, 30 Mar 2017 20:59:42 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949814#comment-15949814

Xiaoyu Yao commented on HDFS-11006:

[~anu], I have the same suggestion on restricting the maximum chunk size. Otherwise the ByteBuffer.allocate
could easily OOM or cause protobuf/netty issues.

> Ozone: support setting chunk size in streaming API
> --------------------------------------------------
>                 Key: HDFS-11006
>                 URL: https://issues.apache.org/jira/browse/HDFS-11006
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Anu Engineer
>            Assignee: Yiqun Lin
>         Attachments: HDFS-11006-HDFS-7240.001.patch
> Right now we have a hard coded chunk size, we should either have this read from config
or the user should be able to pass this to ChunkInputStream

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message