spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-26674) Consolidate CompositeByteBuf when reading large frame
Date Mon, 21 Jan 2019 11:40:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-26674:
------------------------------------

    Assignee:     (was: Apache Spark)

> Consolidate CompositeByteBuf when reading large frame
> -----------------------------------------------------
>
>                 Key: SPARK-26674
>                 URL: https://issues.apache.org/jira/browse/SPARK-26674
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: liupengcheng
>            Priority: Major
>
> Currently, TransportFrameDecoder will not consolidate the buffers read from network which
may cause memory waste. Actually, bytebuf's writtenIndex is far less than it's capacity 
in most cases, so we can optimize it by doing consolidation.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message