kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dong Lin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6258) SSLTransportLayer should keep reading from socket until either the buffer is full or the socket has no more data
Date Wed, 22 Nov 2017 08:06:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dong Lin updated KAFKA-6258:
----------------------------
    Description: When consumer uses plaintext and there is remaining data in consumer's buffer,
consumer.poll() will read all data available from the socket buffer to consumer buffer. However,
if consumer uses ssl and there is remaining data, consumer.poll() may only read 16 KB (the
size of SslTransportLayer.appReadBuffer) from socket buffer. This will reduce efficient of
consumer.poll(). For users who naively sleep a constant time after each consumer.poll(), we
observe that the throughput will reduce after they switch from plaintext to ssl.

> SSLTransportLayer should keep reading from socket until either the buffer is full or
the socket has no more data
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6258
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6258
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Dong Lin
>            Assignee: Dong Lin
>
> When consumer uses plaintext and there is remaining data in consumer's buffer, consumer.poll()
will read all data available from the socket buffer to consumer buffer. However, if consumer
uses ssl and there is remaining data, consumer.poll() may only read 16 KB (the size of SslTransportLayer.appReadBuffer)
from socket buffer. This will reduce efficient of consumer.poll(). For users who naively sleep
a constant time after each consumer.poll(), we observe that the throughput will reduce after
they switch from plaintext to ssl.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message