incubator-kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Burroughs (Commented) (JIRA)" <>
Subject [jira] [Commented] (KAFKA-171) Kafka producer should do a single write to send message sets
Date Thu, 27 Oct 2011 00:09:32 GMT


Chris Burroughs commented on KAFKA-171:

Even if this doesn't measurably improve node to node performance (and I'm not sure we should
expect it to since we don't have to wait for an ACK to send the next packet), isn't it definitely
making life better for network engineer?
> Kafka producer should do a single write to send message sets
> ------------------------------------------------------------
>                 Key: KAFKA-171
>                 URL:
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.7, 0.8
>            Reporter: Jay Kreps
>            Assignee: Jay Kreps
>             Fix For: 0.8
>         Attachments: KAFKA-171-draft.patch
> From email thread: 
> > Before sending an actual message, kafka producer do send a (control) message of
4 bytes to the server. Kafka producer always does this action before send some message to
the server.
> I think this is because in BoundedByteBufferSend.scala we do essentially
>  channel.write(sizeBuffer)
>  channel.write(dataBuffer)
> The correct solution is to use vector I/O and instead do
>  channel.write(Array(sizeBuffer, dataBuffer))

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message