kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joe Stein (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-240) implement new producer and consumer request format
Date Wed, 18 Jan 2012 18:54:39 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188617#comment-13188617

Joe Stein commented on KAFKA-240:

<< we just need a way to encode array structures

right, here we have arrays within arrays so we need to have the "hint" to explain that

what I am proposing is to have a string


split on ","

X is the number of elements in the topics array

A,B,C... (etc) would be for each topic how many partition array elements are there

so this could look


meaning 2 topic_data_struct elements, the first element of the topic array has 2 partition_data_struct
elements in it's array, the second element in the topic array has 3 partition_data_struct

the walking the positions becomes easy and for the gets from the bytebuffer creating the objects

if it was 

5,3,3,3,3,4 then 5 topics, the first 4 of them 3 elements and the last 4 elements

I will start in on this approach
> implement new producer and consumer request format
> --------------------------------------------------
>                 Key: KAFKA-240
>                 URL: https://issues.apache.org/jira/browse/KAFKA-240
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: core
>            Reporter: Jun Rao
>             Fix For: 0.8
> We want to change the producer/consumer request/response format according to the discussion
in the following wiki:
> https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message