Mailing-List: contact kafka-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: kafka-dev@incubator.apache.org
Date: Wed, 18 Jan 2012 18:54:39 +0000 (UTC)
From: "Joe Stein (Commented) (JIRA)" <jira@apache.org>
To: kafka-dev@incubator.apache.org
Message-ID: 
 <799335474.53495.1326912879960.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1956214936.10937.1325789919235.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (KAFKA-240) implement new producer and consumer
 request format
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188617#comment-13188617 ] 

Joe Stein commented on KAFKA-240:
---------------------------------

<< we just need a way to encode array structures

right, here we have arrays within arrays so we need to have the "hint" to explain that

what I am proposing is to have a string

X,A,B,C

split on ","

X is the number of elements in the topics array

A,B,C... (etc) would be for each topic how many partition array elements are there

so this could look

2,2,3

meaning 2 topic_data_struct elements, the first element of the topic array has 2 partition_data_struct elements in it's array, the second element in the topic array has 3 partition_data_struct elements

the walking the positions becomes easy and for the gets from the bytebuffer creating the objects

if it was 

5,3,3,3,3,4 then 5 topics, the first 4 of them 3 elements and the last 4 elements

I will start in on this approach
                
> implement new producer and consumer request format
> --------------------------------------------------
>
>                 Key: KAFKA-240
>                 URL: https://issues.apache.org/jira/browse/KAFKA-240
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: core
>            Reporter: Jun Rao
>             Fix For: 0.8
>
>
> We want to change the producer/consumer request/response format according to the discussion in the following wiki:
> https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira