Return-Path: X-Original-To: apmail-incubator-kafka-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-kafka-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 04664BB94 for ; Fri, 6 Jan 2012 17:43:40 +0000 (UTC) Received: (qmail 10808 invoked by uid 500); 6 Jan 2012 17:43:39 -0000 Delivered-To: apmail-incubator-kafka-dev-archive@incubator.apache.org Received: (qmail 10796 invoked by uid 500); 6 Jan 2012 17:43:39 -0000 Mailing-List: contact kafka-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: kafka-dev@incubator.apache.org Delivered-To: mailing list kafka-dev@incubator.apache.org Received: (qmail 10781 invoked by uid 99); 6 Jan 2012 17:43:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jan 2012 17:43:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.212.175] (HELO mail-wi0-f175.google.com) (209.85.212.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jan 2012 17:43:31 +0000 Received: by wibhq7 with SMTP id hq7so1390020wib.6 for ; Fri, 06 Jan 2012 09:43:10 -0800 (PST) MIME-Version: 1.0 Received: by 10.180.88.169 with SMTP id bh9mr8748903wib.20.1325871790602; Fri, 06 Jan 2012 09:43:10 -0800 (PST) Received: by 10.216.47.201 with HTTP; Fri, 6 Jan 2012 09:43:10 -0800 (PST) X-Originating-IP: [96.252.2.89] In-Reply-To: References: <4F0725C0.1070209@gmail.com> Date: Fri, 6 Jan 2012 12:43:10 -0500 Message-ID: Subject: Re: skype meeting on replication roadmap From: David Ormsbee To: kafka-dev@incubator.apache.org Cc: kafka-users@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d0418257018ba1804b5df958d X-Virus-Checked: Checked by ClamAV on apache.org --f46d0418257018ba1804b5df958d Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Either of those works great for me. In fact, any day next week works for me, though my preference would be Monday, Tuesday, or Friday. Thank you. Dave On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao wrote: > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > Jun > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick >wrote: > > > Any are fine with me too, if it was a little earlier than 2PM PST (5PM > EST) > > it would be better for me personally due to commuting constraints :) > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein wrote: > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein wrote= : > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > chris.burroughs@gmail.com> wrote: > > > > > > > >> I agree it's best to be patient and find a time that works for > > everyone > > > >> who wants to participate. In my particular case I can do Friday, = or > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > >> > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > >> > Joe, > > > >> > > > > >> > I am ok with moving the meeting to Monday. If nobody objects, ho= w > > > about > > > >> we > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will give > > > people a > > > >> > bit more time to read the docs and wiki. > > > >> > > > > >> > Jun > > > >> > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein > > wrote: > > > >> > > > > >> >> so it looks like i need to take my son to a birthday party > tonight > > > (my > > > >> babe > > > >> >> daughter is sick wife has to stay home with her) > > > >> >> > > > >> >> if there is any chance to move this to Monday? (sorry) if not I > > > >> understand > > > >> >> either way let me know > > > >> >> > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao > wrote: > > > >> >> > > > >> >>> Hi, everyone, > > > >> >>> > > > >> >>> So far, the following people have sent me their skype id: > > > >> >>> > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > >> >>> > > > >> >>> So the meeting is on. I encourage everyone to look at the desi= gn > > doc > > > >> in > > > >> >>> kafka-50 and the new wire format at > > > >> >>> > > > >> >>> > > > >> >> > > > >> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposa= lbefore > > > >> >>> the meeting. > > > >> >>> > > > >> >>> Here is a breakdown of all the jiras and their dependencies > > related > > > to > > > >> >> the > > > >> >>> replication work: > > > >> >>> > > > >> >>> 1. kafka-47: create/delete data structures in ZK, automaticall= y > > > create > > > >> >>> topic, and use them (making partitions logical, supporting onl= y > 1 > > > >> >> replica, > > > >> >>> no failure support). =EF=BB=BF=EF=BB=BF(L1) > > > >> >>> 1.1 kafka-237: create/delete ZK path for a topic in an admin > tool > > > >> (L0) > > > >> >>> 1.2 kafka-238: add a getTopicMetaData method in broker and > expose > > > it > > > >> to > > > >> >>> producer > > > >> >>> 1.3 kafka-239: Wire existing producer and consumer to use the > new > > > ZK > > > >> >> data > > > >> >>> structure > > > >> >>> 2. kafka-202: decouple request handler and socket sever; > enabling > > > long > > > >> >> poll > > > >> >>> in the consumer (L1) > > > >> >>> 3. kafka-240: implement new producer and consumer request form= at > > > (L1) > > > >> >>> 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > > > >> >>> 5. kafka-48: long poll in consumer (L2). depending on #2 > > > >> >>> 6. kafka-44: commit thread, replica fetcher thread (L3). > depending > > > on > > > >> #1, > > > >> >>> #4, #5 > > > >> >>> 7. kafka-45: broker starting up, leader election (L3). dependi= ng > > on > > > #1 > > > >> >>> 8. kafka-46: various ZK listeners (L3). depending on #1 > > > >> >>> 9. kafka-43: move master to preferred replica when possible > (L4). > > > >> >>> optimization > > > >> >>> 10. kafka-42: rebalance partition with new brokers (L4). extra > > > feature > > > >> >>> > > > >> >>> Thanks, > > > >> >>> > > > >> >>> Jun > > > >> >>> > > > >> >>> On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao > > wrote: > > > >> >>> > > > >> >>>> Hi, > > > >> >>>> > > > >> >>>> We'd like have a meeting discussing the roadmap for replicati= on > > > (our > > > >> >> 0.8 > > > >> >>>> release) and how people can contribute. How about a Skype > meeting > > > at > > > >> >> 2pm > > > >> >>>> Jan 6 (Friday)? If you are interested, please send me your > Skype > > > id. > > > >> >>>> > > > >> >>>> Thanks, > > > >> >>>> > > > >> >>>> Jun > > > >> >>>> > > > >> >>> > > > >> >> > > > >> >> > > > >> >> > > > >> >> -- > > > >> >> > > > >> >> /* > > > >> >> Joe Stein > > > >> >> http://www.linkedin.com/in/charmalloc > > > >> >> Twitter: @allthingshadoop < > http://www.twitter.com/allthingshadoop> > > > >> >> */ > > > >> >> > > > >> > > > > >> > > > >> > > > > > > > > > > > > -- > > > > > > > > /* > > > > Joe Stein > > > > http://www.linkedin.com/in/charmalloc > > > > Twitter: @allthingshadoop > > > > */ > > > > > > > > > > > > > > > > -- > > > > > > /* > > > Joe Stein > > > http://www.linkedin.com/in/charmalloc > > > Twitter: @allthingshadoop > > > */ > > > > > > --f46d0418257018ba1804b5df958d--