Mailing-List: contact users-help@kafka.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@kafka.apache.org
Received-SPF: pass (athena.apache.org: domain of hsy541@gmail.com designates
 209.85.219.45 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOG_4QYbzM82prNeB65LU5ZSWMNaDRkcLp8fTa7fAf0yf2+wjQ@mail.gmail.com>
References: 
 <CAG2CJAcJ4F0NiWO6e8LGFtbzG+M6kLmiO9rsSpSVnNTRKyrKEQ@mail.gmail.com>
	<CAOG_4QYbzM82prNeB65LU5ZSWMNaDRkcLp8fTa7fAf0yf2+wjQ@mail.gmail.com>
Date: Fri, 11 Oct 2013 11:30:36 -0700
Message-ID: 
 <CAG2CJAcszyG2vq0GwyFHTeZLCiqySd1G-QkvxnK1XpxeOoX-5w@mail.gmail.com>
Subject: Re: Is there a way to pull out kafka metadata from zookeeper?
From: "hsy541@gmail.com" <hsy541@gmail.com>
To: users@kafka.apache.org
Content-Type: multipart/alternative; boundary=089e0149cd5e8d365604e87b50f0

--089e0149cd5e8d365604e87b50f0
Content-Type: text/plain; charset=ISO-8859-1

Thanks guys!
But I feel weird. Assume I have 20 brokers for 10 different topics with 2
partitions and  2 replicas for each. For each consumer consumes different
topic/replica I have to specify those 20 brokers and go over all of them to
know which broker is alive. And even worse how about I dynamically add new
broker into the cluster and remove the old one. I think it's nice to have a
way to get metadata from zookeeper(centralized coordinator?) directly.

Best,
Siyuan


On Fri, Oct 11, 2013 at 9:12 AM, Neha Narkhede <neha.narkhede@gmail.com>wrote:

> If, for some reason, you don't have access to a virtual IP or load
> balancer, you need to round robin once through all the brokers before
> failing a TopicMetadataRequest. So unless all the brokers in your cluster
> are down, this should not be a problem.
>
> Thanks,
> Neha
>
>
> On Thu, Oct 10, 2013 at 10:50 PM, hsy541@gmail.com <hsy541@gmail.com>
> wrote:
>
> > Hi guys,
> >
> > I'm trying to maintain a bunch of simple kafka consumer to consume
> messages
> > from brokers. I know there is a way to send TopicMetadataRequest to
> broker
> > and get the response from the broker. But you have to specify the broker
> > list to query the information. But broker might not be available because
> of
> > some failure. My question is is there any api I can call and query broker
> > metadata for topic/partition directly from zookeeper? I know I can query
> > that information using zookeeper API. But that's not friendly
> datastructure
> >  like the TopicMetadata/PartitionMetadata.  Thank you!
> >
> > Best,
> > Siyuan
> >
>

--089e0149cd5e8d365604e87b50f0--