incubator-drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Test Case for Inability to run a Distributed Drill Query (on JSON files on FS).
Date Sat, 08 Nov 2014 04:32:05 GMT
OK.  Then it sounds like the config has localhost for the ZK address
somewhere.  Or Drill client is connecting that way and that is leaking
through to affect how the Drillbit does a query.



On Fri, Nov 7, 2014 at 3:29 PM, Aditya <adityakishore@gmail.com> wrote:

> I do not think Drillbits, in any mode, starts an embedded Zookeeper server.
>
> I know because I was once looking for how to do it but could not find.
>
> On Fri, Nov 7, 2014 at 1:18 PM, Ted Dunning <ted.dunning@gmail.com> wrote:
>
> > On Fri, Nov 7, 2014 at 11:06 AM, Jacques Nadeau <jacques@apache.org>
> > wrote:
> >
> > > Ted,
> > > I'm not sure what you're suggesting.  Drill uses zk to find out about
> > other
> > > nodes.  As such, the only nodes it will know about are the nodes that
> > have
> > > the same zk setup.
> > >
> >
> > If a ZK client has a connection string that contains members of multiple
> ZK
> > clusters, then the client connect to different ZK nodes each time it
> > connects.  This can lead to massive confusion.  If a Drillbit uses
> multiple
> > connections, those connections could actually connect to different ZK
> > nodes.  Thus, the drill bit might register with one ZK on one connection,
> > but use another to find other drill bits.  The Curator library tends to
> use
> > a style in which connections are used for fairly local purposes, so this
> > isn't all that far-fetched.
> >
> > Similarly, if each drill bit actually is running a solo embedded ZK, a
> user
> > could be confused about what is happening.  If somebody touched multiple
> > drill bits and checked the ZK configs on each node, the problem would be
> > obvious.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message