Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Received-SPF: pass (athena.apache.org: domain of kglover@appnexus.com
 designates 207.5.72.163 as permitted sender)
From: Kristopher Glover <kglover@appnexus.com>
To: "dev@hive.apache.org" <dev@hive.apache.org>
Date: Thu, 15 Aug 2013 12:55:32 -0700
Subject: Re: threading with hive client
Thread-Topic: threading with hive client
Thread-Index: Ac6Z8Wet2KS2Z8luRjGhONkeNf0xxA==
Message-ID: <CE32A995.1FE7A%kglover@appnexus.com>
In-Reply-To: 
 <CAFukC=7dhP+VcdCg11u_r9qPW6SBy2v7Ai==uEcY9TqEvDEwqA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
user-agent: Microsoft-MacOutlook/14.3.6.130613
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Interesting, I didn't realize that. If that's the case then I suppose it'd
be really bad for me to circumvent the lock by reproducing the Driver#run
method by calling Driver#compile and Driver#execute directly from within
my app.=20

If that is the case why make Driver#compile and Driver#execute public
methods? There doesn't seem to be any inheritance that requires them to be
public and the fact that they are public opens up a thread safety issue.

Thanks,
Kris

On 8/15/13 1:11 PM, "Brock Noland" <brock@cloudera.com> wrote:

>The hive semantic analyzer is not fully thread safe.  We'd like to remove
>that lock but it will be a large project.
>
>Brock
>
>
>On Thu, Aug 15, 2013 at 11:12 AM, Kristopher Glover
><kglover@appnexus.com>wrote:
>
>> Hi Everyone,
>>
>> I'm experiencing a threading issue with the Hive client where I want to
>> run multiple queries on the same JVM.
>>
>>  The problem I'm having is that org.apache.hadoop.hive.ql.Driver#run
>>(line
>> 907)  has the following few lines of code :
>>
>>  synchronized (compileMonitor) {
>>
>>       ret =3D compile(command);
>>
>>     }
>>
>>
>> The compileMonitor is a static so it blocks all threads even though I'm
>> using different instances of the Driver class. I could explicitly call
>> Driver#compile then Driver#execute to avoid the synchronized block but I
>> don't know if it's serving a special purpose. Does anyone know why that
>> synchronized block is there and if its really necessary ?
>>
>>
>> Thanks,
>>
>> Kris
>>
>
>
>
>--=20
>Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org