hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergey Shelukhin <>
Subject Re: Big Lock in Driver.compileInternal
Date Thu, 28 May 2015 00:07:58 GMT
Hi. As luck would have it, we are currently looking at this issue :)
I have a small patch up at; I tested it a bit w/a
unit test and some manual cluster testing. Would you be willing to test it
on your setup?

On 15/5/25, 20:54, "Loudongfeng" <> wrote:

>Hi, All
>I notice that there is a big lock in org.apache.hadoop.hive.ql.Driver
>Following is a piece of code from Apache Hive 1.2.0
>private static final Object compileMonitor = new Object();
>private int compileInternal(String command) {
>  int ret;
>  synchronized (compileMonitor) {
>    ret = compile(command);
>  }
>This means HQLs submitted concurrently from clients side will be compiled
>one by one on Hive Server side.
>This will cause problem when compile phase is slow.
>My question is ,what does this lock protect for? Is it possible to remove
>it ?
>Best Regards

View raw message