hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suyog Parlikar <suyogparli...@gmail.com>
Subject Re: Hive Concurrency support
Date Fri, 21 Aug 2015 18:02:57 GMT
Thanks Elliot,

For the immediate reply.

But as per hive locking mechanism,
While inserting data to a partition hive acquires exclusive lock on that
partition and shared lock on the entire table.

How is it possible to insert data into a different partition of the same
table while having shared lock on the table which does not allow write
operation.

Please correct me if my understanding about the same is wrong.
(I am using hql inserts only for these operations)

Thanks,
Suyog
On Aug 21, 2015 7:28 PM, "Elliot West" <teabot@gmail.com> wrote:

> I presume you mean "into different partitions of a table at the same
> time"? This should be possible. It is certainly supported by the streaming
> API, which is probably where you want to look if you need to insert large
> volumes of data to multiple partitions concurrently. I can't see why it
> would not also be possible with HQL INSERTs.
>
> On Friday, 21 August 2015, Suyog Parlikar <suyogparlikar@gmail.com> wrote:
>
>> Can we insert data in different partitions of a table at a time.
>>
>> Waiting for inputs .
>>
>> Thanks in advance.
>>
>> - suyog
>>
>

Mime
View raw message