hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7483) hive insert overwrite table select from self dead lock
Date Wed, 23 Jul 2014 04:54:38 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiaoyu Wang updated HIVE-7483:
------------------------------

    Description: 
CREATE TABLE test(
  id int, 
  msg string)
PARTITIONED BY ( 
  continent string, 
  country string)
CLUSTERED BY (id) 
INTO 10 BUCKETS
STORED AS ORC;

alter table test add partition(continent='Asia',country='India');

in hive-site.xml:
hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
hive.support.concurrency=true;

in hive shell:
set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;

insert into test table some records first.

then execute sql:
insert overwrite table test partition(continent='Asia',country='India') select id,msg from
test;

the log stop at :
INFO log.PerfLogger: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>

i think it has dead lock when insert overwrite table from it self.


  was:
CREATE TABLE test(
  id int, 
  msg string)
PARTITIONED BY ( 
  continent string, 
  country string)
CLUSTERED BY (id) 
INTO 10 BUCKETS
STORED AS ORC;

alter table test add partition(continent='Asia',country='India');

in hive-site.xml:
hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
hive.support.concurrency=true;
hive.zookeeper.quorum=zk1,zk2,zk3;

in hive shell:
set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;

insert into test table some records first.

then execute sql:
insert overwrite table test partition(continent='Asia',country='India') select id,msg from
test;

the log stop at :
INFO log.PerfLogger: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>

i think it has dead lock when insert overwrite table from it self.



> hive insert overwrite table select from self dead lock
> ------------------------------------------------------
>
>                 Key: HIVE-7483
>                 URL: https://issues.apache.org/jira/browse/HIVE-7483
>             Project: Hive
>          Issue Type: Bug
>          Components: Locking
>    Affects Versions: 0.13.1
>            Reporter: Xiaoyu Wang
>
> CREATE TABLE test(
>   id int, 
>   msg string)
> PARTITIONED BY ( 
>   continent string, 
>   country string)
> CLUSTERED BY (id) 
> INTO 10 BUCKETS
> STORED AS ORC;
> alter table test add partition(continent='Asia',country='India');
> in hive-site.xml:
> hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> hive.support.concurrency=true;
> in hive shell:
> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
> insert into test table some records first.
> then execute sql:
> insert overwrite table test partition(continent='Asia',country='India') select id,msg
from test;
> the log stop at :
> INFO log.PerfLogger: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>
> i think it has dead lock when insert overwrite table from it self.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message