hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From unmesha sreeveni <unmeshab...@gmail.com>
Subject Re: hive transactions
Date Mon, 01 Dec 2014 06:19:17 GMT
Hi yogendra,

I have tried the same thing and I wrote a doc on ACID properties.

http://unmeshasreeveni.blogspot.in/2014/11/updatedeleteinsert-in-hive-0140.html

Please follow that steps.

let me know if that stucks you in any point

On Mon, Dec 1, 2014 at 10:49 AM, yogendra reddy <yogendra.60@gmail.com>
wrote:

> Hi All,
>
> I'm caught up with the error pasted below after trying to use hive
> transaction feature.I have followed this wiki to set required
> configuration.
> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration
>
>
> set hive.support.concurrency=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> set hive.compactor.initiator.on=true;
> set hive.compactor.worker.threads=1;
>
> After setting the above I just ran this command "describe formatted
> acidtest;"
> any pointers as to why this occurs?
>
> FAILED: Error in acquiring locks: Error communicating with the metastore
> 14/12/01 05:02:05 ERROR ql.Driver: FAILED: Error in acquiring locks: Error
> communicating with the metastore
> org.apache.hadoop.hive.ql.lockmgr.LockException: Error communicating with
> the metastore
>         at
> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:101)
>         at
> org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.acquireLocks(DbTxnManager.java:202)
>         at
> org.apache.hadoop.hive.ql.Driver.acquireLocksAndOpenTxn(Driver.java:939)
>         at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1166)
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1004)
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:994)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410)
>         at
> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:783)
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: org.apache.thrift.TApplicationException: Internal error
> processing lock
>         at
> org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
>         at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
>         at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_lock(ThriftHiveMetastore.java:3781)
>         at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.lock(ThriftHiveMetastore.java:3768)
>         at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.lock(HiveMetaStoreClient.java:1736)
>         at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:90)
>         at com.sun.proxy.$Proxy9.lock(Unknown Source)
>         at
> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:80)
>         ... 17 more
>
> p.s : Before setting the transaction specific properties I was able to run
> hive queries successfully
>
> Thanks,
> Yogendra
>



-- 
*Thanks & Regards *


*Unmesha Sreeveni U.B*
*Hadoop, Bigdata Developer*
*Centre for Cyber Security | Amrita Vishwa Vidyapeetham*
http://www.unmeshasreeveni.blogspot.in/

Mime
View raw message