hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yogendra reddy <yogendra...@gmail.com>
Subject Re: hive transactions
Date Thu, 04 Dec 2014 03:55:05 GMT
Thanks Vikas Srivastava, I do have lot of space available in my metastore db


Thanks,
Yogendra

On Thu, Dec 4, 2014 at 9:12 AM, hadoop hive <hadoophive@gmail.com> wrote:

> Hi yogendra,
>
> You need to check if space is available on you backend metadata db server
> like mysql or oracle server.
>
> It might be possible the your queries are getting stuck becoz there is no
> enough space for mysql logging.
>
> Thanks
> Vikas Srivastava
> On Dec 4, 2014 7:59 AM, "Yogendra reddy" <yogendra.60@gmail.com> wrote:
>
>> Thanks Alan, I'm able to see TXNS table and yes I have upgraded from 0.13
>> to 0.14.
>>
>> any idea as to wht else might cause this issue?
>>
>> Thanks,
>> Yogendra
>> ------------------------------
>> From: Alan Gates <gates@hortonworks.com>
>> Sent: ‎12/‎3/‎2014 9:51 AM
>> To: user@hive.apache.org
>> Subject: Re: hive transactions
>>
>> Usually this means the metastore database was not properly upgraded.  You
>> can check this by logging into your RDBMS and listing all the tables.  If
>> you see a table named TXNS then the proper tables exist.
>>
>> Did you install Hive 0.14 fresh or upgrade from a previous version?  If
>> you upgraded did you run the upgrade scripts?  In the Hive 0.12 to Hive
>> 0.13 upgrade script it calls hive-txn-schema-0.13.0.mysql.sql, which will
>> create these tables.  If you're upgrading from 13 to 14 there shouldn't be
>> a need to create the tables.
>>
>> Alan.
>>
>>   yogendra reddy <yogendra.60@gmail.com>
>>  November 30, 2014 at 21:19
>> Hi All,
>>
>> I'm caught up with the error pasted below after trying to use hive
>> transaction feature.I have followed this wiki to set required
>> configuration.
>> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration
>>
>>
>> set hive.support.concurrency=true;
>> set hive.exec.dynamic.partition.mode=nonstrict;
>> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
>> set hive.compactor.initiator.on=true;
>> set hive.compactor.worker.threads=1;
>>
>> After setting the above I just ran this command "describe formatted
>> acidtest;"
>> any pointers as to why this occurs?
>>
>> FAILED: Error in acquiring locks: Error communicating with the metastore
>> 14/12/01 05:02:05 ERROR ql.Driver: FAILED: Error in acquiring locks:
>> Error communicating with the metastore
>> org.apache.hadoop.hive.ql.lockmgr.LockException: Error communicating with
>> the metastore
>>         at
>> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:101)
>>         at
>> org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.acquireLocks(DbTxnManager.java:202)
>>         at
>> org.apache.hadoop.hive.ql.Driver.acquireLocksAndOpenTxn(Driver.java:939)
>>         at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1166)
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1004)
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:994)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:783)
>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> Caused by: org.apache.thrift.TApplicationException: Internal error
>> processing lock
>>         at
>> org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
>>         at
>> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
>>         at
>> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_lock(ThriftHiveMetastore.java:3781)
>>         at
>> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.lock(ThriftHiveMetastore.java:3768)
>>         at
>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.lock(HiveMetaStoreClient.java:1736)
>>         at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>         at
>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:90)
>>         at com.sun.proxy.$Proxy9.lock(Unknown Source)
>>         at
>> org.apache.hadoop.hive.ql.lockmgr.DbLockManager.lock(DbLockManager.java:80)
>>         ... 17 more
>>
>> p.s : Before setting the transaction specific properties I was able to
>> run hive queries successfully
>>
>> Thanks,
>> Yogendra
>>
>>
>> --
>> Sent with Postbox <http://www.getpostbox.com>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>>
>

Mime
View raw message