hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Jeltema <bdjelt...@gmail.com>
Subject Re: hive failure after HDP 2.3 upgrade
Date Thu, 19 Nov 2015 23:55:08 GMT
I did. Besides, the query is broken, not the schema. If I perform this query from the mysql
command prompt, the escape has to be specified as ESCAPE ‘\\' <smb://'>

> On Nov 19, 2015, at 6:46 PM, Artem Ervits <artemervits@gmail.com> wrote:
> 
> Confirm Hive metastore schema update scripts have run.
> 
> On Nov 19, 2015 11:39 AM, "Brian Jeltema" <bdjeltema@gmail.com <mailto:bdjeltema@gmail.com>>
wrote:
> Following up, I turned on logging in the MySQL server to capture the failing query. The
query being logged by MySQL is
> 
>   SELECT `A0`.`NAME` AS NUCORDER0 FROM `DBS` `A0` WHERE LOWER(`A0`.`NAME`) LIKE '_%'
ESCAPE '\' ORDER BY NUCORDER0
> 
> which I believe is failing because the backslash in the ESCAPE clause should be doubled.
How can I fix this?
> 
> Brian
> 
> 
>> On Nov 19, 2015, at 7:28 AM, Brian Jeltema <bdjeltema@gmail.com <mailto:bdjeltema@gmail.com>>
wrote:
>> 
>> Originally posted in the Ambari users group, but probably more appropriate here:
>> 
>> I’ve done a rolling upgrade to HDP 2.3 and everything appears to be working now
except for Hive. The HiveServer2
>> process is shown as ‘Started’, but it’s really broken, as is the Hive Metastore.
HiveServer2 is not listening on port 10010 (or 10011 or 10000). In the
>> logs for both processes I see an endless number of the stack traces below. Any suggestions
are appreciated.
>> 
>> Brian
>> 
>> 2015-11-18 14:17:17,417 INFO  metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747))
- 0: get_all_databases
>> 2015-11-18 14:17:17,418 INFO  HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372))
- ugi=hive	ip=unknown-ip-addr	cmd=get_all_databases	
>> 2015-11-18 14:17:17,421 ERROR metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(173))
- Retrying HMSHandler after 2000 ms (attempt 4 of 10) with error: javax.jdo.JDOException:
Exception thrown when executing query
>> 	at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:596)
>> 	at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:230)
>> 	at org.apache.hadoop.hive.metastore.ObjectStore.getDatabases(ObjectStore.java:701)
>> 	at org.apache.hadoop.hive.metastore.ObjectStore.getAllDatabases(ObjectStore.java:717)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:114)
>> 	at com.sun.proxy.$Proxy7.getAllDatabases(Unknown Source)
>> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_all_databases(HiveMetaStore.java:1179)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
>> 	at com.sun.proxy.$Proxy8.get_all_databases(Unknown Source)
>> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:1032)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
>> 	at com.sun.proxy.$Proxy9.getAllDatabases(Unknown Source)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1237)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.reloadFunctions(Hive.java:174)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.<clinit>(Hive.java:166)
>> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
>> 	at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:127)
>> 	at org.apache.hive.service.cli.CLIService.init(CLIService.java:112)
>> 	at org.apache.hive.service.CompositeService.init(CompositeService.java:59)
>> 	at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:104)
>> 	at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:411)
>> 	at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:78)
>> 	at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:654)
>> 	at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:527)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>> NestedThrowablesStackTrace:
>> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your
SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax
to use near ''\' ORDER BY NUCORDER0' at line 1
>> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
>> 	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>> 	at com.mysql.jdbc.Util.getInstance(Util.java:386)
>> 	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
>> 	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3597)
>> 	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3529)
>> 	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1990)
>> 	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2151)
>> 	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2625)
>> 	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2119)
>> 	at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2283)
>> 	at com.jolbox.bonecp.PreparedStatementHandle.executeQuery(PreparedStatementHandle.java:174)
>> 	at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeQuery(ParamLoggingPreparedStatement.java:381)
>> 	at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:504)
>> 	at org.datanucleus.store.rdbms.query.JDOQLQuery.performExecute(JDOQLQuery.java:651)
>> 	at org.datanucleus.store.query.Query.executeQuery(Query.java:1786)
>> 	at org.datanucleus.store.query.Query.executeWithArray(Query.java:1672)
>> 	at org.datanucleus.store.query.Query.execute(Query.java:1654)
>> 	at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:221)
>> 	at org.apache.hadoop.hive.metastore.ObjectStore.getDatabases(ObjectStore.java:701)
>> 	at org.apache.hadoop.hive.metastore.ObjectStore.getAllDatabases(ObjectStore.java:717)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:114)
>> 	at com.sun.proxy.$Proxy7.getAllDatabases(Unknown Source)
>> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_all_databases(HiveMetaStore.java:1179)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
>> 	at com.sun.proxy.$Proxy8.get_all_databases(Unknown Source)
>> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:1032)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
>> 	at com.sun.proxy.$Proxy9.getAllDatabases(Unknown Source)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1237)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.reloadFunctions(Hive.java:174)
>> 	at org.apache.hadoop.hive.ql.metadata.Hive.<clinit>(Hive.java:166)
>> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503)
>> 	at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:127)
>> 	at org.apache.hive.service.cli.CLIService.init(CLIService.java:112)
>> 	at org.apache.hive.service.CompositeService.init(CompositeService.java:59)
>> 	at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:104)
>> 	at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:411)
>> 	at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:78)
>> 	at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:654)
>> 	at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:527)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> 	at java.lang.reflect.Method.invoke(Method.java:497)
>> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> 


Mime
View raw message