hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-11657) HIVE-2573 introduces some issues
Date Wed, 26 Aug 2015 22:50:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715668#comment-14715668
] 

Sergey Shelukhin edited comment on HIVE-11657 at 8/26/15 10:50 PM:
-------------------------------------------------------------------

[~navis] fyi if you have some easy fixes in mind :)

Example of logging I get 
{noformat}
2015-08-26 17:52:16,695 INFO [InputInitializer [Map 1] #0] metastore.HiveMetaStore: 0: Opening
raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
2015-08-26 17:52:16,730 INFO [InputInitializer [Map 1] #0] metastore.ObjectStore: ObjectStore,
initialize called
[snip]
{noformat}

The call stack for the above is:
{noformat}
	at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3054)
	at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3074)
	at org.apache.hadoop.hive.ql.metadata.Hive.getAllFunctions(Hive.java:3299)
	at org.apache.hadoop.hive.ql.metadata.Hive.reloadFunctions(Hive.java:175)
	at org.apache.hadoop.hive.ql.metadata.Hive.<clinit>(Hive.java:167)
	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$MetastoreCache.getHive(OrcInputFormat.java:1544)
{noformat}
Then
{noformat}
2015-08-26 17:52:16,761 INFO [InputInitializer [Map 1] #0] hive.metastore: Trying to connect
to metastore with URI thrift://[snip]:9085
2015-08-26 17:52:16,782 INFO [InputInitializer [Map 1] #0] hive.metastore: Opened a connection
to metastore, current connections: 1
{noformat}



was (Author: sershe):
[~navis] fyi if you have some easy fixes in mind :)

Example of logging I get 
{noformat}
2015-08-26 17:52:16,695 INFO [InputInitializer [Map 1] #0] metastore.HiveMetaStore: 0: Opening
raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
2015-08-26 17:52:16,730 INFO [InputInitializer [Map 1] #0] metastore.ObjectStore: ObjectStore,
initialize called
[snip]
{noformat}

The call stack for the above is:
{noformat}
	at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3054)
	at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3074)
	at org.apache.hadoop.hive.ql.metadata.Hive.getAllFunctions(Hive.java:3299)
	at org.apache.hadoop.hive.ql.metadata.Hive.reloadFunctions(Hive.java:175)
	at org.apache.hadoop.hive.ql.metadata.Hive.<clinit>(Hive.java:167)
	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$MetastoreCache.getHive(OrcInputFormat.java:1544)
{noformat}
[snip]
{noformat}
2015-08-26 17:52:16,761 INFO [InputInitializer [Map 1] #0] hive.metastore: Trying to connect
to metastore with URI thrift://[snip]:9085
2015-08-26 17:52:16,782 INFO [InputInitializer [Map 1] #0] hive.metastore: Opened a connection
to metastore, current connections: 1
{noformat}


> HIVE-2573 introduces some issues
> --------------------------------
>
>                 Key: HIVE-11657
>                 URL: https://issues.apache.org/jira/browse/HIVE-11657
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Priority: Critical
>
> HIVE-2573 introduced static reload functions call.
> It has a few problems:
> 1) When metastore client is initialized using an externally supplied config (i.e. Hive.get(HiveConf)),
it still gets called during static init using the main service config. In my case, even though
I have uris in the supplied config to connect to remote MS (which eventually happens), the
static call creates objectstore, which is undesirable.
> 2) It breaks compat - old metastores do not support this call so new clients will fail,
and there's no workaround like not using a new feature because the static call is always made



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message