hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3255) Add DBTokenStore to store Delegation Tokens in DB
Date Thu, 20 Dec 2012 06:35:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536820#comment-13536820
] 

Arpit Gupta commented on HIVE-3255:
-----------------------------------

I tested this patch out on a cluster running Hive. 


Ran a pig script that used hcat loader to read data from a partitioned table, processed it
and then stored the partitioned results in another table.

Hive metastore service was restarted as the data was being read and processed but before the
data was stored in the table. The tests passed on the cluster when the following config was
present on the server

{code}
<property>
  <name>hive.cluster.delegation.token.store.class</name>
  <value>org.apache.hadoop.hive.thrift.DBTokenStore</value>
</property>
{code}


When i ran the same test on a metastore which did not have this enabled the test failed as
expected.

                
> Add DBTokenStore to store Delegation Tokens in DB
> -------------------------------------------------
>
>                 Key: HIVE-3255
>                 URL: https://issues.apache.org/jira/browse/HIVE-3255
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore, Security
>    Affects Versions: 0.9.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: hive-3255_2.patch, hive-3255_3.patch, hive-3255_4.patch, hive-3255.patch
>
>
> Before HIVE-1696 metastore was completely stateless and all the data is in backend db.
HIVE-1696 added delegation tokens for metastore which metastore needs to keep in memory. HIVE-2467
added support for storing delegation tokens in ZooKeeper via an interface {{DelegationTokenStore}}.
This jira is about using DB backend for storing tokens which metastore uses for storing data.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message