hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-17234) Remove HBase metastore from master
Date Tue, 08 Aug 2017 19:55:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117879#comment-16117879
] 

Lefty Leverenz edited comment on HIVE-17234 at 8/8/17 7:54 PM:
---------------------------------------------------------------

Doc note:  This removes 15 hive.metastore.hbase.* configs from HiveConf.java.  (Why wasn't
*hive.metastore.hbase.file.metadata.threads* removed?)

Most of them haven't been documented in the wiki yet.  The section "Hive Metastore HBase"
in Configuration Properties only has 3 configs:

* [hive.metastore.hbase.cache.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.cache.size]
(_removed by HIVE-9693 before the 2.0.0 release, so didn't belong in the wiki in the first
place_)
* [hive.metastore.hbase.cache.ttl | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.cache.ttl]
(_removed by this patch, so need to update wiki_)
* [hive.metastore.hbase.file.metadata.threads | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.file.metadata.threads]
(_still in the code_)

Here's the complete list, just for the record:

* hive.metastore.hbase.catalog.cache.size
* hive.metastore.hbase.aggregate.stats.cache.size
* hive.metastore.hbase.aggregate.stats.max.partitions
* hive.metastore.hbase.aggregate.stats.false.positive.probability
* hive.metastore.hbase.aggregate.stats.max.variance
* hive.metastore.hbase.cache.ttl (_documented in wiki_)
* hive.metastore.hbase.cache.max.writer.wait
* hive.metastore.hbase.cache.max.reader.wait
* hive.metastore.hbase.cache.max.full
* hive.metastore.hbase.cache.clean.until
* hive.metastore.hbase.connection.class
* hive.metastore.hbase.aggr.stats.cache.entries
* hive.metastore.hbase.aggr.stats.memory.ttl
* hive.metastore.hbase.aggr.stats.invalidator.frequency
* hive.metastore.hbase.aggr.stats.hbase.ttl
* hive.metastore.hbase.file.metadata.threads (_documented in wiki; not removed here_)


was (Author: lefty@hortonworks.com):
Doc note:  This removes 15 hive.metastore.hbase.* configs from HiveConf.java.  (Why wasn't
*hive.metastore.hbase.file.metadata.threads* removed?)

Most of them haven't been documented in the wiki yet.  The section "Hive Metastore HBase"
in Configuration Properties only has 3 configs:

* [hive.metastore.hbase.cache.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.cache.size]
(_still in the code_)
* [hive.metastore.hbase.cache.ttl | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.cache.ttl]
(_removed by this patch, so need to update wiki_)
* [hive.metastore.hbase.cache.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.metastore.hbase.cache.size]
(_removed by HIVE-9693 before the 2.0.0 release, so didn't belong in the wiki in the first
place_)

Here's the complete list, just for the record:

* hive.metastore.hbase.catalog.cache.size
* hive.metastore.hbase.aggregate.stats.cache.size
* hive.metastore.hbase.aggregate.stats.max.partitions
* hive.metastore.hbase.aggregate.stats.false.positive.probability
* hive.metastore.hbase.aggregate.stats.max.variance
* hive.metastore.hbase.cache.ttl (_documented in wiki_)
* hive.metastore.hbase.cache.max.writer.wait
* hive.metastore.hbase.cache.max.reader.wait
* hive.metastore.hbase.cache.max.full
* hive.metastore.hbase.cache.clean.until
* hive.metastore.hbase.connection.class
* hive.metastore.hbase.aggr.stats.cache.entries
* hive.metastore.hbase.aggr.stats.memory.ttl
* hive.metastore.hbase.aggr.stats.invalidator.frequency
* hive.metastore.hbase.aggr.stats.hbase.ttl
* hive.metastore.hbase.file.metadata.threads (_documented in wiki; not removed here_)

> Remove HBase metastore from master
> ----------------------------------
>
>                 Key: HIVE-17234
>                 URL: https://issues.apache.org/jira/browse/HIVE-17234
>             Project: Hive
>          Issue Type: Task
>          Components: HBase Metastore
>    Affects Versions: 3.0.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>             Fix For: 3.0.0
>
>         Attachments: HIVE-17234.patch
>
>
> No new development has been done on the HBase metastore in at least a year, and to my
knowledge no one is using it (nor is it even in a state to be fully usable).  Given the lack
of interest in continuing to develop it, we should remove it rather than leave dead code hanging
around and extra tests taking up time in test runs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message