hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thejas Nair <the...@hortonworks.com>
Subject Re: regarding Hive Thrift Metastore Server
Date Wed, 24 Jul 2013 21:23:02 GMT
Without a metastore server, you would need to make access to the mysql
db possible from all hive clients. This is inherently less secure,
because anybody who can run hive cli can modify the mysql db, and
there is not metastore server doing the authorization checks.
If you don't care about security, metastore server is not that
necessary. In the hortonworks distribution (HDP), we have metastore
server running by default, and that is the common use case.

What version of hive are you using ? Try disabling the file system
cache in hive-site.xml in metastore (fs.hdfs.impl.disable.cache=true
and fs.file.impl.disable.cache=true)

On Wed, Jul 24, 2013 at 1:56 PM, Shangzhong zhu <shanzhong@gmail.com> wrote:
> Hi all,
>
> Our current setting of Hive is:
>
> Hive Thrift server -> MySQL metastore.
>
> All requests to MySQL metastore is going through the Thrift server. However,
> we have been seeing issues with this setting. Thrift server once a while
> gets stuck with TTransport timeout errors or even OOM.
>
> Seems removing the Hive Thrift server, and let all clients directly hit
> MySQL is a better option.
>
> Just want to check with the community that, is everyone directly using MySQL
> metastore without Thrift server, and is it the setting that Hive developer
> team recommend.
>
> Thanks,
> Shanzhong

Mime
View raw message