hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mikhail Antonov <olorinb...@gmail.com>
Subject Re: Need help with Installation hive 0.11
Date Sat, 05 Oct 2013 09:49:23 GMT
There's no need to disable Hive security, what you probably may want to do
is do use default (database/metastore permission-based) type of
authentication as suggested above (I myself use default/my custom
authentication, but not HCatalog one). DefaultHiveAuthorizationProvider -
that's the auth provider you may want to try, should work.






2013/10/5 Lefty Leverenz <leftyleverenz@gmail.com>

> I'm out of my depth, but based on existing documentation I'll make some
> suggestions you could try while waiting for replies from people who
> actually know about installation.
>
> Following Mikhail's lead, since this is an HCatalog security problem
> you should start by seeing if HCatalog is installed.  Then you could try
> changing the value of hive.security.authorization.manager -- I found it
> documented in two places:
>
>    - Hive Configuration Properties<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Authentication%2FAuthorization>
>    - HCatalog Storage Based Authorization<https://cwiki.apache.org/confluence/display/Hive/HCatalog+Authorization#HCatalogAuthorization-ConfiguringStorageSystemBasedAuthorization>
>
> The HCatalog authorization doc says you need to add the HCatalog jar to
> the Hive classpath (add "export HIVE_AUX_JARS_PATH=<*path to hcatalog jar*
> >" to hive-env.sh), but I'm not sure if that's needed now that HCatalog
> has been integrated with Hive.
>
> Try changing hive.security.authorization.manager to its default value,
> either the one listed in the Hive doc or the one in the HCatalog doc:
>
>    -
>    org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider
>    - org.apache.hcatalog.security.HdfsAuthorizationProvider
>
> Or you could turn off hive.security.authorization.enabled by setting it to
> false (see the HCatalog authorization doc).  There's more information about
> this property in the Hive Authorization doc's Prerequisites<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Authorization#LanguageManualAuthorization-Prerequisites>section.
>
> Changing configuration property values is documented in Getting Started (Configuration
> management overview<https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-Configurationmanagementoverview>)
> as well as Configuring Hive<https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration#AdminManualConfiguration-ConfiguringHive>
> .
>
> Agreed, the documentation is confusing.  We're trying to improve it.
>
> -- Lefty
>
>
> On Sat, Oct 5, 2013 at 12:53 AM, Baahu <bahubali@gmail.com> wrote:
>
>> Lefty,
>> Can the install instructions given at
>> https://cwiki.apache.org/confluence/display/Hive/GettingStarted be
>> followed as is?
>> I see instructions to build from source code just after "Installing Hive
>> from a Stable Release" section, which is kinda confusing.I bump in to the
>> error mentioned above while I execute the instructions in "Running Hive"
>> section.
>>
>> Thanks,
>> Baahu
>>
>>
>>
>>
>> On Sat, Oct 5, 2013 at 1:17 PM, Lefty Leverenz <leftyleverenz@gmail.com>wrote:
>>
>>> Do you have any suggestions for improving the Hive wiki instructions?
>>>
>>> -- Lefty
>>>
>>>
>>> On Fri, Oct 4, 2013 at 7:30 PM, Baahu <bahubali@gmail.com> wrote:
>>>
>>>> Apache hive.
>>>> On Oct 5, 2013 1:06 AM, "Mikhail Antonov" <olorinbant@gmail.com> wrote:
>>>>
>>>>> Are you using apache hive or one from cloudera/Horton works?
>>>>>
>>>>> On Oct 4, 2013, at 11:52, Baahu <bahubali@gmail.com> wrote:
>>>>>
>>>>> Hi Mikhail,
>>>>> I followed the steps mentioned in the Apache hive website, found the
>>>>> instructions not so helpful... Is there any good link which provides
proper
>>>>> installation steps.
>>>>>
>>>>> Thanks
>>>>> On Oct 5, 2013 12:07 AM, "Mikhail Antonov" <olorinbant@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Looks like you have StorageDelegationAuthorizationProvider enabled
>>>>>> in hive-site.xml (like below), but hcatalog isn't installed somehow?
>>>>>>
>>>>>> <property>
>>>>>>   <name>hive.security.authorization.manager</name>
>>>>>>   <value>org.apache.hcatalog.security.StorageDelegationAuthorizationProvider</value>
>>>>>>   <description>the hive client authorization manager class
name.
>>>>>>   The user defined authorization class should implement interface
org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider.
>>>>>>   HCatalog uses a model, where authorization checks are delegated
to the storage layer (hdfs, hbase, ...).
>>>>>>   </description>
>>>>>> </property>
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2013/10/4 Baahu <bahubali@gmail.com>
>>>>>>
>>>>>>> Hi,
>>>>>>> Have installed Hive 0.11 in centos.I see the below error when
I
>>>>>>> execute hive.Can you please help me resolving this.
>>>>>>>
>>>>>>> [root@centosvm bin]# hive
>>>>>>> 13/10/04 09:05:35 WARN conf.HiveConf: DEPRECATED: Configuration
>>>>>>> property hive.metastore.local no longer has any effect. Make
sure to
>>>>>>> provide a valid value for hive.metastore.uris if you are connecting
to a
>>>>>>> remote metastore.
>>>>>>>
>>>>>>> Logging initialized using configuration in
>>>>>>> jar:file:/opt/hive-0.11.0-bin/lib/hive-common-0.11.0.jar!/hive-log4j.properties
>>>>>>> Hive history
>>>>>>> file=/tmp/root/hive_job_log_root_8553@centosvm_201310040905_1657489660.txt
>>>>>>> Exception in thread "main" java.lang.RuntimeException:
>>>>>>> org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>>> java.lang.ClassNotFoundException:
>>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:278)
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
>>>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>>> Method)
>>>>>>>         at
>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>>>>>         at
>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
>>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
>>>>>>> java.lang.ClassNotFoundException:
>>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:342)
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
>>>>>>>         ... 7 more
>>>>>>> Caused by: java.lang.ClassNotFoundException:
>>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider
>>>>>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>>>>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>>>>>>         at java.security.AccessController.doPrivileged(Native
Method)
>>>>>>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>>>>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>>>         at java.lang.Class.forName0(Native Method)
>>>>>>>         at java.lang.Class.forName(Class.java:270)
>>>>>>>         at
>>>>>>> org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:335)
>>>>>>>         ... 8 more
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Thanks,
>>>>>> Michael Antonov
>>>>>>
>>>>>
>>>
>>
>>
>> --
>> Twitter:http://twitter.com/Baahu
>>
>>
>


-- 
Thanks,
Michael Antonov

Mime
View raw message