hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maria <linanmengxia...@126.com>
Subject Re:Re:Re:Re:Re: How to access linux kerberosed hive from windows eclipse workspace?
Date Mon, 04 Jul 2016 10:17:47 GMT
The qestion "kinit: Ticket expired while renewing credentials" has been solved. I can successfully
execute "kinit -R",
but the error “java.lang.RuntimeException: org.apache.thrift.transport.TTransportException:
Peer indicated failure: GSS initiate failed”
is still there..

At 2016-07-04 14:39:04, "Maria" <linanmengxiaoai@126.com> wrote:
>I saw a  mail named "HCatalog Security",His or her problem was similar to mine,and the
reply answer were:
>"This issue goes away after doing a kinit -R".
>
>So I did the same operation.while it is failed:
>kinit: Ticket expired while renewing credentials
>
>But in my /etc/krb5.conf, I have configed this item:
>renew_lifetime=7d
>
>So, Can anybody give me some suggestions, please? Thankyou.
>
>At 2016-07-04 11:32:30, "Maria" <linanmengxiaoai@126.com> wrote:
>>
>>
>>And  I can suucessfully access hiveserver2 from beeline.
>>
>>
>>I was so confused by this error"Peer indicated failure: GSS initiate failed".
>>
>> Can you anybody please help me? Any reply will be much appreciated.
>>
>>At 2016-07-04 11:26:53, "Maria" <linanmengxiaoai@126.com> wrote:
>>>Yup,my  hiveserver2 log errors are:
>>>
>>>ERROR [Hiveserver2-Handler-Pool: Thread-48]:server.TThreadPoolServer(TThreadPoolServer.java:run(296))
- error occurred during processing of message.
>>>java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Peer
indicated failure: GSS initiate failed
>>>    at org.apache.thrift.transport.TSaslServerTransport$FactorygetTransport(TSaslServerTransport.java:219)
>>>    at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:739)
>>>    at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:736)
>>>    at java.security.AccessController.doPrivileged(Native Method)
>>>    at javax.security.auth.Subject.doAs(Subject.java:356)
>>>    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
>>>    at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:736)
>>>    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268)
>>>    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>    at java.lang.Thread.run(Thread.java:745)
>>>Caused by: org.apache.thrift.transport.TTransportException:Peer indicated failure:
GSS initiate failed
>>>    at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:199)
>>>    at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
>>>    at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
>>>    at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
>>>    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
>>> ... 10 more
>>>================================================
>>>As if the windows  hive JDBC client can communicate with the hiveserver2,isn't
it?
>>>
>>>while I checked everything I can :
>>>(1)in hiveserver2 node, I execute command "klist",the results are:
>>>Ticket cache: FILE:/tmp/krb5cc_0
>>>Default principal: hive/hm@HADOOP.COM
>>>
>>>Valid starting    Expires                     Service principal
>>>07/04/16 10:28:14    07/05/16 10:28:14     krbtgt/HADOOP.COM@HADOOP.COM
>>>                 renew until 07/04/16 10:28:14
>>>(2)in windows dos cmd,I execute command "klist",the results are:
>>>Ticket cache:API: 1
>>>Default principal: hive/hm@HADOOP.COM
>>>
>>>Valid starting    Expires                     Service principal
>>>07/04/16 10:24:32    07/05/16 10:24:32     krbtgt/HADOOP.COM@HADOOP.COM
>>>                 renew until 07/04/16 10:24:32
>>>
>>> Is there any thing else I have to add or set for hiveserver2?
>>>
>>>Thanks in advance.
>>>
>>>
>>>Maria.
>>>
>>>At 2016-07-03 04:39:31, "Vivek Shrivastava" <vivshrivastava@gmail.com> wrote:
>>> 
>>>
>>>Please look at the hiveserver2 log, it will have better error information. You
can paste error from the logs if you need help. 
>>>
>>>
>>>Regards,
>>>
>>>
>>>Vivek
>>>
>>>
>>>On Sat, Jul 2, 2016 at 5:52 AM, Maria <linanmengxiaoai@126.com> wrote:
>>>
>>>
>>>
>>>Hi,all:
>>>
>>>     recently,I  attempted to access Kerberized hadoop cluster by launching
JAVA applications from Windows workstations. And I hava configured kerberos in my windows7,
and can successfully access hdfs50070. But when I launch JDBC from windows to connection remote
hiveserver,errors accured:
>>>
>>>java.sql.SQLException:could not open client transport with JDBC Uri:jdbc:hive2://hm:10000/default;principal=hive/hm@HADOOM.COM:
GSS initiate failed
>>>
>>>     at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:231)
>>>
>>>     at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
>>>
>>>     at org.apache.hive.jdbc.HiveDriver.connection(HiveDriver.java:105)
>>>
>>>     at java.sql.DriverManager.getConnection(Unknown Source)
>>>
>>>     at java.sql.DriverManager.getConnection(Unknown Source)
>>>
>>>     at org.apache.hadoop.hive.ql.security.authorization.plugin.KerberosTest.main(KerberosTest.java:41)
>>>
>>>Caused by: org.apache.thrift.transport.TTransportException:GSS initiate failed
>>>
>>>     at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
>>>
>>>     at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
>>>
>>>     at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
>>>
>>>     at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
>>>
>>>     at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
>>>
>>>     at java.security.AccessController.doPrivileged(Native Method)
>>>
>>>     at javax.security.auth.Subject.doAs(Unknow source)
>>>
>>>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>>>
>>>     at  org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
>>>
>>>     at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204)
>>>
>>>... 5 more
>>>
>>>------------------------------------------------------------------------------
>>>
>>>below are my test codes:
>>>
>>>
>>>
>>>public static void main(String[] args) {
>>>
>>>    String principal = "hive/hm@HADOOM.COM";
>>>
>>>    String keytab = "E:\\Program Files (x86)\\java\\jre7\\lib\\security\\hive.keytab";
>>>
>>>    String url = "jdbc:hive2://hm:10000/default;principal=hive/hm@HADOOM.COM";
>>>
>>>
>>>
>>>    conf.addResource(new File("hdfs-site.xml").toURI().toURL());
>>>
>>>    conf.addResource(new File("core-site.xml").toURI().toURL());
>>>
>>>    conf.addResource(new File("yarn-site.xml").toURI().toURL());
>>>
>>>    conf.addResource(new File("hive-site.xml").toURI().toURL());
>>>
>>>
>>>
>>>    conf.set("hadoop.security.authentication", "Kerberos");
>>>
>>>    UserGroupInformation.setConfiguration(conf);
>>>
>>>    UserGroupInformation.loginUserFromKeytab(principal, keytab);
>>>
>>>
>>>
>>>    Class.forName("org.apache.hive.,jdbc.HiveDriver");
>>>
>>>    Connection conn =DriverManager.getConnection(url);
>>>
>>>
>>>
>>>    Statement stmt = conn.createStatement();
>>>
>>>    String sql = "select * from testkerberos";
>>>
>>>    ResultSet rs = stmt.executeQuery(sql);
>>>
>>>    while (rs.next()) {
>>>
>>>       system.out.println(rs.getString(1));
>>>
>>>    }
>>>
>>>}
>>>
>>>
>>>
>>>Does anyone had the same problem? Or know how to solve it ?
>>>
>>>
>>>
>>>Thanks in advance.
>>>
>>>
>>>
>>>Maria.
>>>
>>>
>>>
Mime
View raw message