ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Re: Review Request 28646: ambari cluster HS2 health check causing errors in logs
Date Wed, 03 Dec 2014 20:36:13 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/
-----------------------------------------------------------

(Updated Dec. 3, 2014, 8:36 p.m.)


Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Bugs: AMBARI-8523
    https://issues.apache.org/jira/browse/AMBARI-8523


Repository: ambari


Description
-------

The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .

    
    
    2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215))
- Error occurred during processing of message.
    java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
            at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
            at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
            at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
            at java.security.AccessController.doPrivileged(Native Method)
            at javax.security.auth.Subject.doAs(Subject.java:356)
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
            at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
            at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
            at java.lang.Thread.run(Thread.java:745)
    Caused by: org.apache.thrift.transport.TTransportException
            at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
            at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
            at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
            at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
            at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
            at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
            at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
            ... 10 more
    
    

Please assume the following:

> alert_hive_thrift_port.py which is used by the new alerts framework on trunk
uses this method.

>

> is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,  
thrift_port, security_enabled=security_enabled)

>

> If this code change is for trunk, you'll need to update the new alert
scripts as well. If it's not for trunk, then you can close the issue.


Diffs (updated)
-----

  ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2

  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py
bd3f276 
  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py
9437843 
  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py
f27c28c 
  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py
b75578b 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py
bd3f276 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py
ae64c35 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py
6e44a0f 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py
b75578b 
  ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd 
  ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1 
  ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48 
  ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718 

Diff: https://reviews.apache.org/r/28646/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message