hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuxh" <yux...@qq.com>
Subject spring jdbc access Hive connection time out
Date Tue, 28 Mar 2017 07:05:02 GMT
Here is my environment : hive2.2+hadoop2.7.3  on server node25, 
my client use hive-jdbc-2.1.1+spring-jdbc-4.2.8.RELEASE 
my jdbc info:
spring.datasource.url=jdbc:hive2://192.168.156.25:10000/default
spring.datasource.username=hive
spring.datasource.password=hive
 In Junit ,I issue a single query test “select * from mytest limit 5”, most time it result
in exception:
Caused by: java.net.ConnectException: Connection timed out: connect
    at java.net.DualStackPlainSocketImpl.connect0(Native Method) ~[na:1.8.0_121]
    at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:79) ~[na:1.8.0_121]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[na:1.8.0_121]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
~[na:1.8.0_121]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_121]
    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172) ~[na:1.8.0_121]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_121]
    at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_121]
    at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.9.3.jar:0.9.3]
 it success very occassionally, but it has no problem using beeline .

I saw hiveserver2's debug info:
2017-03-28T15:00:24,380  INFO [HiveServer2-Handler-Pool: Thread-77] thrift.ThriftCLIService:
Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V9
2017-03-28T15:00:24,415  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Created HDFS directory: /tmp/hive/hive/21f6c7fb-765a-45d6-8539-954334dd785c
2017-03-28T15:00:24,422  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Created local directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/21f6c7fb-765a-45d6-8539-954334dd785c
2017-03-28T15:00:24,427  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Created HDFS directory: /tmp/hive/hive/21f6c7fb-765a-45d6-8539-954334dd785c/_tmp_space.db
2017-03-28T15:00:24,428  INFO [HiveServer2-Handler-Pool: Thread-77] session.HiveSessionImpl:
Operation log session directory is created: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/21f6c7fb-765a-45d6-8539-954334dd785c
2017-03-28T15:00:24,428  INFO [HiveServer2-Handler-Pool: Thread-77] service.CompositeService:
Session opened, SessionHandle [21f6c7fb-765a-45d6-8539-954334dd785c], current sessions:1
2017-03-28T15:00:25,668  INFO [HiveServer2-Handler-Pool: Thread-80] thrift.ThriftCLIService:
Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V9
2017-03-28T15:00:25,691  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Created HDFS directory: /tmp/hive/hive/ffefbd59-3d34-4ce7-8c42-a150f74920a7
2017-03-28T15:00:25,698  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Created local directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/ffefbd59-3d34-4ce7-8c42-a150f74920a7
2017-03-28T15:00:25,708  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Created HDFS directory: /tmp/hive/hive/ffefbd59-3d34-4ce7-8c42-a150f74920a7/_tmp_space.db
2017-03-28T15:00:25,709  INFO [HiveServer2-Handler-Pool: Thread-80] session.HiveSessionImpl:
Operation log session directory is created: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/ffefbd59-3d34-4ce7-8c42-a150f74920a7
2017-03-28T15:00:25,709  INFO [HiveServer2-Handler-Pool: Thread-80] service.CompositeService:
Session opened, SessionHandle [ffefbd59-3d34-4ce7-8c42-a150f74920a7], current sessions:2
2017-03-28T15:00:26,968  INFO [HiveServer2-Handler-Pool: Thread-83] thrift.ThriftCLIService:
Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V9
2017-03-28T15:00:26,990  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Created HDFS directory: /tmp/hive/hive/abdb3f41-ee98-41cd-9eac-9e6361e0a30d
2017-03-28T15:00:27,000  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Created local directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/abdb3f41-ee98-41cd-9eac-9e6361e0a30d
2017-03-28T15:00:27,008  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Created HDFS directory: /tmp/hive/hive/abdb3f41-ee98-41cd-9eac-9e6361e0a30d/_tmp_space.db
2017-03-28T15:00:27,009  INFO [HiveServer2-Handler-Pool: Thread-83] session.HiveSessionImpl:
Operation log session directory is created: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/abdb3f41-ee98-41cd-9eac-9e6361e0a30d
2017-03-28T15:00:27,009  INFO [HiveServer2-Handler-Pool: Thread-83] service.CompositeService:
Session opened, SessionHandle [abdb3f41-ee98-41cd-9eac-9e6361e0a30d], current sessions:3
2017-03-28T15:00:28,268  INFO [HiveServer2-Handler-Pool: Thread-86] thrift.ThriftCLIService:
Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V9
2017-03-28T15:00:28,289  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Created HDFS directory: /tmp/hive/hive/24dd0e62-d11d-4fdb-a308-6c9853074304
2017-03-28T15:00:28,297  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Created local directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/24dd0e62-d11d-4fdb-a308-6c9853074304
2017-03-28T15:00:28,307  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Created HDFS directory: /tmp/hive/hive/24dd0e62-d11d-4fdb-a308-6c9853074304/_tmp_space.db
2017-03-28T15:00:28,308  INFO [HiveServer2-Handler-Pool: Thread-86] session.HiveSessionImpl:
Operation log session directory is created: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/24dd0e62-d11d-4fdb-a308-6c9853074304
2017-03-28T15:00:28,308  INFO [HiveServer2-Handler-Pool: Thread-86] service.CompositeService:
Session opened, SessionHandle [24dd0e62-d11d-4fdb-a308-6c9853074304], current sessions:4
2017-03-28T15:00:49,623  INFO [HiveServer2-Handler-Pool: Thread-77] service.CompositeService:
Session closed, SessionHandle [21f6c7fb-765a-45d6-8539-954334dd785c], current sessions:3
2017-03-28T15:00:49,623  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Updating thread name to 21f6c7fb-765a-45d6-8539-954334dd785c HiveServer2-Handler-Pool: Thread-77
2017-03-28T15:00:49,624  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-77
2017-03-28T15:00:49,624  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Updating thread name to 21f6c7fb-765a-45d6-8539-954334dd785c HiveServer2-Handler-Pool: Thread-77
2017-03-28T15:00:49,624  INFO [HiveServer2-Handler-Pool: Thread-77] session.HiveSessionImpl:
Operation log session directory is deleted: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/21f6c7fb-765a-45d6-8539-954334dd785c
2017-03-28T15:00:49,625  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-77
2017-03-28T15:00:49,636  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Deleted directory: /tmp/hive/hive/21f6c7fb-765a-45d6-8539-954334dd785c on fs with scheme hdfs
2017-03-28T15:00:49,637  INFO [HiveServer2-Handler-Pool: Thread-77] session.SessionState:
Deleted directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/21f6c7fb-765a-45d6-8539-954334dd785c
on fs with scheme file
2017-03-28T15:00:50,183  INFO [HiveServer2-Handler-Pool: Thread-80] service.CompositeService:
Session closed, SessionHandle [ffefbd59-3d34-4ce7-8c42-a150f74920a7], current sessions:2
2017-03-28T15:00:50,184  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Updating thread name to ffefbd59-3d34-4ce7-8c42-a150f74920a7 HiveServer2-Handler-Pool: Thread-80
2017-03-28T15:00:50,184  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-80
2017-03-28T15:00:50,184  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Updating thread name to ffefbd59-3d34-4ce7-8c42-a150f74920a7 HiveServer2-Handler-Pool: Thread-80
2017-03-28T15:00:50,185  INFO [HiveServer2-Handler-Pool: Thread-80] session.HiveSessionImpl:
Operation log session directory is deleted: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/ffefbd59-3d34-4ce7-8c42-a150f74920a7
2017-03-28T15:00:50,185  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-80
2017-03-28T15:00:50,193  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Deleted directory: /tmp/hive/hive/ffefbd59-3d34-4ce7-8c42-a150f74920a7 on fs with scheme hdfs
2017-03-28T15:00:50,194  INFO [HiveServer2-Handler-Pool: Thread-80] session.SessionState:
Deleted directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/ffefbd59-3d34-4ce7-8c42-a150f74920a7
on fs with scheme file
2017-03-28T15:00:50,779  INFO [HiveServer2-Handler-Pool: Thread-83] service.CompositeService:
Session closed, SessionHandle [abdb3f41-ee98-41cd-9eac-9e6361e0a30d], current sessions:1
2017-03-28T15:00:50,780  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Updating thread name to abdb3f41-ee98-41cd-9eac-9e6361e0a30d HiveServer2-Handler-Pool: Thread-83
2017-03-28T15:00:50,780  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-83
2017-03-28T15:00:50,780  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Updating thread name to abdb3f41-ee98-41cd-9eac-9e6361e0a30d HiveServer2-Handler-Pool: Thread-83
2017-03-28T15:00:50,781  INFO [HiveServer2-Handler-Pool: Thread-83] session.HiveSessionImpl:
Operation log session directory is deleted: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/abdb3f41-ee98-41cd-9eac-9e6361e0a30d
2017-03-28T15:00:50,781  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-83
2017-03-28T15:00:50,792  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Deleted directory: /tmp/hive/hive/abdb3f41-ee98-41cd-9eac-9e6361e0a30d on fs with scheme hdfs
2017-03-28T15:00:50,793  INFO [HiveServer2-Handler-Pool: Thread-83] session.SessionState:
Deleted directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/abdb3f41-ee98-41cd-9eac-9e6361e0a30d
on fs with scheme file
2017-03-28T15:00:51,384  INFO [HiveServer2-Handler-Pool: Thread-86] service.CompositeService:
Session closed, SessionHandle [24dd0e62-d11d-4fdb-a308-6c9853074304], current sessions:0
2017-03-28T15:00:51,384  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Updating thread name to 24dd0e62-d11d-4fdb-a308-6c9853074304 HiveServer2-Handler-Pool: Thread-86
2017-03-28T15:00:51,385  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-86
2017-03-28T15:00:51,385  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Updating thread name to 24dd0e62-d11d-4fdb-a308-6c9853074304 HiveServer2-Handler-Pool: Thread-86
2017-03-28T15:00:51,385  INFO [HiveServer2-Handler-Pool: Thread-86] session.HiveSessionImpl:
Operation log session directory is deleted: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/apache-hive-2.2.0-SNAPSHOT-bin/bin/${system:java.io.tmpdir}/${system:user.name}/operation_logs/24dd0e62-d11d-4fdb-a308-6c9853074304
2017-03-28T15:00:51,386  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Resetting thread name to  HiveServer2-Handler-Pool: Thread-86
2017-03-28T15:00:51,397  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Deleted directory: /tmp/hive/hive/24dd0e62-d11d-4fdb-a308-6c9853074304 on fs with scheme hdfs
2017-03-28T15:00:51,397  INFO [HiveServer2-Handler-Pool: Thread-86] session.SessionState:
Deleted directory: /root/yuxh/app/apache-hive-2.2.0-SNAPSHOT-bin/scratchdir/24dd0e62-d11d-4fdb-a308-6c9853074304
on fs with scheme file
Mime
View raw message