cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CLOUDSTACK-9348) CloudStack Server degrades when a lot of connections on port 8250
Date Thu, 28 Apr 2016 04:56:13 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261540#comment-15261540
] 

ASF GitHub Bot commented on CLOUDSTACK-9348:
--------------------------------------------

Github user swill commented on the pull request:

    https://github.com/apache/cloudstack/pull/1493#issuecomment-215309861
  
    Failed to build.
    ```
    -------------------------------------------------------
     T E S T S
    -------------------------------------------------------
    Running com.cloud.utils.testcase.NioTest
    2016-04-28 06:23:24,581 INFO  [utils.testcase.NioTest] (main:) Setting up Benchmark Test
    2016-04-28 06:23:24,879 INFO  [utils.nio.NioServer] (main:) NioConnection started and
listening on /0:0:0:0:0:0:0:0:58798
    2016-04-28 06:23:24,886 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-1:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,886 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-2:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,887 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-4:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,890 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-5:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,891 INFO  [utils.nio.NioClient] (NioClientHandler-1:) Connecting to
127.0.0.1:58798
    2016-04-28 06:23:24,892 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-6:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,892 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-3:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,893 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-7:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,894 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-8:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,895 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-10:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,924 DEBUG [utils.crypt.EncryptionSecretKeyChecker] (pool-1-thread-1:)
Encryption Type: null
    2016-04-28 06:23:24,928 INFO  [utils.nio.NioClient] (NioClientHandler-2:) Connecting to
127.0.0.1:58798
    2016-04-28 06:23:24,933 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-11:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,933 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:24,939 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-13:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,941 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-14:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,944 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-12:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,944 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-15:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,944 INFO  [utils.nio.NioClient] (NioClientHandler-3:) Connecting to
127.0.0.1:58798
    2016-04-28 06:23:24,945 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-16:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,946 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-9:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,946 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-17:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,946 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-18:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,947 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-19:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,947 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-20:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,948 INFO  [utils.nio.NioClient] (NioClientHandler-4:) Connecting to
127.0.0.1:58798
    2016-04-28 06:23:24,949 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-21:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,949 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-22:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,949 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-23:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,977 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-25:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,977 INFO  [utils.testcase.NioTest] (MaliciousNioClientHandler-24:)
Connecting to 127.0.0.1:58798
    2016-04-28 06:23:24,981 INFO  [utils.nio.NioClient] (NioClientHandler-5:) Connecting to
127.0.0.1:58798
    2016-04-28 06:23:24,996 DEBUG [utils.testcase.NioTest] (Thread-0:) 0/5 tests done. Waiting
for completion
    2016-04-28 06:23:25,103 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,161 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,211 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,282 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,353 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,418 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,477 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,527 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,601 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,805 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:25,887 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,002 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,006 DEBUG [utils.testcase.NioTest] (Thread-0:) 0/5 tests done. Waiting
for completion
    2016-04-28 06:23:26,073 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,362 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,444 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,552 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,667 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:26,693 INFO  [utils.nio.NioClient] (NioClientHandler-1:) SSL: Handshake
done
    2016-04-28 06:23:26,693 INFO  [utils.nio.NioClient] (NioClientHandler-1:) Connected to
127.0.0.1:58798
    2016-04-28 06:23:26,847 INFO  [utils.nio.NioClient] (NioClientHandler-2:) SSL: Handshake
done
    2016-04-28 06:23:26,847 INFO  [utils.nio.NioClient] (NioClientHandler-2:) Connected to
127.0.0.1:58798
    2016-04-28 06:23:27,009 DEBUG [utils.testcase.NioTest] (Thread-0:) 0/5 tests done. Waiting
for completion
    2016-04-28 06:23:27,021 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:27,112 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received CONNECT task
    2016-04-28 06:23:27,231 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received CONNECT task
    2016-04-28 06:23:27,243 INFO  [utils.testcase.NioTest] (NioTestClient-0-Handler-1:) Client:
Received CONNECT task
    2016-04-28 06:23:27,264 INFO  [utils.testcase.NioTest] (NioTestClient-0-Handler-1:) Sending
data to server
    2016-04-28 06:23:27,342 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received CONNECT task
    2016-04-28 06:23:27,349 INFO  [utils.testcase.NioTest] (NioTestClient-1-Handler-1:) Client:
Received CONNECT task
    2016-04-28 06:23:27,367 INFO  [utils.testcase.NioTest] (NioTestClient-1-Handler-1:) Sending
data to server
    2016-04-28 06:23:27,350 INFO  [utils.nio.NioClient] (NioClientHandler-3:) SSL: Handshake
done
    2016-04-28 06:23:27,378 INFO  [utils.nio.NioClient] (NioClientHandler-3:) Connected to
127.0.0.1:58798
    2016-04-28 06:23:27,400 INFO  [utils.testcase.NioTest] (NioTestClient-2-Handler-1:) Client:
Received CONNECT task
    2016-04-28 06:23:27,503 INFO  [utils.testcase.NioTest] (NioTestClient-2-Handler-1:) Sending
data to server
    2016-04-28 06:23:27,753 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,015 DEBUG [utils.testcase.NioTest] (Thread-0:) 0/5 tests done. Waiting
for completion
    2016-04-28 06:23:28,200 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,360 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,471 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,529 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,618 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,744 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,749 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,754 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,758 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,766 WARN  [utils.nio.Link] (pool-1-thread-1:) SSL: Fail to find the
generated keystore. Loading fail-safe one to continue.
    2016-04-28 06:23:28,867 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received DATA task
    2016-04-28 06:23:29,034 DEBUG [utils.testcase.NioTest] (Thread-0:) 1/5 tests done. Waiting
for completion
    2016-04-28 06:23:29,741 INFO  [utils.nio.NioClient] (NioClientHandler-4:) SSL: Handshake
done
    2016-04-28 06:23:29,741 INFO  [utils.nio.NioClient] (NioClientHandler-4:) Connected to
127.0.0.1:58798
    2016-04-28 06:23:29,742 INFO  [utils.nio.NioClient] (NioClientHandler-5:) SSL: Handshake
done
    2016-04-28 06:23:29,742 INFO  [utils.nio.NioClient] (NioClientHandler-5:) Connected to
127.0.0.1:58798
    2016-04-28 06:23:29,851 INFO  [utils.testcase.NioTest] (NioTestClient-3-Handler-1:) Client:
Received CONNECT task
    2016-04-28 06:23:30,185 INFO  [utils.testcase.NioTest] (NioTestClient-3-Handler-1:) Sending
data to server
    2016-04-28 06:23:30,093 INFO  [utils.testcase.NioTest] (NioTestClient-4-Handler-1:) Client:
Received CONNECT task
    2016-04-28 06:23:30,207 INFO  [utils.testcase.NioTest] (NioTestClient-4-Handler-1:) Sending
data to server
    2016-04-28 06:23:30,038 DEBUG [utils.testcase.NioTest] (Thread-0:) 1/5 tests done. Waiting
for completion
    2016-04-28 06:23:30,868 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Verify
data received by server done.
    2016-04-28 06:23:30,868 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received DATA task
    2016-04-28 06:23:31,218 DEBUG [utils.testcase.NioTest] (Thread-0:) 2/5 tests done. Waiting
for completion
    2016-04-28 06:23:32,221 DEBUG [utils.testcase.NioTest] (Thread-0:) 2/5 tests done. Waiting
for completion
    2016-04-28 06:23:32,342 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Verify
data received by server done.
    2016-04-28 06:23:32,342 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Server:
Received DATA task
    2016-04-28 06:23:33,238 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:33,691 INFO  [utils.testcase.NioTest] (NioTestServer-Handler-1:) Verify
data received by server done.
    2016-04-28 06:23:34,247 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:35,261 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:36,275 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:37,285 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:38,302 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:39,310 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:40,318 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:41,333 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:42,338 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:43,341 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:44,344 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:45,345 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:46,350 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:47,353 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:48,356 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:49,364 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:50,370 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:51,375 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:52,387 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:53,400 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:54,508 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:55,523 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:56,529 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:57,550 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:58,568 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:23:59,590 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:00,598 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:01,619 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:02,626 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:03,644 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:04,652 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:05,660 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:06,665 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:07,692 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:08,705 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:09,709 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:10,729 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:11,733 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:12,751 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:13,756 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:14,767 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:15,784 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:16,795 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:17,798 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:18,810 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:19,820 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:20,837 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:21,844 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:22,852 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:23,858 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:24,880 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:25,126 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-1:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33898. Please investigate
this connection.
    2016-04-28 06:24:25,170 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-2:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33899. Please investigate
this connection.
    2016-04-28 06:24:25,290 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-3:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33900. Please investigate
this connection.
    2016-04-28 06:24:25,324 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-4:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33901. Please investigate
this connection.
    2016-04-28 06:24:25,556 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-8:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33905. Please investigate
this connection.
    2016-04-28 06:24:25,556 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-6:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33903. Please investigate
this connection.
    2016-04-28 06:24:25,616 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-7:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33904. Please investigate
this connection.
    2016-04-28 06:24:25,700 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-9:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33906. Please investigate
this connection.
    2016-04-28 06:24:25,824 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-10:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33907. Please investigate
this connection.
    2016-04-28 06:24:25,886 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:26,106 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-12:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33909. Please investigate
this connection.
    2016-04-28 06:24:26,202 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-13:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33910. Please investigate
this connection.
    2016-04-28 06:24:26,403 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-14:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33911. Please investigate
this connection.
    2016-04-28 06:24:26,502 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-15:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33912. Please investigate
this connection.
    2016-04-28 06:24:26,558 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-16:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33913. Please investigate
this connection.
    2016-04-28 06:24:26,891 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:27,228 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-18:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33915. Please investigate
this connection.
    2016-04-28 06:24:27,894 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:27,916 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-19:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33916. Please investigate
this connection.
    2016-04-28 06:24:28,129 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-17:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33917. Please investigate
this connection.
    2016-04-28 06:24:28,358 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-11:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33918. Please investigate
this connection.
    2016-04-28 06:24:28,573 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-20:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33920. Please investigate
this connection.
    2016-04-28 06:24:28,702 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-5:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33919. Please investigate
this connection.
    2016-04-28 06:24:28,897 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:28,919 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-23:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33923. Please investigate
this connection.
    2016-04-28 06:24:28,919 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-24:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33924. Please investigate
this connection.
    2016-04-28 06:24:28,919 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-26:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33926. Please investigate
this connection.
    2016-04-28 06:24:28,919 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-25:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33925. Please investigate
this connection.
    2016-04-28 06:24:28,938 WARN  [utils.nio.Link] (NioTestServer-SSLHandshakeHandler-22:)
SSL Handshake has taken more than 60s to connect to: /127.0.0.1:33922. Please investigate
this connection.
    2016-04-28 06:24:29,897 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:30,898 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:31,898 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:32,898 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:33,899 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:34,899 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:35,900 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:36,900 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:37,900 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:38,901 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:39,901 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:40,902 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:41,902 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:42,902 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:43,903 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:44,903 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:45,904 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:46,904 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:47,904 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:48,905 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:49,905 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:50,906 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:51,906 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:52,906 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:53,907 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:54,907 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:55,908 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:56,908 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:57,908 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:58,909 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:24:59,909 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:00,910 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:01,910 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:02,910 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:03,911 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:04,911 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:05,912 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:06,912 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:07,912 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:08,913 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:09,913 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:10,914 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:11,914 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:12,914 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:13,915 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:14,915 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:15,915 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:16,916 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:17,916 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:18,917 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:19,917 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:20,917 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:21,918 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:22,918 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:23,918 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:24,919 DEBUG [utils.testcase.NioTest] (Thread-0:) 3/5 tests done. Waiting
for completion
    2016-04-28 06:25:24,998 INFO  [utils.testcase.NioTest] (main:) Clients stopped.
    2016-04-28 06:25:24,998 INFO  [utils.testcase.NioTest] (main:) Server stopped.
    Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 120.737 sec <<<
FAILURE! - in com.cloud.utils.testcase.NioTest
    testConnection(com.cloud.utils.testcase.NioTest)  Time elapsed: 120.412 sec  <<<
ERROR!
    java.lang.Exception: test timed out after 120000 milliseconds
            at java.lang.Thread.sleep(Native Method)
            at com.cloud.utils.testcase.NioTest.testConnection(NioTest.java:148)
    ```


> CloudStack Server degrades when a lot of connections on port 8250
> -----------------------------------------------------------------
>
>                 Key: CLOUDSTACK-9348
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-9348
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>            Reporter: Rohit Yadav
>            Assignee: Rohit Yadav
>             Fix For: 4.9.0
>
>
> An intermittent issue was found with a large CloudStack deployment, where servers could
not keep agents connected on port 8250.
> All connections are handled by accept() in NioConnection:
> https://github.com/apache/cloudstack/blob/master/utils/src/main/java/com/cloud/utils/nio/NioConnection.java#L125
> A new connection is handled by accept() which does blocking SSL handshake. A good fix
would be to make this non-blocking and handle expensive tasks in separate threads/pool. This
way the main IO loop won't be blocked and can continue to serve other agents/clients.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message