hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ying Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4754) Too many connection opened to TimelineServer while publishing entities
Date Thu, 28 Jul 2016 03:54:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396875#comment-15396875
] 

Ying Zhang commented on YARN-4754:
----------------------------------

Hi [~varun_saxena], [~rohithsharma], if I understand this correctly, is the following change
enough for this?

{code:title=TimelineWriter.java|borderStyle=solid}

// Moving this call "resp.getEntity(String.class)" out of the if block of " if (LOG.isDebugEnabled())"


private ClientResponse doPosting(final Object obj, final String path)
    throws IOException, YarnException {
 ... ...
  if (resp == null ||
      resp.getStatusInfo().getStatusCode()
          != ClientResponse.Status.OK.getStatusCode()) {
     ... ...
    if (resp != null) {
      msg += " HTTP error code: " + resp.getStatus();
      String output = resp.getEntity(String.class);
      if (LOG.isDebugEnabled()) {
        LOG.debug("HTTP error code: " + resp.getStatus()
            + " Server response : \n" + output);
      }
... ...
}
{code}

> Too many connection opened to TimelineServer while publishing entities
> ----------------------------------------------------------------------
>
>                 Key: YARN-4754
>                 URL: https://issues.apache.org/jira/browse/YARN-4754
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Rohith Sharma K S
>            Priority: Critical
>         Attachments: ConnectionLeak.rar
>
>
> It is observed that there are too many connections are kept opened to TimelineServer
while publishing entities via SystemMetricsPublisher. This cause sometimes resource shortage
for other process or RM itself
> {noformat}
> tcp        0      0 10.18.99.110:3999       10.18.214.60:59265      ESTABLISHED 115302/java
        
> tcp        0      0 10.18.99.110:25001      :::*                    LISTEN      115302/java
        
> tcp        0      0 10.18.99.110:25002      :::*                    LISTEN      115302/java
        
> tcp        0      0 10.18.99.110:25003      :::*                    LISTEN      115302/java
        
> tcp        0      0 10.18.99.110:25004      :::*                    LISTEN      115302/java
        
> tcp        0      0 10.18.99.110:25005      :::*                    LISTEN      115302/java
        
> tcp        1      0 10.18.99.110:48866      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:48137      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:47553      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:48424      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:48139      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:48096      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:47558      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> tcp        1      0 10.18.99.110:49270      10.18.99.110:8188       CLOSE_WAIT  115302/java
        
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message