hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10143) HS2 fails to clean up Spark client state on timeout [Spark Branch]
Date Mon, 30 Mar 2015 20:34:53 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387350#comment-14387350
] 

Marcelo Vanzin commented on HIVE-10143:
---------------------------------------

I took a quick look at the test logs and they don't seem related to the code being changed
(as in, the spark driver is connecting fine to HS2).

> HS2 fails to clean up Spark client state on timeout [Spark Branch]
> ------------------------------------------------------------------
>
>                 Key: HIVE-10143
>                 URL: https://issues.apache.org/jira/browse/HIVE-10143
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Marcelo Vanzin
>            Assignee: Marcelo Vanzin
>         Attachments: HIVE-10143.1-spark.patch
>
>
> When a new client is registered with the Spark client and fails to connect back in time,
the code will time out the future and HS2 will give up on that client. But the RSC backend
does not clean up all the state, and the client is still allowed to connect back. That can
lead to the client staying alive indefinitely and holding on to cluster resources, since HS2
doesn't know it's alive but the connection still exists.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message