hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20506) HOS times out when cluster is full while Hive-on-MR waits
Date Thu, 06 Sep 2018 22:14:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606453#comment-16606453
] 

Brock Noland commented on HIVE-20506:
-------------------------------------

Patch for CDH 5.14.2 attached which appears to be working. I should have a patch against master
soon.

> HOS times out when cluster is full while Hive-on-MR waits
> ---------------------------------------------------------
>
>                 Key: HIVE-20506
>                 URL: https://issues.apache.org/jira/browse/HIVE-20506
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Assignee: Brock Noland
>            Priority: Major
>         Attachments: HIVE-20506-CDH5.14.2.patch
>
>
> My understanding is as follows:
> Hive-on-MR when the cluster is full will wait for resources to be available before submitting
a job. This is because the hadoop jar command is the primary mechanism Hive uses to know if
a job is complete or failed.
>  
> Hive-on-Spark will timeout after {{SPARK_RPC_CLIENT_CONNECT_TIMEOUT}} because the RPC
client in the AppMaster doesn't connect back to the RPC Server in HS2. 
> This is a behavior difference it'd be great to close.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message