hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denys Kuzmenko (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-21581) Remove Lock in GetInputSummary
Date Mon, 11 Nov 2019 10:49:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971441#comment-16971441
] 

Denys Kuzmenko edited comment on HIVE-21581 at 11/11/19 10:48 AM:
------------------------------------------------------------------

Hi [~belugabehr], were you able to check whether by removing InputSummary lock entirely, 
we won't get significantly higher number on NM calls, that might overwhelm it?
https://docs.google.com/document/d/1bCu_l266XYgkNQKaXOSqo7DYUXbHs-EVe_RaUygUKt4/edit#heading=h.n3ai3wm9laz2


was (Author: dkuzmenko):
Hi [~belugabehr], were you able to check whether by removing InputSummary lock entirely, 
we won't get significantly higher number on NM calls, that might overwhelm it?

> Remove Lock in GetInputSummary
> ------------------------------
>
>                 Key: HIVE-21581
>                 URL: https://issues.apache.org/jira/browse/HIVE-21581
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>    Affects Versions: 4.0.0, 3.2.0
>            Reporter: David Mollitor
>            Assignee: David Mollitor
>            Priority: Major
>             Fix For: 4.0.0
>
>         Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch, HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the {{getInputSummary}}
lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message