hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11515) Still some possible race condition in DynamicPartitionPruner
Date Fri, 21 Aug 2015 12:37:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706694#comment-14706694
] 

Navis commented on HIVE-11515:
------------------------------

[~sseth] Sorry for delay. 
I've seen this a month ago in PoC scenario sometimes and desperately made this patch in a
hurry. After applying it, those things gone and I just forget it (there was so many issues).
So I cannot remember what was the exact problem, but it seemed "query hang" situation I guess.
Sorry for my vague description.

> Still some possible race condition in DynamicPartitionPruner
> ------------------------------------------------------------
>
>                 Key: HIVE-11515
>                 URL: https://issues.apache.org/jira/browse/HIVE-11515
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor, Tez
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-11515.1.patch.txt
>
>
> Even after HIVE-9976, I could see race condition in DPP sometimes. Hard to reproduce
but it seemed related to the fact that prune() is called by thread-pool. With some delay in
queue, events from fast tasks are arrived before prune() is called.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message