hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]
Date Wed, 13 Aug 2014 17:22:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095743#comment-14095743
] 

Brock Noland commented on HIVE-7643:
------------------------------------

+1

> ExecMapper static states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>         Attachments: HIVE-7643.1-spark.patch, HIVE-7643.2-spark.patch, HIVE-7643.2-spark.patch
>
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute 
> {code:sql}
> SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
> {code}, 
> TEST should be a table with several blocks source data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message