hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]
Date Fri, 29 May 2015 02:28:24 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xuefu Zhang updated HIVE-7643:
------------------------------
    Fix Version/s:     (was: spark-branch)
                   1.1.0

> ExecMapper static states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>             Fix For: 1.1.0
>
>         Attachments: HIVE-7643.1-spark.patch, HIVE-7643.2-spark.patch, HIVE-7643.2-spark.patch
>
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute 
> {code:sql}
> SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
> {code}, 
> TEST should be a table with several blocks source data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message