hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7643) ExecMapper statis states lead to unpredictable query result.[Spark Branch]
Date Thu, 07 Aug 2014 09:00:19 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chengxiang Li updated HIVE-7643:
--------------------------------

    Description: ExecMapper contain static states, static variable "done" for example. Spark
executor may execute multi tasks concurrently, ExecMapper static state updated by one task
would influence the logic of another task, which may lead to unpredictable result. To reproduce,
execute "select count(*) from test tablesample(1 rows) s", test should be a table with several
blocks source data.  (was: ExecMapper contain static states, static variable "done" for example.
Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one
task would influence the logic of another task, which may lead to unpredictable result.)

> ExecMapper statis states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute "select
count(*) from test tablesample(1 rows) s", test should be a table with several blocks source
data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message