hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7643) ExecMapper statis states lead to unpredictable query result.[Spark Branch]
Date Thu, 07 Aug 2014 09:02:16 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chengxiang Li updated HIVE-7643:
--------------------------------

    Description: 
ExecMapper contain static states, static variable "done" for example. Spark executor may execute
multi tasks concurrently, ExecMapper static state updated by one task would influence the
logic of another task, which may lead to unpredictable result. To reproduce, execute 
{code:sql}
SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
{code}, 
TEST should be a table with several blocks source data.

  was:ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute "select
count(*) from test tablesample(1 rows) s", test should be a table with several blocks source
data.


> ExecMapper statis states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute 
> {code:sql}
> SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
> {code}, 
> TEST should be a table with several blocks source data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message