hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]
Date Wed, 13 Aug 2014 02:45:11 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chengxiang Li updated HIVE-7643:
--------------------------------

    Attachment: HIVE-7643.1-spark.patch

As step 1 of HIVE-7675, Clone the implementation of ExecMapper and remove static state.

> ExecMapper static states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>         Attachments: HIVE-7643.1-spark.patch
>
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute 
> {code:sql}
> SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
> {code}, 
> TEST should be a table with several blocks source data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message