Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B20D61743B for ; Fri, 29 May 2015 02:28:24 +0000 (UTC) Received: (qmail 60133 invoked by uid 500); 29 May 2015 02:28:24 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 60112 invoked by uid 500); 29 May 2015 02:28:24 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 60102 invoked by uid 99); 29 May 2015 02:28:24 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 May 2015 02:28:24 +0000 Date: Fri, 29 May 2015 02:28:24 +0000 (UTC) From: "Xuefu Zhang (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7643: ------------------------------ Fix Version/s: (was: spark-branch) 1.1.0 > ExecMapper static states lead to unpredictable query result.[Spark Branch] > -------------------------------------------------------------------------- > > Key: HIVE-7643 > URL: https://issues.apache.org/jira/browse/HIVE-7643 > Project: Hive > Issue Type: Bug > Components: Spark > Reporter: Chengxiang Li > Assignee: Chengxiang Li > Fix For: 1.1.0 > > Attachments: HIVE-7643.1-spark.patch, HIVE-7643.2-spark.patch, HIVE-7643.2-spark.patch > > > ExecMapper contain static states, static variable "done" for example. Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one task would influence the logic of another task, which may lead to unpredictable result. To reproduce, execute > {code:sql} > SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s > {code}, > TEST should be a table with several blocks source data. -- This message was sent by Atlassian JIRA (v6.3.4#6332)