Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F23BE1108A for ; Wed, 13 Aug 2014 03:19:12 +0000 (UTC) Received: (qmail 57433 invoked by uid 500); 13 Aug 2014 03:19:12 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 57342 invoked by uid 500); 13 Aug 2014 03:19:12 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 57330 invoked by uid 500); 13 Aug 2014 03:19:12 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 57327 invoked by uid 99); 13 Aug 2014 03:19:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Aug 2014 03:19:12 +0000 Date: Wed, 13 Aug 2014 03:19:12 +0000 (UTC) From: "Brock Noland (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095094#comment-14095094 ] Brock Noland commented on HIVE-7643: ------------------------------------ My mistake. I will fix the build. > ExecMapper static states lead to unpredictable query result.[Spark Branch] > -------------------------------------------------------------------------- > > Key: HIVE-7643 > URL: https://issues.apache.org/jira/browse/HIVE-7643 > Project: Hive > Issue Type: Bug > Components: Spark > Reporter: Chengxiang Li > Assignee: Chengxiang Li > Attachments: HIVE-7643.1-spark.patch > > > ExecMapper contain static states, static variable "done" for example. Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one task would influence the logic of another task, which may lead to unpredictable result. To reproduce, execute > {code:sql} > SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s > {code}, > TEST should be a table with several blocks source data. -- This message was sent by Atlassian JIRA (v6.2#6252)