Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Mon, 3 Jun 2013 00:56:20 +0000 (UTC)
From: "Navis (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12649744.1369761897894.54143.1370220980433@arcas>
In-Reply-To: <JIRA.12649744.1369761897894@arcas>
References: <JIRA.12649744.1369761897894@arcas>
Subject: [jira] [Commented] (HIVE-4620) MR temp directory conflicts in case
 of parallel execution mode
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-4620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672744#comment-13672744 ] 

Navis commented on HIVE-4620:
-----------------------------

It would be good to make a phabricator or review-board entry. 

in TaskRunner.run()
{noformat}
taskRunnerID.set(taskCounter.incrementAndGet());
{noformat}
Is it necessary? If it is, is that should be called in runSequential() rather than run()?
                
> MR temp directory conflicts in case of parallel execution mode
> --------------------------------------------------------------
>
>                 Key: HIVE-4620
>                 URL: https://issues.apache.org/jira/browse/HIVE-4620
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.11.0
>            Reporter: Prasad Mujumdar
>            Assignee: Prasad Mujumdar
>             Fix For: 0.12.0
>
>         Attachments: HIVE-4620-1.patch, HIVE-4620-2.patch
>
>
> In parallel query execution mode, all the parallel running task ends up sharing the same temp/scratch directory. This could lead to file conflicts and temp files getting deleted before the job completion.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira