Mailing-List: contact issues-help@tez.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@tez.incubator.apache.org
Date: Mon, 12 Aug 2013 20:45:47 +0000 (UTC)
From: "Gunther Hagleitner (JIRA)" <jira@apache.org>
To: issues@tez.incubator.apache.org
Message-ID: <JIRA.12663278.1376340244816.48903.1376340347771@arcas>
In-Reply-To: <JIRA.12663278.1376340244816@arcas>
References: <JIRA.12663278.1376340244816@arcas>
Subject: [jira] [Created] (TEZ-357) TaskLocalResources should be task
 specific
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Gunther Hagleitner created TEZ-357:
--------------------------------------

             Summary: TaskLocalResources should be task specific
                 Key: TEZ-357
                 URL: https://issues.apache.org/jira/browse/TEZ-357
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Gunther Hagleitner


There's a few resource (most notably the plan) that hive will set for each vertex/task. But AFAIK Tez forces the user to avoid name conflicts on the resource names. If the app doesn't resources will be clobbered.

This causes hive to have to write processors that first detect which stage they are and then resolve the name to something that doesn't conflict.

I think tez should handle this. It should determine shared v specific resources (or give me an api to do so) and then handle this in task subfolders with symlinks (or similar).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira