tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-357) TaskLocalResources should be task specific
Date Mon, 12 Aug 2013 20:45:47 GMT
Gunther Hagleitner created TEZ-357:

             Summary: TaskLocalResources should be task specific
                 Key: TEZ-357
                 URL: https://issues.apache.org/jira/browse/TEZ-357
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Gunther Hagleitner

There's a few resource (most notably the plan) that hive will set for each vertex/task. But
AFAIK Tez forces the user to avoid name conflicts on the resource names. If the app doesn't
resources will be clobbered.

This causes hive to have to write processors that first detect which stage they are and then
resolve the name to something that doesn't conflict.

I think tez should handle this. It should determine shared v specific resources (or give me
an api to do so) and then handle this in task subfolders with symlinks (or similar).

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message