hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1109) Structured temporary directories
Date Fri, 29 Jan 2010 00:29:42 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806169#action_12806169
] 

Zheng Shao commented on HIVE-1109:
----------------------------------

There is no separate test for temp directories.
But every query we test uses the temp directories (which are changed by this patch), so I
think as long as all the current tests pass, it should be good.


> Structured temporary directories
> --------------------------------
>
>                 Key: HIVE-1109
>                 URL: https://issues.apache.org/jira/browse/HIVE-1109
>             Project: Hadoop Hive
>          Issue Type: Improvement
>    Affects Versions: 0.6.0
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>         Attachments: HIVE-1109.1.patch, HIVE-1109.2.patch
>
>
> Currently Hive execution uses a lot of temporary directories. These directories are NOT
named by date or time, so it's impossible to know what are the temporary directories (in case
the query failed to clean up) that can be deleted safely.
> We should have a better temporary directory structure, with the date and time in the
directory name.
> This will help a lot when we are able to resume a query that failed in the middle, because
we need to preserve the temporary directories for that query.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message