Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Fri, 16 Sep 2011 17:32:08 +0000 (UTC)
From: "jiraposter@reviews.apache.org (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: 
 <1253738904.35517.1316194328175.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1837824899.38756.1306230467354.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HIVE-2181)  Clean up the scratch.dir
 (tmp/hive-root) while restarting Hive server.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106615#comment-13106615 ] 

jiraposter@reviews.apache.org commented on HIVE-2181:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1481/
-----------------------------------------------------------

(Updated 2011-09-16 17:30:40.980271)


Review request for hive.


Changes
-------

Rebased the patch on latest trunk


Summary
-------

Now queries leaves the map outputs under scratch.dir after execution. If the hive server is stopped we need not keep the stopped server's map oputputs. So whle starting the server we can clear the scratch.dir. This can help in improved disk usage.

Implemented a cleanup method in HiveServer and it will trigger based on the property value "hive.start.cleanup.scrachdir"


This addresses bug HIVE-2181.
    https://issues.apache.org/jira/browse/HIVE-2181


Diffs (updated)
-----

  trunk/conf/hive-default.xml 1171488 
  trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java 1171488 
  trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1171488 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 1171488 

Diff: https://reviews.apache.org/r/1481/diff


Testing
-------

Added test case for this scenario.


Thanks,

chinna


>  Clean up the scratch.dir (tmp/hive-root) while restarting Hive server. 
> ------------------------------------------------------------------------
>
>                 Key: HIVE-2181
>                 URL: https://issues.apache.org/jira/browse/HIVE-2181
>             Project: Hive
>          Issue Type: Bug
>          Components: Server Infrastructure
>    Affects Versions: 0.8.0
>         Environment: Suse linux, Hadoop 20.1, Hive 0.8
>            Reporter: sanoj mathew
>            Assignee: Chinna Rao Lalam
>            Priority: Minor
>         Attachments: HIVE-2181.1.patch, HIVE-2181.2.patch, HIVE-2181.3.patch, HIVE-2181.patch
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> Now queries leaves the map outputs under scratch.dir after execution. If the hive server is stopped we need not keep the stopped server's map oputputs. So whle starting the server we can clear the scratch.dir. This can help in improved disk usage.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira