hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2181) Clean up the scratch.dir (tmp/hive-root) while restarting Hive server.
Date Mon, 22 Aug 2011 18:23:31 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088888#comment-13088888
] 

jiraposter@reviews.apache.org commented on HIVE-2181:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1481/
-----------------------------------------------------------

(Updated 2011-08-22 18:23:15.749654)


Review request for hive.


Changes
-------

Fixed review comments and updated the patch.


Summary
-------

Now queries leaves the map outputs under scratch.dir after execution. If the hive server is
stopped we need not keep the stopped server's map oputputs. So whle starting the server we
can clear the scratch.dir. This can help in improved disk usage.

Implemented a cleanup method in HiveServer and it will trigger based on the property value
"hive.start.cleanup.scrachdir"


This addresses bug HIVE-2181.
    https://issues.apache.org/jira/browse/HIVE-2181


Diffs (updated)
-----

  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 1158629 
  trunk/conf/hive-default.xml 1158629 
  trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java 1158629 
  trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1158629 

Diff: https://reviews.apache.org/r/1481/diff


Testing
-------

Added test case for this scenario.


Thanks,

chinna



>  Clean up the scratch.dir (tmp/hive-root) while restarting Hive server. 
> ------------------------------------------------------------------------
>
>                 Key: HIVE-2181
>                 URL: https://issues.apache.org/jira/browse/HIVE-2181
>             Project: Hive
>          Issue Type: Bug
>          Components: Server Infrastructure
>    Affects Versions: 0.8.0
>         Environment: Suse linux, Hadoop 20.1, Hive 0.8
>            Reporter: sanoj mathew
>            Assignee: Chinna Rao Lalam
>            Priority: Minor
>         Attachments: HIVE-2181.1.patch, HIVE-2181.2.patch, HIVE-2181.patch
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> Now queries leaves the map outputs under scratch.dir after execution. If the hive server
is stopped we need not keep the stopped server's map oputputs. So whle starting the server
we can clear the scratch.dir. This can help in improved disk usage.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message