hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2181) Clean up the scratch.dir (tmp/hive-root) while restarting Hive server.
Date Fri, 12 Aug 2011 19:11:28 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084309#comment-13084309
] 

jiraposter@reviews.apache.org commented on HIVE-2181:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1481/
-----------------------------------------------------------

Review request for hive.


Summary
-------

Now queries leaves the map outputs under scratch.dir after execution. If the hive server is
stopped we need not keep the stopped server's map oputputs. So whle starting the server we
can clear the scratch.dir. This can help in improved disk usage.

Implemented a cleanup method in HiveServer and it will trigger based on the property value
"hive.start.cleanup.scrachdir"


This addresses bug HIVE-2181.
    https://issues.apache.org/jira/browse/HIVE-2181


Diffs
-----

  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 1156493 
  trunk/conf/hive-default.xml 1156493 
  trunk/data/conf/hive-site.xml 1156493 
  trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java 1156493 
  trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1156493 

Diff: https://reviews.apache.org/r/1481/diff


Testing
-------

Added test case for this scenario.


Thanks,

chinna



>  Clean up the scratch.dir (tmp/hive-root) while restarting Hive server. 
> ------------------------------------------------------------------------
>
>                 Key: HIVE-2181
>                 URL: https://issues.apache.org/jira/browse/HIVE-2181
>             Project: Hive
>          Issue Type: Bug
>          Components: Server Infrastructure
>    Affects Versions: 0.8.0
>         Environment: Suse linux, Hadoop 20.1, Hive 0.8
>            Reporter: sanoj mathew
>            Assignee: Chinna Rao Lalam
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2181.1.patch, HIVE-2181.patch
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> Now queries leaves the map outputs under scratch.dir after execution. If the hive server
is stopped we need not keep the stopped server's map oputputs. So whle starting the server
we can clear the scratch.dir. This can help in improved disk usage.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message