hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chinna...@huawei.com
Subject Re: Review Request: Clean up the scratch.dir (tmp/hive-root) while restarting Hive server.
Date Thu, 22 Sep 2011 18:26:19 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1481/
-----------------------------------------------------------

(Updated 2011-09-22 18:26:19.812602)


Review request for hive.


Changes
-------

In testcases server startup is removed and added unit tests for cleanUpScratchDir().


Summary
-------

Now queries leaves the map outputs under scratch.dir after execution. If the hive server is
stopped we need not keep the stopped server's map oputputs. So whle starting the server we
can clear the scratch.dir. This can help in improved disk usage.

Implemented a cleanup method in HiveServer and it will trigger based on the property value
"hive.start.cleanup.scrachdir"


This addresses bug HIVE-2181.
    https://issues.apache.org/jira/browse/HIVE-2181


Diffs (updated)
-----

  trunk/common/src/java/org/apache/hadoop/hive/common/ServerUtils.java PRE-CREATION 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 1174277 
  trunk/conf/hive-default.xml 1174277 
  trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java 1174277 
  trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1174277 

Diff: https://reviews.apache.org/r/1481/diff


Testing
-------

Added test case for this scenario.


Thanks,

chinna


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message