hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <>
Subject [jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2
Date Wed, 26 Oct 2016 09:24:58 GMT


Hive QA commented on HIVE-15068:

Here are the results of testing the latest attachment:

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 10622 tests executed
*Failed tests:*
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_bulk] (batchId=89)
org.apache.hive.beeline.TestBeelineArgParsing.testAddLocalJarWithoutAddDriverClazz[0] (batchId=164)
org.apache.hive.beeline.TestBeelineArgParsing.testAddLocalJar[0] (batchId=164)
org.apache.hive.beeline.TestBeelineArgParsing.testAddLocalJar[1] (batchId=164)

Test results:
Console output:
Test logs:

Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed

This message is automatically generated.

ATTACHMENT ID: 12835280 - PreCommit-HIVE-Build

> Run ClearDanglingScratchDir periodically inside HS2
> ---------------------------------------------------
>                 Key: HIVE-15068
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: HIVE-15068.1.patch
> In HIVE-13429, we introduce a tool which clear dangling scratch directory. In this ticket,
we want to invoke the tool automatically on a Hive cluster. Options are:
> 1. cron job, which would involve manual cron job setup
> 2. As a metastore thread. However, it is possible we run metastore without hdfs in the
future (eg, managing s3 files). ClearDanglingScratchDir needs support which only exists in
hdfs, it won't work if the above scenario happens
> 3. As a HS2 thread. The downside is if no HS2 is running, the tool will not run automatically.
But we expect HS2 will be a required component down the road
> Here I choose approach 3 in the implementation.

This message was sent by Atlassian JIRA

View raw message