hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bennie Schut (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1587) Files on /tmp/hive-{username}/hive_{some timestamp}/ which are leftovers from old jobs which never are never removed
Date Tue, 24 Aug 2010 09:48:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901802#action_12901802
] 

Bennie Schut commented on HIVE-1587:
------------------------------------

This might not be the problem but looking at why this happends I noticed the delete used to
happen on ExecDriver.execute but seems to have moved to ctx.clear() which is now only executed
when the Context was removed.
Is it correct the Driver remains alive for the duration of a connection (when using HiveServer)?
Since we use connection pooling to connect to the hive server it means some connections never
really close so that would explian what I'm seeing.


r957035

    } finally {
      Utilities.clearMapRedWork(job);
      try {
        emptyScratchDir.getFileSystem(job).delete(emptyScratchDir, true);
        if (returnVal != 0 && rj != null) {
          rj.killJob();
        }
        runningJobKillURIs.remove(rj.getJobID());
      } catch (Exception e) {
      }
    }


r982490

    } finally {
      Utilities.clearMapRedWork(job);
      try {
        if(ctxCreated)
          ctx.clear();

        if (returnVal != 0 && rj != null) {
          rj.killJob();
        }
        runningJobKillURIs.remove(rj.getJobID());
      } catch (Exception e) {
      }
    }


> Files on /tmp/hive-{username}/hive_{some timestamp}/ which are leftovers from old jobs
which never are never removed
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1587
>                 URL: https://issues.apache.org/jira/browse/HIVE-1587
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.7.0
>            Reporter: Bennie Schut
>
> I seem to have a lot of files on /tmp/hive-{username}/hive_{some timestamp}/ which are
leftovers from old jobs which never are never removed.
> These jobs ran without any problems.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message