hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Drome (JIRA)" <>
Subject [jira] [Commented] (HIVE-14323) Reduce number of FS permissions and redundant FS operations
Date Mon, 25 Jul 2016 13:02:20 GMT


Chris Drome commented on HIVE-14323:

[~rajesh.balamohan], I just finished working on a patch for
which deals with this more thoroughly, as there are a bunch of fundamental problems at the
core of this which lead to these and other issues, all of which I address.

I might be mistaken, but it appears that your patch also deals with the Hive query side as
Would you mind if I took over the changes to as part of
my patch?

Otherwise, could you provide more details about what your patch fixes exactly?

> Reduce number of FS permissions and redundant FS operations
> -----------------------------------------------------------
>                 Key: HIVE-14323
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-14323.1.patch
> Some examples are given below.
> 1. When creating stage directory, FileUtils sets the directory permissions by running
a set of chgrp and chmod commands. In systems like S3, this would not be relevant.
> 2. In some cases, fs.delete() is followed by fs.exists(). In this case, it might be redundant
to check for exists() (lookup ops are expensive in systems like S3). 

This message was sent by Atlassian JIRA

View raw message