hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <>
Subject [jira] [Commented] (HIVE-15385) Failure to inherit permissions when running HdfsUtils.setFullFileStatus(..., false) causes queries to fail
Date Fri, 09 Dec 2016 19:21:58 GMT


Hive QA commented on HIVE-15385:

Here are the results of testing the latest attachment:

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 10798 tests executed
*Failed tests:*
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample2] (batchId=5)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample4] (batchId=15)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample6] (batchId=61)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample7] (batchId=60)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample9] (batchId=38)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] (batchId=134)

Test results:
Console output:
Test logs:

Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed

This message is automatically generated.

ATTACHMENT ID: 12842388 - PreCommit-HIVE-Build

> Failure to inherit permissions when running HdfsUtils.setFullFileStatus(..., false) causes
queries to fail
> ----------------------------------------------------------------------------------------------------------
>                 Key: HIVE-15385
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>         Attachments: HIVE-15385.1.patch, HIVE-15385.2.patch
> According to,
failure to inherit permissions should not cause queries to fail.
> It looks like this was the case until HIVE-13716, which added some code to use {{fs.setOwner}},
{{fs.setAcl}}, and {{fs.setPermission}} to set permissions instead of shelling out and running
{{-chgrp -R ...}}.
> When shelling out, the return status of each command is ignored, so if there are any
failures when inheriting permissions, a warning is logged, but the query still succeeds.
> However, when invoked the {{FileSystem}} API, any failures will be propagated up to the
caller, and the query will fail.
> This is problematic because {{setFulFileStatus}} shells out when the {{recursive}} parameter
is set to {{true}}, and when it is false it invokes the {{FileSystem}} API. So the behavior
is inconsistent depending on the value of {{recursive}}.
> We should decide whether or not permission inheritance should fail queries or not, and
then ensure the code consistently follows that decision.

This message was sent by Atlassian JIRA

View raw message