hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6499) Using Metastore-side Auth errors on non-resolvable IF/OF/SerDe
Date Thu, 13 Mar 2014 22:19:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934209#comment-13934209
] 

Hive QA commented on HIVE-6499:
-------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12634158/HIVE-6499.patch

Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1767/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1767/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and
output '+ [[ -n '' ]]
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1767/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'contrib/src/test/results/clientnegative/udtf_explode2.q.out'
Reverted 'contrib/src/test/results/clientnegative/case_with_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientnegative/invalid_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_min_n.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_max_n.q.out'
Reverted 'contrib/src/test/results/clientpositive/lateral_view_explode2.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_avg.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_arraymapstruct.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_group_concat.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_min.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_row_sequence.q.out'
Reverted 'contrib/src/test/results/clientpositive/udaf_example_max.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_add.q.out'
Reverted 'contrib/src/test/results/clientpositive/udf_example_format.q.out'
Reverted 'contrib/src/test/results/clientpositive/udtf_output_on_close.q.out'
Reverted 'contrib/src/test/results/clientpositive/udtf_explode2.q.out'
Reverted 'contrib/src/test/results/clientpositive/dboutput.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_local_resource.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_function_does_not_implement_udf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_unknown_udf_udaf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonudf_class.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonexistent_db.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_test_error_reduce.q.out'
Reverted 'ql/src/test/results/clientnegative/drop_native_udf.q.out'
Reverted 'ql/src/test/results/clientnegative/create_udaf_failure.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_nonexistent_resource.q.out'
Reverted 'ql/src/test/results/clientnegative/create_unknown_genericudf.q.out'
Reverted 'ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out'
Reverted 'ql/src/test/results/clientnegative/udf_test_error.q.out'
Reverted 'ql/src/test/results/clientnegative/create_function_nonexistent_class.q.out'
Reverted 'ql/src/test/results/clientpositive/create_func1.q.out'
Reverted 'ql/src/test/results/clientpositive/macro.q.out'
Reverted 'ql/src/test/results/clientpositive/create_view.q.out'
Reverted 'ql/src/test/results/clientpositive/udaf_sum_list.q.out'
Reverted 'ql/src/test/results/clientpositive/create_genericudaf.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_logic_java_boolean.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_compare_java_string.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_testlength.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_testlength2.q.out'
Reverted 'ql/src/test/results/clientpositive/drop_udf.q.out'
Reverted 'ql/src/test/results/clientpositive/autogen_colalias.q.out'
Reverted 'ql/src/test/results/clientpositive/create_udaf.q.out'
Reverted 'ql/src/test/results/clientpositive/create_genericudf.q.out'
Reverted 'ql/src/test/results/clientpositive/ptf_register_tblfn.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_context_aware.q.out'
Reverted 'ql/src/test/results/clientpositive/windowing_udaf2.q.out'
Reverted 'ql/src/test/results/clientpositive/compile_processor.q.out'
Reverted 'ql/src/test/results/clientpositive/udf_using.q.out'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/FunctionSemanticAnalyzer.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/MacroSemanticAnalyzer.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/Operation2Privilege.java'
++ awk '{print $2}'
++ egrep -v '^X|^Performing status on external'
++ svn status --no-ignore
+ rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target
shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target
hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target
itests/test-serde/target itests/qtest/target itests/hive-unit/target itests/custom-serde/target
itests/util/target hcatalog/target hcatalog/storage-handlers/hbase/target hcatalog/server-extensions/target
hcatalog/core/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target
hwi/target common/target common/src/gen service/target contrib/target serde/target beeline/target
odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientnegative/authorization_create_macro1.q.out
ql/src/test/results/clientnegative/authorization_create_func1.q.out ql/src/test/results/clientnegative/authorization_create_func2.q.out
ql/src/test/results/clientpositive/authorization_create_func1.q.out ql/src/test/results/clientpositive/authorization_create_macro1.q.out
ql/src/test/queries/clientnegative/authorization_create_macro1.q ql/src/test/queries/clientnegative/authorization_create_func1.q
ql/src/test/queries/clientnegative/authorization_create_func2.q ql/src/test/queries/clientpositive/authorization_create_macro1.q
ql/src/test/queries/clientpositive/authorization_create_func1.q
+ svn update

Fetching external item into 'hcatalog/src/test/e2e/harness'
External at revision 1577348.

At revision 1577348.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12634158

> Using Metastore-side Auth errors on non-resolvable IF/OF/SerDe
> --------------------------------------------------------------
>
>                 Key: HIVE-6499
>                 URL: https://issues.apache.org/jira/browse/HIVE-6499
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore, Security
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-6499.patch, HIVE-6499.patch
>
>
> In cases where a user needs to use a custom IF/OF/SerDe that is not accessible from the
metastore, calls like msc.createTable and msc.dropTable should still work without being able
to load the class. This is possible as long as one does not enable MetaStore-side authorization,
at which point this becomes impossible, erroring out with a ClassNotFoundException.
> The reason this happens is that since the AuthorizationProvider interface is defined
against a ql.metadata.Table, we wind up needing to instantiate a ql.metadata.Table object,
which, in its constructor tries to instantiate IF/OF/SerDe elements in an attempt to pre-load
those fields. And if we do not have access to those classes in the metastore, this is when
that fails. The constructor/initialize methods of Table and Partition do not really need to
pre-initialize these fields, since the fields are accessed only through the accessor, and
will be instantiated on first-use.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message