hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9416) Get rid of Extract Operator
Date Sat, 24 Jan 2015 06:46:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290477#comment-14290477
] 

Hive QA commented on HIVE-9416:
-------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12694291/HIVE-9416.4.patch

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2503/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2503/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2503/

Messages:
{noformat}
**** This message was trimmed, see log for full details ****
Reverted 'ql/src/test/results/clientpositive/spark/auto_join31.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_reorder3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/outer_join_ppr.q.java1.7.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_20.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/tez_joins_explain.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join10.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/vectorization_13.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/mapjoin_mapjoin.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_transform.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt14.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_9.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_hive_626.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/router_join_ppr.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join7.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join28.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union5.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join18_multi_distinct.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/mergejoins_mixed.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_multi_single_reducer3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt8.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/having.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_vc.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join23.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union15.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join16.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join32.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_join.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_21.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_join2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union33.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join11.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/multi_insert_gby3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/vectorization_14.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join34.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby10.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join20.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/multi_insert_mixed.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_cube1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join8.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/reduce_deduplicate_exclude_join.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join29.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/tez_join_tests.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_rollup1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/limit_partition_metadataonly.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_18.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join0.q.java1.7.out'
Reverted 'ql/src/test/results/clientpositive/spark/mapreduce1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_5.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join15.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt9.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/louter_join_ppr.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/merge1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_reorder.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join0.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join17.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/orc_analyze.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_join3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/count.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoin.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union11.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/mapjoin_distinct.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join12.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/vectorization_15.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/input17.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join35.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_join_filter.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt16.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby11.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join21.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_25.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_merging.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_multi_insert.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join9.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoin_union_remove_1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/optimize_nullscan.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join30.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join_without_localtask.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join6.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_19.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt11.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union7.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/mapreduce2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/index_auto_self_join.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_nullsafe.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_merge_multi_expressions.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_6.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/vector_mapjoin_reduce.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt20.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/merge2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/identity_project_remove_skip.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual4.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/subquery_in.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join18.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/parallel.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt5.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/cross_join.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join20.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join13.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/vectorization_16.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/input18.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/multi_insert_gby.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt17.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join22.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_multi_single_reducer.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union30.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_multi_insert_common_distinct.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoin_union_remove_2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join31.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join7.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt12.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ctas.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_7.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/multigroupby_singlemr.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join40.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join18_multi_distinct.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/subquery_exists.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join5.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join26.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join19.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_15.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby8.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt6.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_24.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/transform_ppr1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/escape_sortby1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/subquery_multiinsert.q.java1.7.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_complex_types_multi_single_reducer.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_view.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join21.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join14.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_10.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby3.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join30.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_reorder2.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join23.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_thrift.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/mergejoins.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/groupby_complex_types.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/ppd_gby_join.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/input14.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_alt_syntax.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/join_cond_pushdown_1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/escape_clusterby1.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/skewjoinopt13.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/sort.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/union_remove_8.q.out'
Reverted 'ql/src/test/results/clientpositive/spark/auto_join18.q.out'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SetSparkReducerParallelism.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobStatus.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/RemoteSparkJobStatus.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobMonitor.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/SparkJobRef.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionManagerImpl.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSession.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionImpl.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/LocalHiveSparkClient.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveSparkClientFactory.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java'
++ egrep -v '^X|^Performing status on external'
++ awk '{print $2}'
++ svn status --no-ignore
+ rm -rf target datanucleus.log ant/target shims/target shims/0.20S/target shims/0.23/target
shims/aggregator/target shims/common/target shims/scheduler/target packaging/target hbase-handler/target
testutils/target jdbc/target metastore/target itests/target itests/thirdparty itests/hcatalog-unit/target
itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target
itests/src/test/resources/testconfiguration.properties.orig itests/hive-jmh/target itests/hive-unit/target
itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target
hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target
hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target accumulo-handler/target hwi/target
common/target common/src/gen spark-client/target spark-client/src/test/java/org/apache/hive/spark/client/TestJobHandle.java
service/target contrib/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml
ql/target ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/RemoteSparkJobMonitor.java
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/LocalSparkJobMonitor.java ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/LocalSparkJobRef.java
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/RemoteSparkJobRef.java
+ svn update

Fetching external item into 'hcatalog/src/test/e2e/harness'
External at revision 1654473.

At revision 1654473.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12694291 - PreCommit-HIVE-TRUNK-Build

> Get rid of Extract Operator
> ---------------------------
>
>                 Key: HIVE-9416
>                 URL: https://issues.apache.org/jira/browse/HIVE-9416
>             Project: Hive
>          Issue Type: Task
>          Components: Query Processor
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-9416.1.patch, HIVE-9416.2.patch, HIVE-9416.3.patch, HIVE-9416.4.patch,
HIVE-9416.patch
>
>
> {{Extract Operator}} has been there for legacy reasons. But there is no functionality
it provides which cant be provided by {{Select Operator}} Instead of having two operators,
one being subset of another we should just get rid of {{Extract}} and simplify our codebase.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message