hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13339) Vectorization: GenericUDFBetween in Projection mode
Date Fri, 25 Mar 2016 21:40:26 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212456#comment-15212456
] 

Hive QA commented on HIVE-13339:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12794959/HIVE-13339.2.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 11 failed/errored test(s), 9863 tests executed
*Failed tests:*
{noformat}
TestSparkCliDriver-groupby3_map.q-sample2.q-auto_join14.q-and-12-more - did not produce a
TEST-*.xml file
TestSparkCliDriver-groupby_map_ppr_multi_distinct.q-table_access_keys_stats.q-groupby4_noskew.q-and-12-more
- did not produce a TEST-*.xml file
TestSparkCliDriver-join_rc.q-insert1.q-vectorized_rcfile_columnar.q-and-12-more - did not
produce a TEST-*.xml file
TestSparkCliDriver-ppd_join4.q-join9.q-ppd_join3.q-and-12-more - did not produce a TEST-*.xml
file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vector_between_in
org.apache.hadoop.hive.ql.exec.vector.expressions.TestVectorTimestampExpressions.testVectorUDFMonthString
org.apache.hadoop.hive.ql.exec.vector.expressions.TestVectorTimestampExpressions.testVectorUDFMonthTimestamp
org.apache.hadoop.hive.ql.exec.vector.expressions.TestVectorTimestampExpressions.testVectorUDFYearString
org.apache.hadoop.hive.ql.exec.vector.expressions.TestVectorTimestampExpressions.testVectorUDFYearTimestamp
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7365/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7365/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-7365/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 11 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12794959 - PreCommit-HIVE-TRUNK-Build

> Vectorization: GenericUDFBetween in Projection mode 
> ----------------------------------------------------
>
>                 Key: HIVE-13339
>                 URL: https://issues.apache.org/jira/browse/HIVE-13339
>             Project: Hive
>          Issue Type: Bug
>          Components: Vectorization
>            Reporter: Gopal V
>            Assignee: Gopal V
>         Attachments: HIVE-13339.2.patch
>
>
> {code}
> 016-03-23T03:05:43,751 INFO  [8fc926f7-721f-4bef-b4d3-60da6a6884f9 main]: physical.Vectorizer
(Vectorizer.java:process(910)) - MapWork Operator: SEL could not be vectorized.
> 2016-03-23T03:05:43,751 INFO  [8fc926f7-721f-4bef-b4d3-60da6a6884f9 main]: physical.Vectorizer
(Vectorizer.java:validateSelectOperator(1392)) - Cannot vectorize select expression: GenericUDFBetween(Const
boolean false, Column[ss_sold_time_sk], Const int 1, Const int 2)
> {code}
> {code}
> hive> set hive.explain.user=false;
> hive> explain select ss_sold_time_sk between 1 and 2 from store_sales;
> OK
> STAGE DEPENDENCIES:
>   Stage-1 is a root stage
>   Stage-0 depends on stages: Stage-1
> STAGE PLANS:
>   Stage: Stage-1
>     Tez
>       DagId: gopal_20160323010940_4e7cdfe1-b1e2-4443-acff-fa83f8428bff:9
>       DagName: 
>       Vertices:
>         Map 1 
>             Map Operator Tree:
>                 TableScan
>                   alias: store_sales
>                   Statistics: Num rows: 575995635 Data size: 50918178412 Basic stats:
COMPLETE Column stats: NONE
>                   Select Operator
>                     expressions: ss_sold_time_sk BETWEEN 1 AND 2 (type: boolean)
>                     outputColumnNames: _col0
>                     Statistics: Num rows: 575995635 Data size: 50918178412 Basic stats:
COMPLETE Column stats: NONE
>                     File Output Operator
>                       compressed: false
>                       Statistics: Num rows: 575995635 Data size: 50918178412 Basic stats:
COMPLETE Column stats: NONE
>                       table:
>                           input format: org.apache.hadoop.mapred.SequenceFileInputFormat
>                           output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
>                           serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
>             Execution mode: llap
>             LLAP IO: no inputs
>   Stage: Stage-0
>     Fetch Operator
>       limit: -1
>       Processor Tree:
>         ListSink
> Time taken: 1.258 seconds, Fetched: 35 row(s)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message