Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 16E2C200D06 for ; Mon, 25 Sep 2017 22:59:51 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 15966160BCB; Mon, 25 Sep 2017 20:59:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 86A561609BB for ; Mon, 25 Sep 2017 22:59:49 +0200 (CEST) Received: (qmail 89834 invoked by uid 500); 25 Sep 2017 20:59:48 -0000 Mailing-List: contact commits-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hive.apache.org Delivered-To: mailing list commits@hive.apache.org Received: (qmail 89809 invoked by uid 99); 25 Sep 2017 20:59:48 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Sep 2017 20:59:48 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id AB4A7F5615; Mon, 25 Sep 2017 20:59:47 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: vgarg@apache.org To: commits@hive.apache.org Date: Mon, 25 Sep 2017 20:59:48 -0000 Message-Id: <7f3ec65ff1734f47a308f629ada59a79@git.apache.org> In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [02/23] hive git commit: HIVE-17536 : StatsUtil::getBasicStatForTable doesn't distinguish b/w absence of statistics or zero stats (Vineet Garg, reviewed by Ashutosh Chauhan) archived-at: Mon, 25 Sep 2017 20:59:51 -0000 http://git-wip-us.apache.org/repos/asf/hive/blob/6a99cf53/ql/src/test/results/clientpositive/vector_windowing_windowspec.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/vector_windowing_windowspec.q.out b/ql/src/test/results/clientpositive/vector_windowing_windowspec.q.out index 5c353b7..bca8c12 100644 --- a/ql/src/test/results/clientpositive/vector_windowing_windowspec.q.out +++ b/ql/src/test/results/clientpositive/vector_windowing_windowspec.q.out @@ -65,7 +65,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -78,7 +78,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -101,7 +101,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey0 (type: int), KEY.reducesinkkey2 (type: bigint), KEY.reducesinkkey1 (type: string) outputColumnNames: _col2, _col3, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -121,17 +121,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumLong window frame: ROWS PRECEDING(MAX)~CURRENT - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), sum_window_0 (type: bigint) outputColumnNames: _col0, _col1 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -273,7 +273,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -286,7 +286,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -309,7 +309,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey2 (type: float), KEY.reducesinkkey0 (type: double), KEY.reducesinkkey1 (type: string) outputColumnNames: _col4, _col5, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -329,17 +329,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumDouble window frame: ROWS PRECEDING(MAX)~CURRENT - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), sum_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -481,7 +481,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -494,7 +494,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE value expressions: s (type: string) Execution mode: vectorized Map Vectorization: @@ -518,7 +518,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: float), VALUE._col6 (type: string), KEY.reducesinkkey0 (type: timestamp) outputColumnNames: _col4, _col7, _col8 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -538,17 +538,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumDouble window frame: RANGE CURRENT~FOLLOWING(MAX) - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), sum_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -690,7 +690,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -703,7 +703,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -726,7 +726,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey2 (type: float), KEY.reducesinkkey1 (type: string), KEY.reducesinkkey0 (type: timestamp) outputColumnNames: _col4, _col7, _col8 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -746,17 +746,17 @@ STAGE PLANS: name: avg window function: GenericUDAFAverageEvaluatorDouble window frame: ROWS CURRENT~FOLLOWING(5) - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), avg_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -898,7 +898,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -911,7 +911,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -934,7 +934,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey0 (type: tinyint), KEY.reducesinkkey2 (type: double), KEY.reducesinkkey1 (type: string) outputColumnNames: _col0, _col5, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -954,17 +954,17 @@ STAGE PLANS: name: avg window function: GenericUDAFAverageEvaluatorDouble window frame: ROWS PRECEDING(5)~FOLLOWING(5) - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), avg_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 11200 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1106,7 +1106,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1119,7 +1119,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE value expressions: i (type: int) Execution mode: vectorized Map Vectorization: @@ -1143,7 +1143,7 @@ STAGE PLANS: Select Operator expressions: VALUE._col2 (type: int), KEY.reducesinkkey1 (type: string), KEY.reducesinkkey0 (type: timestamp) outputColumnNames: _col2, _col7, _col8 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -1163,17 +1163,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumLong window frame: RANGE PRECEDING(MAX)~CURRENT - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), sum_window_0 (type: bigint) outputColumnNames: _col0, _col1 - Statistics: Num rows: 7066 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 14400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1315,7 +1315,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1328,7 +1328,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -1351,7 +1351,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: float), KEY.reducesinkkey0 (type: timestamp) outputColumnNames: _col4, _col8 - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -1371,17 +1371,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumDouble window frame: RANGE PRECEDING(MAX)~CURRENT - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col4 (type: float), sum_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 4400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 4400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1523,7 +1523,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1536,7 +1536,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Execution mode: vectorized Map Vectorization: enabled: true @@ -1559,7 +1559,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: float), KEY.reducesinkkey0 (type: timestamp) outputColumnNames: _col4, _col8 - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -1579,17 +1579,17 @@ STAGE PLANS: name: sum window function: GenericUDAFSumDouble window frame: ROWS PRECEDING(2)~PRECEDING(1) - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col4 (type: float), sum_window_0 (type: double) outputColumnNames: _col0, _col1 - Statistics: Num rows: 23126 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 100 - Statistics: Num rows: 100 Data size: 4400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 100 Data size: 4400 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1731,7 +1731,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1744,7 +1744,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE value expressions: d (type: double) Execution mode: vectorized Map Vectorization: @@ -1768,7 +1768,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: int), VALUE._col4 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col2, _col5, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -1788,17 +1788,17 @@ STAGE PLANS: name: avg window function: GenericUDAFAverageEvaluatorDouble window frame: RANGE PRECEDING(MAX)~CURRENT - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), _col2 (type: int), round((avg_window_0 / 10.0), 2) (type: double) outputColumnNames: _col0, _col1, _col2 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 7 - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1847,7 +1847,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1860,7 +1860,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE value expressions: d (type: double) Execution mode: vectorized Map Vectorization: @@ -1884,7 +1884,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: int), VALUE._col4 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col2, _col5, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -1904,17 +1904,17 @@ STAGE PLANS: name: avg window function: GenericUDAFAverageEvaluatorDouble window frame: RANGE PRECEDING(MAX)~CURRENT - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), _col2 (type: int), round(((avg_window_0 + 10.0) - (avg_window_0 - 10.0)), 2) (type: double) outputColumnNames: _col0, _col1, _col2 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 7 - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat @@ -1963,7 +1963,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: over10k - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] @@ -1976,7 +1976,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.vectorized.execution.reducesink.new.enabled IS true, No PTF TopN IS true, No DISTINCT columns IS true, BinarySortableSerDe for keys IS true, LazyBinarySerDe for values IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE value expressions: d (type: double) Execution mode: vectorized Map Vectorization: @@ -2000,7 +2000,7 @@ STAGE PLANS: Select Operator expressions: KEY.reducesinkkey1 (type: int), VALUE._col4 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col2, _col5, _col7 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE PTF Operator Function definitions: Input definition @@ -2020,17 +2020,17 @@ STAGE PLANS: name: avg window function: GenericUDAFAverageEvaluatorDouble window frame: RANGE PRECEDING(MAX)~CURRENT - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col7 (type: string), _col2 (type: int) outputColumnNames: _col0, _col1 - Statistics: Num rows: 9085 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 7 - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false - Statistics: Num rows: 7 Data size: 784 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 1017544 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat http://git-wip-us.apache.org/repos/asf/hive/blob/6a99cf53/ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out b/ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out index 1127f8a..a54e231 100644 --- a/ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out +++ b/ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out @@ -54,14 +54,14 @@ STAGE PLANS: $hdt$_0:x TableScan alias: x - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: a is not null (type: boolean) - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: a (type: int) outputColumnNames: _col0 - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE HashTable Sink Operator keys: 0 _col0 (type: int) @@ -72,7 +72,7 @@ STAGE PLANS: Map Operator Tree: TableScan alias: y - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE TableScan Vectorization: native: true projectedOutputColumns: [0] @@ -82,7 +82,7 @@ STAGE PLANS: native: true predicateExpression: SelectColumnIsNotNull(col 0) -> boolean predicate: b is not null (type: boolean) - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: b (type: int) outputColumnNames: _col0 @@ -90,7 +90,7 @@ STAGE PLANS: className: VectorSelectOperator native: true projectedOutputColumns: [0] - Statistics: Num rows: 45 Data size: 181 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 181 Basic stats: COMPLETE Column stats: NONE Map Join Operator condition map: Inner Join 0 to 1 @@ -102,7 +102,7 @@ STAGE PLANS: native: false nativeConditionsMet: hive.mapjoin.optimized.hashtable IS true, hive.vectorized.execution.mapjoin.native.enabled IS true, One MapJoin Condition IS true, No nullsafe IS true, Small table vectorizes IS true, Fast Hash Table and No Hybrid Hash Join IS true nativeConditionsNotMet: hive.execution.engine mr IN [tez, spark] IS false - Statistics: Num rows: 49 Data size: 199 Basic stats: COMPLETE Column stats: NONE + Statistics: Num rows: 1 Data size: 199 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: count() Group By Vectorization: