Return-Path: X-Original-To: apmail-hive-commits-archive@www.apache.org Delivered-To: apmail-hive-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BD73E17BDD for ; Mon, 6 Oct 2014 04:02:49 +0000 (UTC) Received: (qmail 18011 invoked by uid 500); 6 Oct 2014 04:02:49 -0000 Delivered-To: apmail-hive-commits-archive@hive.apache.org Received: (qmail 17967 invoked by uid 500); 6 Oct 2014 04:02:49 -0000 Mailing-List: contact commits-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hive.apache.org Delivered-To: mailing list commits@hive.apache.org Received: (qmail 17955 invoked by uid 99); 6 Oct 2014 04:02:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Oct 2014 04:02:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Oct 2014 04:02:45 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id 913C72388C74; Mon, 6 Oct 2014 04:01:28 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1629563 [26/33] - in /hive/branches/spark: ./ accumulo-handler/ beeline/ beeline/src/java/org/apache/hive/beeline/ bin/ bin/ext/ common/ common/src/java/org/apache/hadoop/hive/conf/ common/src/test/org/apache/hadoop/hive/common/type/ contr... Date: Mon, 06 Oct 2014 04:00:54 -0000 To: commits@hive.apache.org From: brock@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20141006040128.913C72388C74@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge7.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge7.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge7.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge7.q.out Mon Oct 6 04:00:39 2014 @@ -148,19 +148,23 @@ POSTHOOK: Lineage: orc_merge5a PARTITION PREHOOK: query: -- 3 files total analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: -- 3 files total analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -194,7 +198,7 @@ Partition Parameters: numFiles 1 numRows 1 rawDataSize 255 - totalSize 521 + totalSize 513 #### A masked pattern was here #### # Storage Information @@ -238,7 +242,7 @@ Partition Parameters: numFiles 2 numRows 2 rawDataSize 510 - totalSize 1058 + totalSize 1044 #### A masked pattern was here #### # Storage Information @@ -440,19 +444,23 @@ POSTHOOK: Lineage: orc_merge5a PARTITION PREHOOK: query: -- 1 file after merging analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: -- 1 file after merging analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -486,7 +494,7 @@ Partition Parameters: numFiles 1 numRows 1 rawDataSize 255 - totalSize 521 + totalSize 513 #### A masked pattern was here #### # Storage Information @@ -530,7 +538,7 @@ Partition Parameters: numFiles 1 numRows 2 rawDataSize 510 - totalSize 852 + totalSize 838 #### A masked pattern was here #### # Storage Information @@ -636,18 +644,22 @@ POSTHOOK: Lineage: orc_merge5a PARTITION POSTHOOK: Lineage: orc_merge5a PARTITION(st=80.0).userid SIMPLE [(orc_merge5)orc_merge5.FieldSchema(name:userid, type:bigint, comment:null), ] PREHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -681,7 +693,7 @@ Partition Parameters: numFiles 1 numRows 1 rawDataSize 255 - totalSize 521 + totalSize 513 #### A masked pattern was here #### # Storage Information @@ -725,7 +737,7 @@ Partition Parameters: numFiles 2 numRows 2 rawDataSize 510 - totalSize 1058 + totalSize 1044 #### A masked pattern was here #### # Storage Information @@ -813,19 +825,23 @@ POSTHOOK: Output: default@orc_merge5a@st PREHOOK: query: -- 1 file after merging analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: -- 1 file after merging analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -859,7 +875,7 @@ Partition Parameters: numFiles 1 numRows 1 rawDataSize 255 - totalSize 521 + totalSize 513 #### A masked pattern was here #### # Storage Information @@ -903,7 +919,7 @@ Partition Parameters: numFiles 1 numRows 2 rawDataSize 510 - totalSize 852 + totalSize 838 #### A masked pattern was here #### # Storage Information Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat1.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat1.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat1.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat1.q.out Mon Oct 6 04:00:39 2014 @@ -148,10 +148,12 @@ POSTHOOK: Lineage: orc_merge5b.userid SI PREHOOK: query: -- 5 files total analyze table orc_merge5b compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5b PREHOOK: Output: default@orc_merge5b POSTHOOK: query: -- 5 files total analyze table orc_merge5b compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5b POSTHOOK: Output: default@orc_merge5b PREHOOK: query: desc formatted orc_merge5b PREHOOK: type: DESCTABLE @@ -179,7 +181,7 @@ Table Parameters: numFiles 5 numRows 15 rawDataSize 3825 - totalSize 2862 + totalSize 2877 #### A masked pattern was here #### # Storage Information @@ -226,10 +228,12 @@ POSTHOOK: Output: default@orc_merge5b PREHOOK: query: -- 3 file after merging - all 0.12 format files will be merged and 0.11 files will be left behind analyze table orc_merge5b compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5b PREHOOK: Output: default@orc_merge5b POSTHOOK: query: -- 3 file after merging - all 0.12 format files will be merged and 0.11 files will be left behind analyze table orc_merge5b compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5b POSTHOOK: Output: default@orc_merge5b PREHOOK: query: desc formatted orc_merge5b PREHOOK: type: DESCTABLE @@ -257,7 +261,7 @@ Table Parameters: numFiles 3 numRows 15 rawDataSize 3825 - totalSize 2325 + totalSize 2340 #### A masked pattern was here #### # Storage Information Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat2.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat2.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat2.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/orc_merge_incompat2.q.out Mon Oct 6 04:00:39 2014 @@ -207,18 +207,22 @@ POSTHOOK: Lineage: orc_merge5a PARTITION POSTHOOK: Lineage: orc_merge5a PARTITION(st=80.0).userid SIMPLE [(orc_merge5)orc_merge5.FieldSchema(name:userid, type:bigint, comment:null), ] PREHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -252,7 +256,7 @@ Partition Parameters: numFiles 4 numRows 4 rawDataSize 1020 - totalSize 2092 + totalSize 2060 #### A masked pattern was here #### # Storage Information @@ -296,7 +300,7 @@ Partition Parameters: numFiles 4 numRows 8 rawDataSize 2040 - totalSize 2204 + totalSize 2188 #### A masked pattern was here #### # Storage Information @@ -392,18 +396,22 @@ POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=80.0 POSTHOOK: query: analyze table orc_merge5a partition(st=80.0) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=80.0 PREHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan PREHOOK: type: QUERY +PREHOOK: Input: default@orc_merge5a PREHOOK: Output: default@orc_merge5a PREHOOK: Output: default@orc_merge5a@st=0.8 POSTHOOK: query: analyze table orc_merge5a partition(st=0.8) compute statistics noscan POSTHOOK: type: QUERY +POSTHOOK: Input: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a POSTHOOK: Output: default@orc_merge5a@st=0.8 PREHOOK: query: desc formatted orc_merge5a partition(st=80.0) @@ -437,7 +445,7 @@ Partition Parameters: numFiles 3 numRows 4 rawDataSize 1020 - totalSize 1851 + totalSize 1819 #### A masked pattern was here #### # Storage Information @@ -481,7 +489,7 @@ Partition Parameters: numFiles 3 numRows 8 rawDataSize 2040 - totalSize 1944 + totalSize 1928 #### A masked pattern was here #### # Storage Information Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/select_dummy_source.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/select_dummy_source.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/select_dummy_source.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/select_dummy_source.q.out Mon Oct 6 04:00:39 2014 @@ -239,37 +239,20 @@ explain select 2 + 3,x from (select 1 + 2 x) X POSTHOOK: type: QUERY STAGE DEPENDENCIES: - Stage-1 is a root stage - Stage-0 depends on stages: Stage-1 + Stage-0 is a root stage STAGE PLANS: - Stage: Stage-1 - Tez -#### A masked pattern was here #### - Vertices: - Map 1 - Map Operator Tree: - TableScan - alias: _dummy_table - Row Limit Per Split: 1 - Statistics: Num rows: 0 Data size: 1 Basic stats: PARTIAL Column stats: COMPLETE - Select Operator - expressions: 5 (type: int), 3 (type: int) - outputColumnNames: _col0, _col1 - Statistics: Num rows: 0 Data size: 1 Basic stats: PARTIAL Column stats: COMPLETE - File Output Operator - compressed: false - Statistics: Num rows: 0 Data size: 1 Basic stats: PARTIAL Column stats: COMPLETE - table: - input format: org.apache.hadoop.mapred.TextInputFormat - output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat - serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: - ListSink + TableScan + alias: _dummy_table + Row Limit Per Split: 1 + Select Operator + expressions: 5 (type: int), 3 (type: int) + outputColumnNames: _col0, _col1 + ListSink PREHOOK: query: select 2 + 3,x from (select 1 + 2 x) X PREHOOK: type: QUERY Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_exists.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_exists.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_exists.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_exists.q.out Mon Oct 6 04:00:39 2014 @@ -66,7 +66,7 @@ STAGE PLANS: Statistics: Num rows: 42 Data size: 446 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_in.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_in.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_in.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/subquery_in.q.out Mon Oct 6 04:00:39 2014 @@ -159,7 +159,7 @@ STAGE PLANS: value expressions: value (type: string) Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: @@ -276,7 +276,7 @@ STAGE PLANS: Statistics: Num rows: 42 Data size: 446 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: @@ -439,7 +439,7 @@ STAGE PLANS: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reducer 4 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: @@ -545,7 +545,7 @@ STAGE PLANS: value expressions: p_mfgr (type: string), p_size (type: int) Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: @@ -714,7 +714,7 @@ STAGE PLANS: Statistics: Num rows: 42 Data size: 446 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: @@ -901,7 +901,7 @@ STAGE PLANS: Statistics: Num rows: 432 Data size: 3024 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Inner Join 0 to 1 condition expressions: @@ -917,7 +917,7 @@ STAGE PLANS: value expressions: _col0 (type: int), _col3 (type: int) Reducer 3 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Semi Join 0 to 1 condition expressions: Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_bmj_schema_evolution.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_bmj_schema_evolution.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_bmj_schema_evolution.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_bmj_schema_evolution.q.out Mon Oct 6 04:00:39 2014 @@ -113,6 +113,8 @@ STAGE PLANS: 0 key (type: int) 1 key (type: int) outputColumnNames: _col0, _col1 + input vertices: + 1 Map 1 Statistics: Num rows: 550 Data size: 28771 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: int), _col1 (type: string) Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_dml.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_dml.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_dml.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_dml.q.out Mon Oct 6 04:00:39 2014 @@ -443,8 +443,6 @@ STAGE DEPENDENCIES: STAGE PLANS: Stage: Stage-1 Tez - Edges: - Reducer 2 <- Map 1 (SIMPLE_EDGE) #### A masked pattern was here #### Vertices: Map 1 @@ -456,24 +454,14 @@ STAGE PLANS: expressions: value (type: string), cnt (type: bigint) outputColumnNames: _col0, _col1 Statistics: Num rows: 309 Data size: 2718 Basic stats: COMPLETE Column stats: NONE - Reduce Output Operator - key expressions: _col1 (type: bigint) - sort order: + - Map-reduce partition columns: _col1 (type: bigint) + File Output Operator + compressed: false Statistics: Num rows: 309 Data size: 2718 Basic stats: COMPLETE Column stats: NONE - value expressions: _col0 (type: string), _col1 (type: bigint) - Reducer 2 - Reduce Operator Tree: - Extract - Statistics: Num rows: 309 Data size: 2718 Basic stats: COMPLETE Column stats: NONE - File Output Operator - compressed: false - Statistics: Num rows: 309 Data size: 2718 Basic stats: COMPLETE Column stats: NONE - table: - input format: org.apache.hadoop.mapred.TextInputFormat - output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat - serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe - name: default.tmp_src_part + table: + input format: org.apache.hadoop.mapred.TextInputFormat + output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat + serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe + name: default.tmp_src_part Stage: Stage-2 Dependency Collection @@ -529,314 +517,314 @@ POSTHOOK: Input: default@tmp_src_part@d= POSTHOOK: Input: default@tmp_src_part@d=5 #### A masked pattern was here #### val_490 1 -val_289 1 -val_291 1 -val_292 1 -val_296 1 -val_180 1 -val_30 1 -val_302 1 -val_305 1 -val_306 1 -val_491 1 -val_308 1 -val_96 1 -val_310 1 -val_178 1 -val_315 1 -val_177 1 -val_493 1 -val_170 1 -val_494 1 -val_495 1 -val_323 1 -val_496 1 -val_17 1 -val_33 1 -val_497 1 -val_332 1 -val_111 1 -val_335 1 -val_336 1 -val_338 1 -val_339 1 -val_34 1 -val_341 1 -val_11 1 -val_85 1 -val_345 1 -val_168 1 -val_166 1 -val_351 1 -val_53 1 -val_356 1 -val_360 1 -val_362 1 -val_364 1 -val_365 1 -val_366 1 -val_54 1 -val_368 1 -val_163 1 -val_57 1 -val_373 1 -val_374 1 -val_375 1 -val_377 1 -val_378 1 -val_379 1 -val_86 1 -val_162 1 -val_386 1 -val_389 1 -val_392 1 -val_393 1 -val_394 1 -val_64 1 -val_160 1 -val_65 1 -val_66 1 -val_4 1 -val_400 1 -val_158 1 -val_402 1 -val_157 1 -val_87 1 -val_156 1 -val_407 1 -val_155 1 -val_41 1 -val_411 1 -val_69 1 -val_105 1 -val_153 1 -val_418 1 -val_419 1 -val_9 1 -val_421 1 -val_74 1 -val_427 1 -val_10 1 -val_43 1 -val_150 1 -val_145 1 -val_432 1 -val_435 1 -val_436 1 -val_437 1 -val_143 1 -val_77 1 -val_44 1 -val_443 1 -val_444 1 -val_446 1 -val_448 1 -val_192 1 -val_190 1 -val_194 1 -val_449 1 -val_196 1 -val_452 1 -val_19 1 -val_2 1 -val_20 1 -val_453 1 -val_201 1 -val_202 1 -val_136 1 -val_455 1 -val_457 1 -val_189 1 -val_78 1 -val_8 1 -val_214 1 -val_460 1 -val_80 1 -val_218 1 -val_82 1 -val_133 1 -val_222 1 -val_467 1 -val_131 1 -val_226 1 -val_228 1 -val_126 1 -val_186 1 -val_47 1 -val_235 1 -val_470 1 -val_472 1 -val_475 1 -val_477 1 -val_241 1 -val_92 1 -val_244 1 -val_247 1 -val_248 1 -val_249 1 -val_252 1 -val_479 1 -val_116 1 -val_257 1 -val_258 1 -val_481 1 -val_260 1 -val_262 1 -val_263 1 -val_482 1 -val_266 1 -val_27 1 -val_483 1 -val_183 1 -val_274 1 -val_275 1 -val_181 1 -val_484 1 -val_28 1 -val_485 1 -val_487 1 -val_114 1 -val_283 1 -val_284 1 -val_285 1 -val_286 1 val_287 1 -val_84 2 -val_95 2 -val_97 2 -val_98 2 -val_100 2 -val_103 2 -val_104 2 -val_113 2 -val_118 2 -val_12 2 -val_120 2 -val_125 2 -val_129 2 -val_134 2 -val_137 2 -val_146 2 -val_149 2 -val_15 2 -val_152 2 -val_164 2 -val_165 2 -val_172 2 -val_174 2 -val_175 2 -val_176 2 -val_179 2 -val_18 2 -val_191 2 -val_195 2 -val_197 2 -val_200 2 -val_203 2 -val_205 2 -val_207 2 -val_209 2 -val_213 2 -val_216 2 -val_217 2 -val_219 2 -val_221 2 -val_223 2 -val_224 2 -val_229 2 -val_233 2 -val_237 2 -val_238 2 -val_239 2 -val_24 2 -val_242 2 -val_255 2 -val_256 2 -val_26 2 -val_265 2 -val_272 2 -val_278 2 -val_280 2 -val_281 2 -val_282 2 -val_288 2 -val_307 2 -val_309 2 -val_317 2 -val_321 2 -val_322 2 -val_325 2 -val_331 2 -val_333 2 -val_342 2 -val_344 2 -val_353 2 -val_367 2 -val_37 2 -val_382 2 -val_395 2 -val_397 2 -val_399 2 -val_404 2 -val_413 2 -val_414 2 -val_42 2 -val_424 2 -val_429 2 -val_439 2 -val_458 2 -val_459 2 -val_462 2 -val_463 2 -val_478 2 -val_492 2 -val_51 2 -val_58 2 -val_67 2 -val_72 2 -val_76 2 +val_286 1 +val_285 1 +val_284 1 +val_283 1 +val_114 1 +val_487 1 +val_485 1 +val_28 1 +val_484 1 +val_181 1 +val_275 1 +val_274 1 +val_183 1 +val_483 1 +val_27 1 +val_266 1 +val_482 1 +val_263 1 +val_262 1 +val_260 1 +val_481 1 +val_258 1 +val_257 1 +val_116 1 +val_479 1 +val_252 1 +val_249 1 +val_248 1 +val_247 1 +val_244 1 +val_92 1 +val_241 1 +val_477 1 +val_475 1 +val_472 1 +val_470 1 +val_235 1 +val_47 1 +val_186 1 +val_126 1 +val_228 1 +val_226 1 +val_131 1 +val_467 1 +val_222 1 +val_133 1 +val_82 1 +val_218 1 +val_80 1 +val_460 1 +val_214 1 +val_8 1 +val_78 1 +val_189 1 +val_457 1 +val_455 1 +val_136 1 +val_202 1 +val_201 1 +val_453 1 +val_20 1 +val_2 1 +val_19 1 +val_452 1 +val_196 1 +val_449 1 +val_194 1 +val_190 1 +val_192 1 +val_448 1 +val_446 1 +val_444 1 +val_443 1 +val_44 1 +val_77 1 +val_143 1 +val_437 1 +val_436 1 +val_435 1 +val_432 1 +val_145 1 +val_150 1 +val_43 1 +val_10 1 +val_427 1 +val_74 1 +val_421 1 +val_9 1 +val_419 1 +val_418 1 +val_153 1 +val_105 1 +val_69 1 +val_411 1 +val_41 1 +val_155 1 +val_407 1 +val_156 1 +val_87 1 +val_157 1 +val_402 1 +val_158 1 +val_400 1 +val_4 1 +val_66 1 +val_65 1 +val_160 1 +val_64 1 +val_394 1 +val_393 1 +val_392 1 +val_389 1 +val_386 1 +val_162 1 +val_86 1 +val_379 1 +val_378 1 +val_377 1 +val_375 1 +val_374 1 +val_373 1 +val_57 1 +val_163 1 +val_368 1 +val_54 1 +val_366 1 +val_365 1 +val_364 1 +val_362 1 +val_360 1 +val_356 1 +val_53 1 +val_351 1 +val_166 1 +val_168 1 +val_345 1 +val_85 1 +val_11 1 +val_341 1 +val_34 1 +val_339 1 +val_338 1 +val_336 1 +val_335 1 +val_111 1 +val_332 1 +val_497 1 +val_33 1 +val_17 1 +val_496 1 +val_323 1 +val_495 1 +val_494 1 +val_170 1 +val_493 1 +val_177 1 +val_315 1 +val_178 1 +val_310 1 +val_96 1 +val_308 1 +val_491 1 +val_306 1 +val_305 1 +val_302 1 +val_30 1 +val_180 1 +val_296 1 +val_292 1 +val_291 1 +val_289 1 +val_98 2 +val_97 2 +val_95 2 +val_84 2 val_83 2 -val_396 3 -val_384 3 -val_369 3 +val_76 2 +val_72 2 +val_67 2 +val_58 2 +val_51 2 +val_492 2 +val_478 2 +val_463 2 +val_462 2 +val_459 2 +val_458 2 +val_439 2 +val_429 2 +val_424 2 +val_42 2 +val_414 2 +val_413 2 +val_404 2 +val_399 2 +val_397 2 +val_395 2 +val_382 2 +val_37 2 +val_367 2 +val_353 2 +val_344 2 +val_342 2 +val_333 2 +val_331 2 +val_325 2 +val_322 2 +val_321 2 +val_317 2 +val_309 2 +val_307 2 +val_288 2 +val_282 2 +val_281 2 +val_280 2 +val_278 2 +val_272 2 +val_265 2 +val_26 2 +val_256 2 +val_255 2 +val_242 2 +val_24 2 +val_239 2 +val_238 2 +val_237 2 +val_233 2 +val_229 2 +val_224 2 +val_223 2 +val_221 2 +val_219 2 +val_217 2 +val_216 2 +val_213 2 +val_209 2 +val_207 2 +val_205 2 +val_203 2 +val_200 2 +val_197 2 +val_195 2 +val_191 2 +val_18 2 +val_179 2 +val_176 2 +val_175 2 +val_174 2 +val_172 2 +val_165 2 +val_164 2 +val_152 2 +val_15 2 +val_149 2 +val_146 2 +val_137 2 +val_134 2 +val_129 2 +val_125 2 +val_120 2 +val_12 2 +val_118 2 +val_113 2 +val_104 2 +val_103 2 +val_100 2 val_498 3 -val_35 3 -val_167 3 -val_327 3 -val_318 3 -val_128 3 -val_90 3 -val_466 3 -val_316 3 -val_311 3 -val_454 3 -val_298 3 -val_273 3 -val_187 3 -val_208 3 -val_199 3 -val_193 3 -val_480 3 -val_438 3 -val_431 3 -val_0 3 -val_119 3 -val_70 3 -val_430 3 -val_5 3 -val_417 3 -val_409 3 +val_369 3 +val_384 3 +val_396 3 val_403 3 -val_406 4 -val_489 4 +val_409 3 +val_417 3 +val_5 3 +val_430 3 +val_70 3 +val_119 3 +val_0 3 +val_431 3 +val_438 3 +val_480 3 +val_193 3 +val_199 3 +val_208 3 +val_187 3 +val_273 3 +val_298 3 +val_454 3 +val_311 3 +val_316 3 +val_466 3 +val_90 3 +val_128 3 +val_318 3 +val_327 3 +val_167 3 +val_35 3 val_468 4 -val_277 4 -val_138 4 +val_489 4 +val_406 4 val_169 4 -val_348 5 -val_230 5 -val_401 5 +val_138 4 +val_277 4 val_469 5 +val_401 5 +val_230 5 +val_348 5 PREHOOK: query: -- multi insert CREATE TABLE even (c int, d string) PREHOOK: type: CREATETABLE Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_hash.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_hash.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_hash.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_hash.q.out Mon Oct 6 04:00:39 2014 @@ -63,7 +63,7 @@ STAGE PLANS: Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Inner Join 0 to 1 condition expressions: Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_tests.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_tests.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_tests.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_join_tests.q.out Mon Oct 6 04:00:39 2014 @@ -52,7 +52,7 @@ STAGE PLANS: Statistics: Num rows: 25 Data size: 191 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Outer Join0 to 1 condition expressions: @@ -83,7 +83,7 @@ STAGE PLANS: value expressions: _col0 (type: string) Reducer 4 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Right Outer Join0 to 1 condition expressions: Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_joins_explain.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_joins_explain.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_joins_explain.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_joins_explain.q.out Mon Oct 6 04:00:39 2014 @@ -52,7 +52,7 @@ STAGE PLANS: Statistics: Num rows: 25 Data size: 191 Basic stats: COMPLETE Column stats: NONE Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Left Outer Join0 to 1 condition expressions: @@ -83,7 +83,7 @@ STAGE PLANS: value expressions: _col0 (type: string) Reducer 4 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Right Outer Join0 to 1 condition expressions: Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_union.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_union.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_union.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/tez_union.q.out Mon Oct 6 04:00:39 2014 @@ -36,6 +36,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0, _col1 + input vertices: + 1 Map 3 Select Operator expressions: _col0 (type: string), _col1 (type: string) outputColumnNames: _col0, _col1 @@ -218,7 +220,7 @@ STAGE PLANS: Map-reduce partition columns: _col0 (type: string) Reducer 3 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Inner Join 0 to 1 condition expressions: @@ -355,6 +357,8 @@ STAGE PLANS: 0 key (type: string) 1 _col0 (type: string) outputColumnNames: _col0, _col5 + input vertices: + 0 Map 1 Select Operator expressions: _col0 (type: string), _col5 (type: string) outputColumnNames: _col0, _col1 @@ -383,6 +387,8 @@ STAGE PLANS: 0 key (type: string) 1 _col0 (type: string) outputColumnNames: _col0, _col5 + input vertices: + 0 Map 1 Select Operator expressions: _col0 (type: string), _col5 (type: string) outputColumnNames: _col0, _col1 @@ -535,6 +541,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0 + input vertices: + 1 Map 5 Select Operator expressions: _col0 (type: string) outputColumnNames: _col0 @@ -551,6 +559,9 @@ STAGE PLANS: 1 _col0 (type: string) 2 key (type: string) outputColumnNames: _col0, _col5, _col6 + input vertices: + 0 Map 1 + 2 Map 8 Select Operator expressions: _col0 (type: string), _col5 (type: string), _col6 (type: string) outputColumnNames: _col0, _col1, _col2 @@ -600,6 +611,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0 + input vertices: + 1 Map 6 Select Operator expressions: _col0 (type: string) outputColumnNames: _col0 @@ -616,6 +629,9 @@ STAGE PLANS: 1 _col0 (type: string) 2 key (type: string) outputColumnNames: _col0, _col5, _col6 + input vertices: + 0 Map 1 + 2 Map 8 Select Operator expressions: _col0 (type: string), _col5 (type: string), _col6 (type: string) outputColumnNames: _col0, _col1, _col2 @@ -662,6 +678,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0 + input vertices: + 1 Map 10 Select Operator expressions: _col0 (type: string) outputColumnNames: _col0 @@ -678,6 +696,9 @@ STAGE PLANS: 1 _col0 (type: string) 2 key (type: string) outputColumnNames: _col0, _col5, _col6 + input vertices: + 0 Map 1 + 2 Map 8 Select Operator expressions: _col0 (type: string), _col5 (type: string), _col6 (type: string) outputColumnNames: _col0, _col1, _col2 @@ -883,6 +904,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0 + input vertices: + 1 Map 3 Select Operator expressions: _col0 (type: string) outputColumnNames: _col0 @@ -924,6 +947,8 @@ STAGE PLANS: 0 key (type: string) 1 key (type: string) outputColumnNames: _col0 + input vertices: + 1 Map 5 Select Operator expressions: _col0 (type: string) outputColumnNames: _col0 @@ -1057,6 +1082,8 @@ STAGE PLANS: 0 _col0 (type: string) 1 key (type: string) outputColumnNames: _col0, _col1, _col2, _col3 + input vertices: + 1 Map 3 Select Operator expressions: _col0 (type: string), _col1 (type: string), _col2 (type: string), _col3 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 @@ -1100,6 +1127,8 @@ STAGE PLANS: 0 _col0 (type: string) 1 key (type: string) outputColumnNames: _col0, _col1, _col2, _col3 + input vertices: + 1 Map 3 Select Operator expressions: _col0 (type: string), _col1 (type: string), _col2 (type: string), _col3 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 @@ -1167,6 +1196,8 @@ STAGE PLANS: 0 _col0 (type: string) 1 key (type: string) outputColumnNames: _col0, _col2 + input vertices: + 0 Union 2 Statistics: Num rows: 1100 Data size: 11686 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: string), _col2 (type: string) Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/union7.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/union7.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/union7.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/union7.q.out Mon Oct 6 04:00:39 2014 @@ -92,14 +92,14 @@ STAGE PLANS: keys: KEY._col0 (type: string) mode: mergepartial outputColumnNames: _col0, _col1 - Statistics: Num rows: 13 Data size: 1300 Basic stats: COMPLETE Column stats: PARTIAL + Statistics: Num rows: 6 Data size: 600 Basic stats: COMPLETE Column stats: PARTIAL Select Operator expressions: _col0 (type: string), _col1 (type: bigint) outputColumnNames: _col0, _col1 - Statistics: Num rows: 13 Data size: 1300 Basic stats: COMPLETE Column stats: PARTIAL + Statistics: Num rows: 6 Data size: 600 Basic stats: COMPLETE Column stats: PARTIAL File Output Operator compressed: false - Statistics: Num rows: 13 Data size: 1300 Basic stats: COMPLETE Column stats: PARTIAL + Statistics: Num rows: 6 Data size: 600 Basic stats: COMPLETE Column stats: PARTIAL table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_after_multiple_inserts.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_after_multiple_inserts.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_after_multiple_inserts.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_after_multiple_inserts.q.out Mon Oct 6 04:00:39 2014 @@ -1,12 +1,12 @@ PREHOOK: query: create table acid_uami(i int, de decimal(5,2), - vc varchar(128)) clustered by (i) into 2 buckets stored as orc + vc varchar(128)) clustered by (i) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uami POSTHOOK: query: create table acid_uami(i int, de decimal(5,2), - vc varchar(128)) clustered by (i) into 2 buckets stored as orc + vc varchar(128)) clustered by (i) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uami Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_non_partitioned.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_non_partitioned.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_non_partitioned.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_non_partitioned.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_uanp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_uanp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uanp -POSTHOOK: query: create table acid_uanp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_uanp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uanp Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_partitioned.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_partitioned.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_partitioned.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_partitioned.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_uap(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_uap(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uap -POSTHOOK: query: create table acid_uap(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_uap(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uap @@ -85,15 +85,21 @@ POSTHOOK: Input: default@acid_uap@ds=tod POSTHOOK: Input: default@acid_uap@ds=tomorrow #### A masked pattern was here #### -1073279343 fred today +-1073279343 oj1YrV5Wa today -1073051226 fred today -1072910839 fred today +-1072081801 dPkN74F7 today -1072081801 fred today -1072076362 fred today -1071480828 fred today +-1071363017 Anj0oF today -1071363017 fred today +-1070883071 0ruyd6Y50JpdGRf6HqD today -1070883071 fred today -1070551679 fred today +-1070551679 iUR3Q today -1069736047 fred today +-1069736047 k17Am8uPHWk02cEf1jet today 762 fred tomorrow 762 fred tomorrow 762 fred tomorrow Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_types.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_types.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_types.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_all_types.q.out Mon Oct 6 04:00:39 2014 @@ -10,7 +10,7 @@ PREHOOK: query: create table acid_uat(ti s string, vc varchar(128), ch char(36), - b boolean) clustered by (i) into 2 buckets stored as orc + b boolean) clustered by (i) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uat @@ -26,7 +26,7 @@ POSTHOOK: query: create table acid_uat(t s string, vc varchar(128), ch char(36), - b boolean) clustered by (i) into 2 buckets stored as orc + b boolean) clustered by (i) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uat @@ -151,3 +151,37 @@ NULL -5470 -1072076362 1864027286 NULL - NULL -947 -1070551679 1864027286 NULL -947.0 NULL NULL 1970-01-01 iUR3Q iUR3Q 4KWs6gw7lv2WYd66P false 11 NULL -1069736047 -453772520 11.0 NULL 11.0 1969-12-31 16:00:02.351 NULL k17Am8uPHWk02cEf1jet k17Am8uPHWk02cEf1jet qrXLLNX1 true 1 2 3 4 3.14 6.28 5.99 NULL 2014-09-01 its a beautiful day in the neighbhorhood a beautiful day for a neighbor wont you be mine true +PREHOOK: query: update acid_uat set + ti = ti * 2, + si = cast(f as int), + d = floor(de) + where s = 'aw724t8c5558x2xneC624' +PREHOOK: type: QUERY +PREHOOK: Input: default@acid_uat +PREHOOK: Output: default@acid_uat +POSTHOOK: query: update acid_uat set + ti = ti * 2, + si = cast(f as int), + d = floor(de) + where s = 'aw724t8c5558x2xneC624' +POSTHOOK: type: QUERY +POSTHOOK: Input: default@acid_uat +POSTHOOK: Output: default@acid_uat +PREHOOK: query: select * from acid_uat order by i +PREHOOK: type: QUERY +PREHOOK: Input: default@acid_uat +#### A masked pattern was here #### +POSTHOOK: query: select * from acid_uat order by i +POSTHOOK: type: QUERY +POSTHOOK: Input: default@acid_uat +#### A masked pattern was here #### +11 NULL -1073279343 -1595604468 11.0 NULL 11.0 1969-12-31 16:00:02.351 NULL oj1YrV5Wa oj1YrV5Wa P76636jJ6qM17d7DIy true +NULL -7382 -1073051226 -1887561756 NULL -7382.0 NULL NULL 1970-01-01 A34p7oRr2WvUJNf A34p7oRr2WvUJNf 4hA4KQj2vD3fI6gX82220d false +11 NULL -1072910839 2048385991 11.0 NULL 11.0 1969-12-31 16:00:02.351 NULL 0iqrc5 0iqrc5 KbaDXiN85adbHRx58v false +NULL 8373 -1072081801 1864027286 NULL 8373.0 NULL NULL 1970-01-01 dPkN74F7 dPkN74F7 4KWs6gw7lv2WYd66P true +NULL -5470 -1072076362 1864027286 NULL -5470.0 NULL NULL 1970-01-01 2uLyD28144vklju213J1mr 2uLyD28144vklju213J1mr 4KWs6gw7lv2WYd66P true +-102 -51 -1071480828 -1401575336 -51.0 -51.0 -51.0 1969-12-31 16:00:08.451 NULL aw724t8c5558x2xneC624 aw724t8c5558x2xneC624 4uE7l74tESBiKfu7c8wM7GA true +8 NULL -1071363017 1349676361 8.0 NULL 8.0 1969-12-31 16:00:15.892 NULL Anj0oF Anj0oF IwE1G7Qb0B1NEfV030g true +NULL -947 -1070551679 1864027286 NULL -947.0 NULL NULL 1970-01-01 iUR3Q iUR3Q 4KWs6gw7lv2WYd66P false +11 NULL -1069736047 -453772520 11.0 NULL 11.0 1969-12-31 16:00:02.351 NULL k17Am8uPHWk02cEf1jet k17Am8uPHWk02cEf1jet qrXLLNX1 true +1 2 3 4 3.14 6.28 5.99 NULL 2014-09-01 its a beautiful day in the neighbhorhood a beautiful day for a neighbor wont you be mine true Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_tmp_table.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_tmp_table.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_tmp_table.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_tmp_table.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_utt(a int, b varchar(128)) clustered by (b) into 2 buckets stored as orc +PREHOOK: query: create table acid_utt(a int, b varchar(128)) clustered by (b) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_utt -POSTHOOK: query: create table acid_utt(a int, b varchar(128)) clustered by (b) into 2 buckets stored as orc +POSTHOOK: query: create table acid_utt(a int, b varchar(128)) clustered by (b) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_utt Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_two_cols.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_two_cols.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_two_cols.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_two_cols.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_utc(a int, b varchar(128), c float) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_utc(a int, b varchar(128), c float) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_utc -POSTHOOK: query: create table acid_utc(a int, b varchar(128), c float) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_utc(a int, b varchar(128), c float) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_utc Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_no_match.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_no_match.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_no_match.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_no_match.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_wnm(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_wnm(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_wnm -POSTHOOK: query: create table acid_wnm(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_wnm(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_wnm Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_non_partitioned.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_non_partitioned.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_non_partitioned.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_non_partitioned.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_uwnp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_uwnp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uwnp -POSTHOOK: query: create table acid_uwnp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_uwnp(a int, b varchar(128)) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uwnp Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_partitioned.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_partitioned.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_partitioned.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/update_where_partitioned.q.out Mon Oct 6 04:00:39 2014 @@ -1,8 +1,8 @@ -PREHOOK: query: create table acid_uwp(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc +PREHOOK: query: create table acid_uwp(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@acid_uwp -POSTHOOK: query: create table acid_uwp(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc +POSTHOOK: query: create table acid_uwp(a int, b varchar(128)) partitioned by (ds string) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true') POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@acid_uwp Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_char_simple.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_char_simple.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_char_simple.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_char_simple.q.out Mon Oct 6 04:00:39 2014 @@ -234,3 +234,109 @@ POSTHOOK: query: drop table char_2 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@char_2 POSTHOOK: Output: default@char_2 +PREHOOK: query: -- Implicit conversion. Occurs in reduce-side under Tez. +create table char_3 ( + field char(12) +) stored as orc +PREHOOK: type: CREATETABLE +PREHOOK: Output: database:default +PREHOOK: Output: default@char_3 +POSTHOOK: query: -- Implicit conversion. Occurs in reduce-side under Tez. +create table char_3 ( + field char(12) +) stored as orc +POSTHOOK: type: CREATETABLE +POSTHOOK: Output: database:default +POSTHOOK: Output: default@char_3 +PREHOOK: query: explain +insert into table char_3 select cint from alltypesorc limit 10 +PREHOOK: type: QUERY +POSTHOOK: query: explain +insert into table char_3 select cint from alltypesorc limit 10 +POSTHOOK: type: QUERY +STAGE DEPENDENCIES: + Stage-1 is a root stage + Stage-2 depends on stages: Stage-1 + Stage-0 depends on stages: Stage-2 + Stage-3 depends on stages: Stage-0 + +STAGE PLANS: + Stage: Stage-1 + Tez + Edges: + Reducer 2 <- Map 1 (SIMPLE_EDGE) +#### A masked pattern was here #### + Vertices: + Map 1 + Map Operator Tree: + TableScan + alias: alltypesorc + Statistics: Num rows: 12288 Data size: 377237 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: cint (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 12288 Data size: 377237 Basic stats: COMPLETE Column stats: NONE + Limit + Number of rows: 10 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + sort order: + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + value expressions: _col0 (type: int) + Execution mode: vectorized + Reducer 2 + Reduce Operator Tree: + Select Operator + expressions: VALUE._col0 (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Limit + Number of rows: 10 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: CAST( _col0 AS CHAR(12) (type: char(12)) + outputColumnNames: _col0 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + File Output Operator + compressed: false + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + table: + input format: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat + output format: org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat + serde: org.apache.hadoop.hive.ql.io.orc.OrcSerde + name: default.char_3 + Execution mode: vectorized + + Stage: Stage-2 + Dependency Collection + + Stage: Stage-0 + Move Operator + tables: + replace: false + table: + input format: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat + output format: org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat + serde: org.apache.hadoop.hive.ql.io.orc.OrcSerde + name: default.char_3 + + Stage: Stage-3 + Stats-Aggr Operator + +PREHOOK: query: insert into table char_3 select cint from alltypesorc limit 10 +PREHOOK: type: QUERY +PREHOOK: Input: default@alltypesorc +PREHOOK: Output: default@char_3 +POSTHOOK: query: insert into table char_3 select cint from alltypesorc limit 10 +POSTHOOK: type: QUERY +POSTHOOK: Input: default@alltypesorc +POSTHOOK: Output: default@char_3 +POSTHOOK: Lineage: char_3.field EXPRESSION [(alltypesorc)alltypesorc.FieldSchema(name:cint, type:int, comment:null), ] +PREHOOK: query: drop table char_3 +PREHOOK: type: DROPTABLE +PREHOOK: Input: default@char_3 +PREHOOK: Output: default@char_3 +POSTHOOK: query: drop table char_3 +POSTHOOK: type: DROPTABLE +POSTHOOK: Input: default@char_3 +POSTHOOK: Output: default@char_3 Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_decimal_aggregate.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_decimal_aggregate.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_decimal_aggregate.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_decimal_aggregate.q.out Mon Oct 6 04:00:39 2014 @@ -113,7 +113,7 @@ POSTHOOK: query: SELECT cint, POSTHOOK: type: QUERY POSTHOOK: Input: default@decimal_vgby #### A masked pattern was here #### -0 3072 9318.4351351351 -4298.1513513514 5018444.1081079808 3072 11160.71538461538500 -5147.90769230769300 6010604.30769230735360 +NULL 3072 9318.4351351351 -4298.1513513514 5018444.1081079808 3072 11160.71538461538500 -5147.90769230769300 6010604.30769230735360 -3728 6 5831542.2692483780 -3367.6517567568 5817556.0411483778 6 6984454.21109769200000 -4033.445769230769 6967702.86724384584710 -563 2 -515.6210729730 -3367.6517567568 -3883.2728297298 2 -617.56077692307690 -4033.445769230769 -4651.00654615384590 762 2 5831542.2692483780 1531.2194054054 5833073.4886537834 2 6984454.21109769200000 1833.9456923076925 6986288.15678999969250 Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_left_outer_join.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_left_outer_join.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_left_outer_join.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_left_outer_join.q.out Mon Oct 6 04:00:39 2014 @@ -54,6 +54,8 @@ STAGE PLANS: 0 cint (type: int) 1 cint (type: int) outputColumnNames: _col0 + input vertices: + 1 Map 4 Statistics: Num rows: 13516 Data size: 414960 Basic stats: COMPLETE Column stats: NONE Map Join Operator condition map: @@ -64,6 +66,8 @@ STAGE PLANS: keys: 0 _col0 (type: tinyint) 1 ctinyint (type: tinyint) + input vertices: + 1 Map 1 Statistics: Num rows: 14867 Data size: 456456 Basic stats: COMPLETE Column stats: NONE Select Operator Statistics: Num rows: 14867 Data size: 456456 Basic stats: COMPLETE Column stats: NONE Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out Mon Oct 6 04:00:39 2014 @@ -204,6 +204,8 @@ STAGE PLANS: 0 _col0 (type: int) 1 l_partkey (type: int) outputColumnNames: _col0, _col1, _col3 + input vertices: + 1 Map 1 Statistics: Num rows: 831 Data size: 3326 Basic stats: COMPLETE Column stats: NONE Map Join Operator condition map: @@ -215,6 +217,8 @@ STAGE PLANS: 0 _col1 (type: int) 1 _col0 (type: int) outputColumnNames: _col0, _col3 + input vertices: + 1 Map 4 Statistics: Num rows: 914 Data size: 3658 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: int), _col3 (type: int) @@ -363,6 +367,8 @@ STAGE PLANS: 0 _col0 (type: int) 1 l_partkey (type: int) outputColumnNames: _col0, _col1, _col3 + input vertices: + 1 Map 1 Statistics: Num rows: 831 Data size: 3326 Basic stats: COMPLETE Column stats: NONE Map Join Operator condition map: @@ -374,6 +380,8 @@ STAGE PLANS: 0 _col1 (type: int), 1 (type: int) 1 _col0 (type: int), _col1 (type: int) outputColumnNames: _col0, _col3 + input vertices: + 1 Map 4 Statistics: Num rows: 914 Data size: 3658 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: int), _col3 (type: int) Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_varchar_simple.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_varchar_simple.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_varchar_simple.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vector_varchar_simple.q.out Mon Oct 6 04:00:39 2014 @@ -1,31 +1,31 @@ -PREHOOK: query: drop table char_2 +PREHOOK: query: drop table varchar_2 PREHOOK: type: DROPTABLE -POSTHOOK: query: drop table char_2 +POSTHOOK: query: drop table varchar_2 POSTHOOK: type: DROPTABLE -PREHOOK: query: create table char_2 ( +PREHOOK: query: create table varchar_2 ( key varchar(10), value varchar(20) ) stored as orc PREHOOK: type: CREATETABLE PREHOOK: Output: database:default -PREHOOK: Output: default@char_2 -POSTHOOK: query: create table char_2 ( +PREHOOK: Output: default@varchar_2 +POSTHOOK: query: create table varchar_2 ( key varchar(10), value varchar(20) ) stored as orc POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default -POSTHOOK: Output: default@char_2 -PREHOOK: query: insert overwrite table char_2 select * from src +POSTHOOK: Output: default@varchar_2 +PREHOOK: query: insert overwrite table varchar_2 select * from src PREHOOK: type: QUERY PREHOOK: Input: default@src -PREHOOK: Output: default@char_2 -POSTHOOK: query: insert overwrite table char_2 select * from src +PREHOOK: Output: default@varchar_2 +POSTHOOK: query: insert overwrite table varchar_2 select * from src POSTHOOK: type: QUERY POSTHOOK: Input: default@src -POSTHOOK: Output: default@char_2 -POSTHOOK: Lineage: char_2.key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), ] -POSTHOOK: Lineage: char_2.value EXPRESSION [(src)src.FieldSchema(name:value, type:string, comment:default), ] +POSTHOOK: Output: default@varchar_2 +POSTHOOK: Lineage: varchar_2.key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), ] +POSTHOOK: Lineage: varchar_2.value EXPRESSION [(src)src.FieldSchema(name:value, type:string, comment:default), ] PREHOOK: query: select key, value from src order by key asc @@ -46,12 +46,12 @@ POSTHOOK: Input: default@src 10 val_10 100 val_100 PREHOOK: query: explain select key, value -from char_2 +from varchar_2 order by key asc limit 5 PREHOOK: type: QUERY POSTHOOK: query: explain select key, value -from char_2 +from varchar_2 order by key asc limit 5 POSTHOOK: type: QUERY @@ -69,7 +69,7 @@ STAGE PLANS: Map 1 Map Operator Tree: TableScan - alias: char_2 + alias: varchar_2 Statistics: Num rows: 500 Data size: 88000 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: key (type: varchar(10)), value (type: varchar(20)) @@ -107,19 +107,19 @@ STAGE PLANS: PREHOOK: query: -- should match the query from src select key, value -from char_2 +from varchar_2 order by key asc limit 5 PREHOOK: type: QUERY -PREHOOK: Input: default@char_2 +PREHOOK: Input: default@varchar_2 #### A masked pattern was here #### POSTHOOK: query: -- should match the query from src select key, value -from char_2 +from varchar_2 order by key asc limit 5 POSTHOOK: type: QUERY -POSTHOOK: Input: default@char_2 +POSTHOOK: Input: default@varchar_2 #### A masked pattern was here #### 0 val_0 0 val_0 @@ -146,12 +146,12 @@ POSTHOOK: Input: default@src 97 val_97 96 val_96 PREHOOK: query: explain select key, value -from char_2 +from varchar_2 order by key desc limit 5 PREHOOK: type: QUERY POSTHOOK: query: explain select key, value -from char_2 +from varchar_2 order by key desc limit 5 POSTHOOK: type: QUERY @@ -169,7 +169,7 @@ STAGE PLANS: Map 1 Map Operator Tree: TableScan - alias: char_2 + alias: varchar_2 Statistics: Num rows: 500 Data size: 88000 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: key (type: varchar(10)), value (type: varchar(20)) @@ -207,30 +207,136 @@ STAGE PLANS: PREHOOK: query: -- should match the query from src select key, value -from char_2 +from varchar_2 order by key desc limit 5 PREHOOK: type: QUERY -PREHOOK: Input: default@char_2 +PREHOOK: Input: default@varchar_2 #### A masked pattern was here #### POSTHOOK: query: -- should match the query from src select key, value -from char_2 +from varchar_2 order by key desc limit 5 POSTHOOK: type: QUERY -POSTHOOK: Input: default@char_2 +POSTHOOK: Input: default@varchar_2 #### A masked pattern was here #### 98 val_98 98 val_98 97 val_97 97 val_97 96 val_96 -PREHOOK: query: drop table char_2 +PREHOOK: query: drop table varchar_2 PREHOOK: type: DROPTABLE -PREHOOK: Input: default@char_2 -PREHOOK: Output: default@char_2 -POSTHOOK: query: drop table char_2 +PREHOOK: Input: default@varchar_2 +PREHOOK: Output: default@varchar_2 +POSTHOOK: query: drop table varchar_2 POSTHOOK: type: DROPTABLE -POSTHOOK: Input: default@char_2 -POSTHOOK: Output: default@char_2 +POSTHOOK: Input: default@varchar_2 +POSTHOOK: Output: default@varchar_2 +PREHOOK: query: -- Implicit conversion. Occurs in reduce-side under Tez. +create table varchar_3 ( + field varchar(25) +) stored as orc +PREHOOK: type: CREATETABLE +PREHOOK: Output: database:default +PREHOOK: Output: default@varchar_3 +POSTHOOK: query: -- Implicit conversion. Occurs in reduce-side under Tez. +create table varchar_3 ( + field varchar(25) +) stored as orc +POSTHOOK: type: CREATETABLE +POSTHOOK: Output: database:default +POSTHOOK: Output: default@varchar_3 +PREHOOK: query: explain +insert into table varchar_3 select cint from alltypesorc limit 10 +PREHOOK: type: QUERY +POSTHOOK: query: explain +insert into table varchar_3 select cint from alltypesorc limit 10 +POSTHOOK: type: QUERY +STAGE DEPENDENCIES: + Stage-1 is a root stage + Stage-2 depends on stages: Stage-1 + Stage-0 depends on stages: Stage-2 + Stage-3 depends on stages: Stage-0 + +STAGE PLANS: + Stage: Stage-1 + Tez + Edges: + Reducer 2 <- Map 1 (SIMPLE_EDGE) +#### A masked pattern was here #### + Vertices: + Map 1 + Map Operator Tree: + TableScan + alias: alltypesorc + Statistics: Num rows: 12288 Data size: 377237 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: cint (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 12288 Data size: 377237 Basic stats: COMPLETE Column stats: NONE + Limit + Number of rows: 10 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + sort order: + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + value expressions: _col0 (type: int) + Execution mode: vectorized + Reducer 2 + Reduce Operator Tree: + Select Operator + expressions: VALUE._col0 (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Limit + Number of rows: 10 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: CAST( _col0 AS varchar(25)) (type: varchar(25)) + outputColumnNames: _col0 + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + File Output Operator + compressed: false + Statistics: Num rows: 10 Data size: 300 Basic stats: COMPLETE Column stats: NONE + table: + input format: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat + output format: org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat + serde: org.apache.hadoop.hive.ql.io.orc.OrcSerde + name: default.varchar_3 + Execution mode: vectorized + + Stage: Stage-2 + Dependency Collection + + Stage: Stage-0 + Move Operator + tables: + replace: false + table: + input format: org.apache.hadoop.hive.ql.io.orc.OrcInputFormat + output format: org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat + serde: org.apache.hadoop.hive.ql.io.orc.OrcSerde + name: default.varchar_3 + + Stage: Stage-3 + Stats-Aggr Operator + +PREHOOK: query: insert into table varchar_3 select cint from alltypesorc limit 10 +PREHOOK: type: QUERY +PREHOOK: Input: default@alltypesorc +PREHOOK: Output: default@varchar_3 +POSTHOOK: query: insert into table varchar_3 select cint from alltypesorc limit 10 +POSTHOOK: type: QUERY +POSTHOOK: Input: default@alltypesorc +POSTHOOK: Output: default@varchar_3 +POSTHOOK: Lineage: varchar_3.field EXPRESSION [(alltypesorc)alltypesorc.FieldSchema(name:cint, type:int, comment:null), ] +PREHOOK: query: drop table varchar_3 +PREHOOK: type: DROPTABLE +PREHOOK: Input: default@varchar_3 +PREHOOK: Output: default@varchar_3 +POSTHOOK: query: drop table varchar_3 +POSTHOOK: type: DROPTABLE +POSTHOOK: Input: default@varchar_3 +POSTHOOK: Output: default@varchar_3 Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_mapjoin.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_mapjoin.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_mapjoin.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_mapjoin.q.out Mon Oct 6 04:00:39 2014 @@ -50,6 +50,8 @@ STAGE PLANS: 0 cint (type: int) 1 cint (type: int) outputColumnNames: _col2, _col17 + input vertices: + 1 Map 1 Statistics: Num rows: 6758 Data size: 207479 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col2 (type: int), _col17 (type: int) Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_nested_mapjoin.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_nested_mapjoin.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_nested_mapjoin.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_nested_mapjoin.q.out Mon Oct 6 04:00:39 2014 @@ -33,6 +33,8 @@ STAGE PLANS: 0 _col0 (type: smallint) 1 csmallint (type: smallint) outputColumnNames: _col1 + input vertices: + 0 Map 4 Statistics: Num rows: 6758 Data size: 207479 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col1 (type: double) @@ -81,6 +83,8 @@ STAGE PLANS: 0 ctinyint (type: tinyint) 1 ctinyint (type: tinyint) outputColumnNames: _col0, _col1, _col5, _col15 + input vertices: + 0 Map 3 Statistics: Num rows: 6758 Data size: 207479 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (_col0 = _col15) (type: boolean) Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== Files hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out Mon Oct 6 04:00:39 2014 differ Modified: hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_shufflejoin.q.out URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_shufflejoin.q.out?rev=1629563&r1=1629562&r2=1629563&view=diff ============================================================================== --- hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_shufflejoin.q.out (original) +++ hive/branches/spark/ql/src/test/results/clientpositive/tez/vectorized_shufflejoin.q.out Mon Oct 6 04:00:39 2014 @@ -48,7 +48,7 @@ STAGE PLANS: Execution mode: vectorized Reducer 2 Reduce Operator Tree: - Join Operator + Merge Join Operator condition map: Inner Join 0 to 1 condition expressions: