hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jeff little (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator
Date Thu, 10 Oct 2013 08:57:44 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

jeff little updated HIVE-5245:
------------------------------

    Description: 
hello everyone, recently i came across one hive problem as below:
hive (test)> create table test_09 as
           > select a.* from test_01 a
           > join test_02 b
           > on (a.id=b.id);
Automatically selecting local only mode for query
Total MapReduce jobs = 2
setting HADOOP_USER_NAME        hadoop
13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
Execution log at: /tmp/hadoop/.log
2013-09-09 05:22:36     Starting to launch local task to process map join;      maximum memory
= 932118528
2013-09-09 05:22:37     Processing rows:        4       Hashtable size: 4       Memory usage:
  113068056       rate:   0.121
2013-09-09 05:22:37     Dump the hashtable into file: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
2013-09-09 05:22:37     Upload 1 File to: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
File size: 788
2013-09-09 05:22:37     End of local task; Time Taken: 0.444 sec.
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Mapred Local Task Succeeded . Convert the Join into MapJoin
Launching Job 1 out of 2
Number of reduce tasks is set to 0 since there's no reduce operator
13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
Execution log at: /tmp/hadoop/.log
Job running in-process (local Hadoop)
Hadoop job information for null: number of mappers: 0; number of reducers: 0
2013-09-09 17:22:41,807 null map = 0%,  reduce = 0%
2013-09-09 17:22:44,814 null map = 100%,  reduce = 0%
Ended Job = job_local_0001
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Stage-7 is filtered out by condition resolver.
OK
Time taken: 13.138 seconds
hive (test)> select * from test_09;
FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'test_09'
hive (test)>
Problem:
I can't get the created table, namely this CTAS is nonavailable, and this table is not created
by this hql sentence at all.who can explain for me.Thanks.

  was:
hello everyone, recently i came across one hive problem as below:
hive (test)> create table test_09 as
           > select a.* from test_01 a
           > join test_02 b
           > on (a.id=b.id);
Automatically selecting local only mode for query
Total MapReduce jobs = 2
setting HADOOP_USER_NAME        hadoop
13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
Execution log at: /tmp/hadoop/.log
2013-09-09 05:22:36     Starting to launch local task to process map join;      maximum memory
= 932118528
2013-09-09 05:22:37     Processing rows:        4       Hashtable size: 4       Memory usage:
  113068056       rate:   0.121
2013-09-09 05:22:37     Dump the hashtable into file: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
2013-09-09 05:22:37     Upload 1 File to: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
File size: 788
2013-09-09 05:22:37     End of local task; Time Taken: 0.444 sec.
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Mapred Local Task Succeeded . Convert the Join into MapJoin
Launching Job 1 out of 2
Number of reduce tasks is set to 0 since there's no reduce operator
13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
Execution log at: /tmp/hadoop/.log
Job running in-process (local Hadoop)
Hadoop job information for null: number of mappers: 0; number of reducers: 0
2013-09-09 17:22:41,807 null map = 0%,  reduce = 0%
2013-09-09 17:22:44,814 null map = 100%,  reduce = 0%
Ended Job = job_local_0001
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Stage-7 is filtered out by condition resolver.
OK
Time taken: 13.138 seconds
hive (test)> select * from test_08;
FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'test_08'
hive (test)>
Problem:
I can't get the created table, namely this CTAS is nonavailable, and this table is not created
by this hql sentence at all.who can explain for me.Thanks.


> hive create table as select(CTAS) can not work(not support) with join on operator
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-5245
>                 URL: https://issues.apache.org/jira/browse/HIVE-5245
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 0.11.0
>            Reporter: jeff little
>              Labels: CTAS, hive
>   Original Estimate: 96h
>  Remaining Estimate: 96h
>
> hello everyone, recently i came across one hive problem as below:
> hive (test)> create table test_09 as
>            > select a.* from test_01 a
>            > join test_02 b
>            > on (a.id=b.id);
> Automatically selecting local only mode for query
> Total MapReduce jobs = 2
> setting HADOOP_USER_NAME        hadoop
> 13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
> 13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
> Execution log at: /tmp/hadoop/.log
> 2013-09-09 05:22:36     Starting to launch local task to process map join;      maximum
memory = 932118528
> 2013-09-09 05:22:37     Processing rows:        4       Hashtable size: 4       Memory
usage:   113068056       rate:   0.121
> 2013-09-09 05:22:37     Dump the hashtable into file: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
> 2013-09-09 05:22:37     Upload 1 File to: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
File size: 788
> 2013-09-09 05:22:37     End of local task; Time Taken: 0.444 sec.
> Execution completed successfully
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Launching Job 1 out of 2
> Number of reduce tasks is set to 0 since there's no reduce operator
> 13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.system.dir;  Ignoring.
> 13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
attempt to override final parameter: mapred.local.dir;  Ignoring.
> Execution log at: /tmp/hadoop/.log
> Job running in-process (local Hadoop)
> Hadoop job information for null: number of mappers: 0; number of reducers: 0
> 2013-09-09 17:22:41,807 null map = 0%,  reduce = 0%
> 2013-09-09 17:22:44,814 null map = 100%,  reduce = 0%
> Ended Job = job_local_0001
> Execution completed successfully
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Stage-7 is filtered out by condition resolver.
> OK
> Time taken: 13.138 seconds
> hive (test)> select * from test_09;
> FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'test_09'
> hive (test)>
> Problem:
> I can't get the created table, namely this CTAS is nonavailable, and this table is not
created by this hql sentence at all.who can explain for me.Thanks.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message