hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cam Bazz <camb...@gmail.com>
Subject trouble loading from raw data table to data table
Date Mon, 31 Jan 2011 14:19:05 GMT
Hello,

I just started hive today. Following instructions I did set it up, and
made it work to play with my web server log files.

I created two tables:

CREATE TABLE item_view(view_time BIGINT, ip_number STRING, session_id
STRING, session_cookie STRING, referrer_url STRING, eser_sid INT,
sale_status INT, maker_name STRING, title STRING) CLUSTERED
BY(eser_sid) SORTED BY(view_time) INTO 32 BUCKETS row format delimited
fields terminated by '\t' lines terminated  BY '\n' STORED AS
SEQUENCEFILE;

and

CREATE TABLE item_view_raw(view_time BIGINT,log_level STRING, log_tag
STRING, ip_number STRING, session_id STRING, session_cookie STRING,
referrer_url STRING, agent_string STRING, eser_sid INT, sale_status
INT, maker_name STRING, title STRING) row format delimited fields
terminated by '\t' lines terminated  BY '\n' STORED AS TEXTFILE;

then I load data into item_view_raw table:

LOAD DATA LOCAL INPATH '/tmp/prod.log' INTO TABLE item_view_raw;

whıch puts the data item_view_raw table.

this is the staging table, and i want to insert rows from it into my
item_view table so I:

FROM item_view_raw ivr INSERT OVERWRITE TABLE item_view SELECT
ivr.view_time, ivr.ip_number, ivr.session_id, ivr.session_cookie,
ivr.referrer_url, ivr.eser_sid, ivr.sale_status, ivr.maker_name,
ivr.title;

but I get:

Total MapReduce jobs = 2
Launching Job 1 out of 2
Number of reduce tasks is set to 0 since there's no reduce operator
java.io.IOException: Call to /192.168.1.10:50030 failed on local
exception: java.io.EOFException
	at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
	at org.apache.hadoop.ipc.Client.call(Client.java:743)
	at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
	at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
	at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
	at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:429)
	at org.apache.hadoop.mapred.JobClient.init(JobClient.java:423)
	at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:410)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:683)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:633)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:506)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:384)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:302)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.EOFException
	at java.io.DataInputStream.readInt(DataInputStream.java:375)
	at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
Job Submission failed with exception 'java.io.IOException(Call to
/192.168.1.10:50030 failed on local exception: java.io.EOFException)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.ExecDriver

I did fiddle with it for couple of hours, then I decided to write to
this list. no matter what I tried i could not solve the problem.

Any ideas, recomendations and help greatly appreciated,
-C.B.

Mime
View raw message