hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-316) Error storing aggregate function output
Date Tue, 15 Jul 2008 17:45:31 GMT

    [ https://issues.apache.org/jira/browse/PIG-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12613675#action_12613675
] 

Pradeep Kamath commented on PIG-316:
------------------------------------

My mistake - I meant to do store c - and it did work with that change

> Error storing aggregate function output
> ---------------------------------------
>
>                 Key: PIG-316
>                 URL: https://issues.apache.org/jira/browse/PIG-316
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Pradeep Kamath
>             Fix For: types_branch
>
>
> Query which causes error:
> {code}
> a = load ':INPATH:/singlefile/studenttab10k' as (name:chararray, age:int, gpa:double);
> b = group a ALL;
> c = foreach b generate SUM(a.age), MIN(a.name), MIN(a.age), MAX(a.name), MAX(a.age),
AVG(a.age), AVG(a.gpa), COUNT(a.age);
> store b into ':OUTPATH:';
> {code}
> Error:
> {quote}
> 2008-07-14 16:34:44,328 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Connecting to hadoop file system at: mytesthost:8020
> 2008-07-14 16:34:44,384 [main] WARN  org.apache.hadoop.fs.FileSystem - "mytesthost:8020"
is a deprecated filesystem name. Use "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:44,638 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Connecting to map-reduce job tracker at: mytesthost:50020
> 2008-07-14 16:34:44,895 [main] WARN  org.apache.hadoop.fs.FileSystem - "mytesthost:8020"
is a deprecated filesystem name. Use "hdfs://mytesthost:8020/" instead.
> store file is /user/pig/tests/results/pradeepk.1216078420/Types_7.out:org.apache.pig.builtin.PigStorage
> 2008-07-14 16:34:46,780 [main] WARN  org.apache.hadoop.fs.FileSystem - "mytesthost:8020"
is a deprecated filesystem name. Use "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:46,892 [Thread-9] WARN  org.apache.hadoop.fs.FileSystem - "mytesthost:8020"
is a deprecated filesystem name. Use "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:47,157 [Thread-9] WARN  org.apache.hadoop.fs.FileSystem - "mytesthost:8020"
is a deprecated filesystem name. Use "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:47,357 [main] INFO  org.apache.pig.impl.mapReduceLayer.Launcher - 0.0%
complete
> 2008-07-14 16:34:50,938 [main] INFO  org.apache.pig.impl.mapReduceLayer.Launcher - 50.0%
complete
> 2008-07-14 16:36:02,180 [main] INFO  org.apache.pig.impl.mapReduceLayer.Launcher - 83.33480060100555%
complete
> 2008-07-14 16:36:07,732 [main] INFO  org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful
attempt. Completed 0.0% of the job
> 2008-07-14 16:36:07,747 [main] ERROR org.apache.pig.impl.mapReduceLayer.Launcher - Error
message from task (map) tip_200807081132_0526_m_000000
> 2008-07-14 16:36:07,750 [main] ERROR org.apache.pig.impl.mapReduceLayer.Launcher - Error
message from task (reduce) tip_200807081132_0526_r_000000 java.io.IOException: Cannot store
a non-flat tuple using PigStorage
>     at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>     at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
>     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
>     at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
>  java.io.IOException: Cannot store a non-flat tuple using PigStorage
>     at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>     at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)

>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
>     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
>     at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
>  java.io.IOException: Cannot store a non-flat tuple using PigStorage
>     at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>     at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
>     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
>     at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
>  java.io.IOException: Cannot store a non-flat tuple using PigStorage
>     at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
>     at org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>     at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
>     at org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
>     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
>     at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
> {quote}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message