hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-527) Pig does not support storing nested data using default storage
Date Tue, 18 Nov 2008 03:13:44 GMT

     [ https://issues.apache.org/jira/browse/PIG-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Santhosh Srinivasan updated PIG-527:
------------------------------------

    Patch Info: [Patch Available]

> Pig does not support storing nested data using default storage
> --------------------------------------------------------------
>
>                 Key: PIG-527
>                 URL: https://issues.apache.org/jira/browse/PIG-527
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Santhosh Srinivasan
>            Assignee: Santhosh Srinivasan
>             Fix For: types_branch
>
>         Attachments: PIG-527.patch
>
>
> Pig does not allow storing nested data using the default storage function (PigStorage)
> {code}
> grunt> a = load 'student_tab.data' as (name, age, gpa);
> grunt> b = group a by age;
> grunt> store b into '/user/sms/data/complex.data';
> 2008-11-13 16:21:17,711 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 50% complete
> 2008-11-13 16:21:52,747 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Map reduce job failed
> 2008-11-13 16:21:52,747 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Job failed!
> 2008-11-13 16:21:52,764 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher
- Error message from task (reduce) task_200809241441_21188_r_000000java.io.IOException: Cannot
store a non-flat tuple using PigStorage
>         at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:196)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:116)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>         at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:300)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:238)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:224)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:136)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
> 2008-11-13 16:21:52,764 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher
- Error message from task (reduce) task_200809241441_21188_r_000000java.io.IOException: Cannot
store a non-flat tuple using PigStorage
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message