hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankit Modi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1107) PigLineRecordReader bails out on an empty line for compressed data
Date Thu, 26 Nov 2009 01:15:39 GMT

     [ https://issues.apache.org/jira/browse/PIG-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ankit Modi updated PIG-1107:
----------------------------

    Attachment: pig_piglinerecordreader_bug.patch

Submitting a small patch. It has 2 new unit tests for the patch applied.

> PigLineRecordReader bails out on an empty line for compressed data
> ------------------------------------------------------------------
>
>                 Key: PIG-1107
>                 URL: https://issues.apache.org/jira/browse/PIG-1107
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0
>            Reporter: Ankit Modi
>            Assignee: Ankit Modi
>             Fix For: 0.6.0
>
>         Attachments: pig_piglinerecordreader_bug.patch
>
>
> PigLineRecordReader bails out with an exception when it encounters an empty line in a
compressed file
> java.lang.ArrayIndexOutOfBoundsException: -1
>        at org.apache.pig.impl.io.PigLineRecordReader$LineReader.getNext(PigLineRecordReader.java:136)
>         at org.apache.pig.impl.io.PigLineRecordReader.next(PigLineRecordReader.java:57)
>         at org.apache.pig.builtin.PigStorage.getNext(PigStorage.java:121)
>         at org.apache.pig.backend.executionengine.PigSlice.next(PigSlice.java:139)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SliceWrapper$1.next(SliceWrapper.java:164)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SliceWrapper$1.next(SliceWrapper.java:140)
>         at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:192)
>         at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:176)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message