hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milind Bhandarkar (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-1196) StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark
Date Thu, 25 Oct 2007 22:27:51 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Milind Bhandarkar resolved HADOOP-1196.
---------------------------------------

    Resolution: Duplicate

Duplicate of HADOOP-2071.

> StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-1196
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1196
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>         Environment: Suse Linux 64bit, JDK 1.6, Hadoop 0.12.2, 25 node cluster.
>            Reporter: Seetharam Venkatesh
>
> I encounter this error consistently whenever I have over 500 maps in my job.  I read
XML feeds with about 200,000 documents in each, parse and index the document. I get the following
exception.
> java.io.IOException: Resetting to invalid mark
> 	at java.io.BufferedInputStream.reset(BufferedInputStream.java:416)
> 	at java.io.FilterInputStream.reset(FilterInputStream.java:200)
> 	at org.apache.hadoop.streaming.StreamXmlRecordReader.fastReadUntilMatch(StreamXmlRecordReader.java:291)
> 	at org.apache.hadoop.streaming.StreamXmlRecordReader.readUntilMatchBegin(StreamXmlRecordReader.java:120)
> 	at org.apache.hadoop.streaming.StreamXmlRecordReader.seekNextRecordBoundary(StreamXmlRecordReader.java:113)
> 	at org.apache.hadoop.streaming.StreamXmlRecordReader.init(StreamXmlRecordReader.java:75)
> 	at org.apache.hadoop.streaming.StreamXmlRecordReader.(StreamXmlRecordReader.java:65)
> 	at com.gale.searchng.workflow.fetcher.DocFetcherParser$XmlInputFormat.getRecordReader(DocFetcherParser.java:231)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> 	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message