Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 39894 invoked from network); 1 Jun 2007 21:05:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 1 Jun 2007 21:05:38 -0000 Received: (qmail 32942 invoked by uid 500); 1 Jun 2007 21:05:41 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 32797 invoked by uid 500); 1 Jun 2007 21:05:40 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 32787 invoked by uid 99); 1 Jun 2007 21:05:40 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jun 2007 14:05:40 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jun 2007 14:05:36 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 1336B71418E for ; Fri, 1 Jun 2007 14:05:16 -0700 (PDT) Message-ID: <7527885.1180731916076.JavaMail.jira@brutus> Date: Fri, 1 Jun 2007 14:05:16 -0700 (PDT) From: "Sameer Paranjpye (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-1196) StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark In-Reply-To: <13536666.1175614112323.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-1196: ------------------------------------- Component/s: contrib/streaming Priority: Major (was: Blocker) > StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark > --------------------------------------------------------------------------- > > Key: HADOOP-1196 > URL: https://issues.apache.org/jira/browse/HADOOP-1196 > Project: Hadoop > Issue Type: Bug > Components: contrib/streaming > Environment: Suse Linux 64bit, JDK 1.6, Hadoop 0.12.2, 25 node cluster. > Reporter: Seetharam Venkatesh > > I encounter this error consistently whenever I have over 500 maps in my job. I read XML feeds with about 200,000 documents in each, parse and index the document. I get the following exception. > java.io.IOException: Resetting to invalid mark > at java.io.BufferedInputStream.reset(BufferedInputStream.java:416) > at java.io.FilterInputStream.reset(FilterInputStream.java:200) > at org.apache.hadoop.streaming.StreamXmlRecordReader.fastReadUntilMatch(StreamXmlRecordReader.java:291) > at org.apache.hadoop.streaming.StreamXmlRecordReader.readUntilMatchBegin(StreamXmlRecordReader.java:120) > at org.apache.hadoop.streaming.StreamXmlRecordReader.seekNextRecordBoundary(StreamXmlRecordReader.java:113) > at org.apache.hadoop.streaming.StreamXmlRecordReader.init(StreamXmlRecordReader.java:75) > at org.apache.hadoop.streaming.StreamXmlRecordReader.(StreamXmlRecordReader.java:65) > at com.gale.searchng.workflow.fetcher.DocFetcherParser$XmlInputFormat.getRecordReader(DocFetcherParser.java:231) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.