Return-Path: 
 <user-return-12960-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-user-archive@www.apache.org
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id E1F6810BAD
	for <apmail-hadoop-common-user-archive@www.apache.org>;
 Fri,  3 Jan 2014 09:22:35 +0000 (UTC)
Received: (qmail 12337 invoked by uid 500); 3 Jan 2014 09:22:20 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 12246 invoked by uid 500); 3 Jan 2014 09:22:19 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 12236 invoked by uid 99); 3 Jan 2014 09:22:18 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 09:22:18 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of ranjinibecse@gmail.com
 designates 209.85.217.180 as permitted sender)
Received: from [209.85.217.180] (HELO mail-lb0-f180.google.com)
 (209.85.217.180)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 09:22:11 +0000
Received: by mail-lb0-f180.google.com with SMTP id x18so7768106lbi.25
        for <user@hadoop.apache.org>; Fri, 03 Jan 2014 01:21:51 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=6vYd5JFFBUnIZUxbzrMnujmz5SA8iSBa2GKWexgoNmk=;
        b=wBsxe3ef4EeRnib4kwPfDEeCvbjpufB8k8d/8y+SCCh1obQPL5tvUPuwd9qGv1J2Yu
         uqHdYpPKtpFSIiDNt2TyLQwe3cY1Pi9is99h2mdyFblnfqfVzOMJhKdV80+QFjqFIepR
         wF9++gmWGDxrKtADYbuegvp6DpJUX9Bp61Ea1xzg5Q0XHvaJpFuTEhT8NWDwlzynDRgv
         AZPA65uXakW+YtAKYFdkNjd9qHTbB305+SD9dtzvCDj+1OS/RRj0zlH5NBsn5ln+IWgd
         rAjz9IHWraVznV3cVwZorn6O4WoAOGySc+o8qNvuzI7SRJhTSfgVWER1natXmnc+S/29
         tLUw==
MIME-Version: 1.0
X-Received: by 10.112.52.6 with SMTP id p6mr2105lbo.67.1388740911040; Fri, 03
 Jan 2014 01:21:51 -0800 (PST)
Received: by 10.152.131.165 with HTTP; Fri, 3 Jan 2014 01:21:50 -0800 (PST)
In-Reply-To: 
 <CALr1C9oYEZPAvbwFa12MLKF+MOscj5OMiyw1rhDD9d6=ycajLQ@mail.gmail.com>
References: 
 <CALGZSrBwZ6nHPnTZVvdbv9nJEuRkXwKTCJZKBTitmUTLfUnRkg@mail.gmail.com>
	<CALr1C9oYEZPAvbwFa12MLKF+MOscj5OMiyw1rhDD9d6=ycajLQ@mail.gmail.com>
Date: Fri, 3 Jan 2014 14:51:50 +0530
Message-ID: 
 <CALGZSrDCXKdKO1Hov+=-x0xo+iOoRb1+TvQaPosUZAqUKGDD9g@mail.gmail.com>
Subject: Re: XML to TEXT
From: Ranjini Rathinam <ranjinibecse@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c3cd4ab00dfc04ef0d7071
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11c3cd4ab00dfc04ef0d7071
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I used XMLInputFormat , in that i used  Record Reader class. Same as u have
given

THe whole xml is been split into part For Eg: consider the below xml

<Comp><Emp><id></id><name></name></Emp><Emp><id></id><name></name></Emp></Comp>

after using the RecordReader class the xml output is

<Emp><id></id><name></name></Emp><Emp><id></id><name></name></Emp>

the starting and end tag is Emp.

it does not convert into text.

Please suggest and help.

Thanks in advance

Ranjini

On Fri, Jan 3, 2014 at 11:22 AM, Azuryy Yu <azuryyyu@gmail.com> wrote:

>     Hi,
>
> you can use org.apache.hadoop.streaming.StreamInputFormat  using map
> reduce to convert XML to text.
>
> such as your xml like this:
> <xml>
>   <name>lll</name>
> </xml>
>
> you need to specify stream.recordreader.begin and stream.recordreader.end
> in the Configuration:
> Configuration conf = new Configuration();
> conf.set("stream.recordreader.begin", "<xml>");
> conf.set("stream.recordreader.end", "</xml>");
>
>
>
>
>
>
> On Fri, Jan 3, 2014 at 1:16 PM, Ranjini Rathinam <ranjinibecse@gmail.com>wrote:
>
>> Hi,
>>
>> Need to convert XML into text using mapreduce.
>>
>> I have used DOM and SAX parser.
>>
>> After using SAX Builder in mapper class. the child node act as root
>> Element.
>>
>> While seeing in Sys out i found thar root element is taking the child
>> element and printing.
>>
>> For Eg,
>>
>> <Comp><Emp><id>100</id><name>RR</name></Emp></Comp>
>> when this xml is passed in mapper , in sys out printing the root element
>>
>> I am getting the the root element as
>>
>> <id>
>> <name>
>>
>> Please suggest and help to fix this.
>>
>> I need to convert the xml into text using mapreduce code. Please provide
>> with example.
>>
>> Required output is
>>
>> id,name
>> 100,RR
>>
>> Please help.
>>
>> Thanks in advance,
>> Ranjini R
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
>

--001a11c3cd4ab00dfc04ef0d7071
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>Hi,</div>
<div><br>I used XMLInputFormat , in that i used=A0 Record Reader class. Sam=
e as u have given </div>
<div>=A0</div>
<div>THe whole xml is been split into part For Eg: consider the below xml</=
div>
<div>=A0</div>
<div>&lt;Comp&gt;&lt;Emp&gt;&lt;id&gt;&lt;/id&gt;&lt;name&gt;&lt;/name&gt;&=
lt;/Emp&gt;&lt;Emp&gt;&lt;id&gt;&lt;/id&gt;&lt;name&gt;&lt;/name&gt;&lt;/Em=
p&gt;&lt;/Comp&gt;</div>
<div>=A0</div>
<div>after using the RecordReader class the xml output is</div>
<div>=A0</div>
<div>&lt;Emp&gt;&lt;id&gt;&lt;/id&gt;&lt;name&gt;&lt;/name&gt;&lt;/Emp&gt;&=
lt;Emp&gt;&lt;id&gt;&lt;/id&gt;&lt;name&gt;&lt;/name&gt;&lt;/Emp&gt;</div>
<div>=A0</div>
<div>the starting and end tag is Emp.</div>
<div>=A0</div>
<div>it does not convert into text.</div>
<div>=A0</div>
<div>Please suggest and help.</div>
<div>=A0</div>
<div>Thanks in advance</div>
<div>=A0</div>
<div>Ranjini</div>
<div>=A0</div>
<div class=3D"gmail_quote">On Fri, Jan 3, 2014 at 11:22 AM, Azuryy Yu <span=
 dir=3D"ltr">&lt;<a href=3D"mailto:azuryyyu@gmail.com" target=3D"_blank">az=
uryyyu@gmail.com</a>&gt;</span> wrote:<br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<div dir=3D"ltr">
<div>
<div>
<div>
<div>
<div>
<div>
<div>Hi,<br><br></div>you can use org.apache.hadoop.streaming.StreamInputFo=
rmat=A0 using map reduce to convert XML to text.<br><br></div>such as your =
xml like this:<br></div>&lt;xml&gt;<br></div>=A0 &lt;name&gt;lll&lt;/name&g=
t;<br>
</div>&lt;/xml&gt;<br><br></div>you need to specify stream.recordreader.beg=
in and stream.recordreader.end in the Configuration:<br>Configuration conf =
=3D new Configuration();<br></div>conf.set(&quot;stream.recordreader.begin&=
quot;, &quot;&lt;xml&gt;&quot;);<br>
conf.set(&quot;stream.recordreader.end&quot;, &quot;&lt;/xml&gt;&quot;);<br=
><br><br>
<div>
<div>
<div>
<div>
<div>
<div>
<div><br><br></div></div></div></div></div></div></div></div>
<div class=3D"HOEnZb">
<div class=3D"h5">
<div class=3D"gmail_extra"><br><br>
<div class=3D"gmail_quote">On Fri, Jan 3, 2014 at 1:16 PM, Ranjini Rathinam=
 <span dir=3D"ltr">&lt;<a href=3D"mailto:ranjinibecse@gmail.com" target=3D"=
_blank">ranjinibecse@gmail.com</a>&gt;</span> wrote:<br>
<blockquote style=3D"BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PA=
DDING-LEFT:1ex" class=3D"gmail_quote">
<div>Hi,</div>
<div>=A0</div>
<div>Need to convert XML into text using mapreduce.</div>
<div>=A0</div>
<div>I have used DOM and SAX parser. </div>
<div>=A0</div>
<div>After using SAX Builder in mapper class. the child node act as root El=
ement.</div>
<div>=A0</div>
<div>While seeing in Sys out i found thar root element is taking the child =
element and printing.</div>
<div>=A0</div>
<div>For Eg,</div>
<div>=A0</div>
<div>&lt;Comp&gt;&lt;Emp&gt;&lt;id&gt;100&lt;/id&gt;&lt;name&gt;RR&lt;/name=
&gt;&lt;/Emp&gt;&lt;/Comp&gt;</div>
<div>when this xml is passed in mapper , in sys out printing the root eleme=
nt</div>
<div>=A0</div>
<div>I am getting the the root element as</div>
<div>=A0</div>
<div>&lt;id&gt;</div>
<div>&lt;name&gt;</div>
<div>=A0</div>
<div>Please suggest and help to fix this.</div>
<div>=A0</div>
<div>I need to convert the xml into text using mapreduce code. Please provi=
de with example.</div>
<div>=A0</div>
<div>Required output is</div>
<div>=A0</div>
<div>id,name</div>
<div>100,RR</div>
<div>=A0</div>
<div>Please help.</div>
<div>=A0</div>
<div>Thanks in advance,</div>
<div>Ranjini R</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div>
<div>=A0</div></blockquote></div><br></div></div></div></blockquote></div><=
br>

--001a11c3cd4ab00dfc04ef0d7071--