Return-Path: 
 <user-return-8462-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 6AC2110495
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Tue,  4 Jun 2013 20:17:04 +0000 (UTC)
Received: (qmail 58860 invoked by uid 500); 4 Jun 2013 20:16:59 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 58669 invoked by uid 500); 4 Jun 2013 20:16:59 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 58662 invoked by uid 99); 4 Jun 2013 20:16:59 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Jun 2013 20:16:59 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of dontariq@gmail.com designates
 209.85.212.53 as permitted sender)
Received: from [209.85.212.53] (HELO mail-vb0-f53.google.com) (209.85.212.53)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Jun 2013 20:16:52 +0000
Received: by mail-vb0-f53.google.com with SMTP id p12so520683vbe.26
        for <user@hadoop.apache.org>; Tue, 04 Jun 2013 13:16:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        bh=3rWqepabxYQnLBv+aCqwOkn87wh8b2pzupQ1T2Y/2Bg=;
        b=cJtkwWoGgU/8HMPiM4oIi0ONstqHZRBy3TpX5CbFKH5eV1AyU3lIxSfx9JgO2X7uXc
         1H2rWYP2K5bd8ythfjDYB4NIwZBx/q1b4DjKDjzJDeMvmXoz04VPOFcu4vmHQMfeXDVW
         ykuKtPLThkyiN4+JA5SdNQCkAgdrl69xuq2xxxQo8OVLuGrM7hWLifM2t4M0tC2Sb6Lc
         OjisHhfEF7UMJ2jGN7A3XPlVuWFVBDkKk5mbwJAkSzrzXAmvn9UK83faEq0z0wEstSim
         Cz78I99kLe9aJCaX/iiSMsP34SDERMKIICE6C0FpZ0uz7819bLV2O2sC1qL3oHONyR46
         mHzQ==
X-Received: by 10.52.72.78 with SMTP id b14mr12522110vdv.63.1370376991378;
 Tue, 04 Jun 2013 13:16:31 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.59.12.163 with HTTP; Tue, 4 Jun 2013 13:15:51 -0700 (PDT)
In-Reply-To: 
 <CADoiZqqnrm8pJngVZAWV5Lty=TByn1MUYeWMTw9AsfQj09whQw@mail.gmail.com>
References: 
 <CAONdThrEmk-yMifeCvgNEV8_nZssC2dPKNEFYkhFFKj84j9zTw@mail.gmail.com>
 <CADoiZqqnrm8pJngVZAWV5Lty=TByn1MUYeWMTw9AsfQj09whQw@mail.gmail.com>
From: Mohammad Tariq <dontariq@gmail.com>
Date: Wed, 5 Jun 2013 01:45:51 +0530
Message-ID: 
 <CAMVC6RM1cqM9kqk32jKjdkqrK7O_dKLz-ep16-EEN_icxUh5+g@mail.gmail.com>
Subject: Re: Reducer to output only json
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=20cf307f35e2c7926204de59c174
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf307f35e2c7926204de59c174
Content-Type: text/plain; charset=ISO-8859-1

Yes...This should do the trick.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Wed, Jun 5, 2013 at 1:38 AM, Niels Basjes <Niels@basjes.nl> wrote:

> Have you tried something like this (i do not have a pc here to check this
> code)
>
> context.write(NullWritable, new Text(jsn.toString()));
> On Jun 4, 2013 8:10 PM, "Chengi Liu" <chengi.liu.86@gmail.com> wrote:
>
>> Hi,
>>
>>  I have the following redcuer class
>>
>> public static class TokenCounterReducer
>>     extends Reducer<Text, Text, Text, Text> {
>>     public void reduce(Text key, Iterable<Text> values, Context context)
>>         throws IOException, InterruptedException {
>>
>>     //String[] fields = s.split("\t", -1)
>>     JSONObject jsn = new JSONObject();
>>         int sum = 0;
>>         for (Text value : values) {
>>         String[] vals = value.toString().split("\t");
>>         String[] targetNodes = vals[0].toString().split(",",-1);
>>         jsn.put("source",vals[1] );
>>         jsn.put("target",targetNodes);
>>             //sum += value.get();
>>         }
>>        // context.write(key, new Text(sum));
>>     }
>> }
>>
>> I want to save that json to hdfs?
>>
>> It was very trivial in hadoop streaming.. but how do i do it in hadoop
>> java?
>> Thanks
>>
>

--20cf307f35e2c7926204de59c174
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Yes...This should do the trick.</div><div class=3D"gmail_e=
xtra"><br clear=3D"all"><div><div dir=3D"ltr">Warm Regards,<div>Tariq</div>=
<div><a href=3D"http://cloudfront.blogspot.com" target=3D"_blank">cloudfron=
t.blogspot.com</a><br>

</div></div></div>
<br><br><div class=3D"gmail_quote">On Wed, Jun 5, 2013 at 1:38 AM, Niels Ba=
sjes <span dir=3D"ltr">&lt;<a href=3D"mailto:Niels@basjes.nl" target=3D"_bl=
ank">Niels@basjes.nl</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_qu=
ote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex=
">

<p dir=3D"ltr">Have you tried something like this (i do not have a pc here =
to check this code)</p>
<p dir=3D"ltr">context.write(NullWritable, new Text(jsn.toString()));</p><d=
iv class=3D"HOEnZb"><div class=3D"h5">
<div class=3D"gmail_quote">On Jun 4, 2013 8:10 PM, &quot;Chengi Liu&quot; &=
lt;<a href=3D"mailto:chengi.liu.86@gmail.com" target=3D"_blank">chengi.liu.=
86@gmail.com</a>&gt; wrote:<br type=3D"attribution"><blockquote class=3D"gm=
ail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-le=
ft:1ex">


<div dir=3D"ltr">Hi,=A0<div><br></div><div>=A0I have the following redcuer =
class</div><div><br></div><div><div>public static class TokenCounterReducer=
</div><div>=A0 =A0 extends Reducer&lt;Text, Text, Text, Text&gt; {</div>
<div>=A0 =A0 public void reduce(Text key, Iterable&lt;Text&gt; values, Cont=
ext context)</div><div>=A0 =A0 =A0 =A0 throws IOException, InterruptedExcep=
tion {</div><div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span></div=
><div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span>//String[] field=
s =3D s.split(&quot;\t&quot;, -1)</div>



<div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span>JSONObject jsn =
=3D new JSONObject();</div><div>=A0 =A0 =A0 =A0 int sum =3D 0;</div><div>=
=A0 =A0 =A0 =A0 for (Text value : values) {</div><div>=A0 =A0 =A0 =A0 <span=
 style=3D"white-space:pre-wrap">	</span>String[] vals =3D value.toString().=
split(&quot;\t&quot;);</div>



<div>=A0 =A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>String[] =
targetNodes =3D vals[0].toString().split(&quot;,&quot;,-1);</div><div>=A0 =
=A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>jsn.put(&quot;sour=
ce&quot;,vals[1] );</div>



<div>=A0 =A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>jsn.put(&=
quot;target&quot;,targetNodes);</div><div>=A0 =A0 =A0 =A0 =A0 =A0 //sum +=
=3D value.get();</div><div>=A0 =A0 =A0 =A0 }</div><div>=A0 =A0 =A0 =A0// co=
ntext.write(key, new Text(sum));</div>



<div>=A0 =A0 }</div><div>}</div><div><br></div><div>I want to save that jso=
n to hdfs?</div><div><br></div><div>It was very trivial in hadoop streaming=
.. but how do i do it in hadoop java?</div><div>Thanks</div>
</div></div>
</blockquote></div>
</div></div></blockquote></div><br></div>

--20cf307f35e2c7926204de59c174--