Return-Path: 
 <user-return-8461-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 50F6410465
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Tue,  4 Jun 2013 20:09:43 +0000 (UTC)
Received: (qmail 46956 invoked by uid 500); 4 Jun 2013 20:09:38 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 46750 invoked by uid 500); 4 Jun 2013 20:09:38 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 46743 invoked by uid 99); 4 Jun 2013 20:09:38 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Jun 2013 20:09:38 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW
X-Spam-Check-By: apache.org
Received-SPF: error (nike.apache.org: local policy)
Received: from [209.85.214.177] (HELO mail-ob0-f177.google.com)
 (209.85.214.177)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Jun 2013 20:09:30 +0000
Received: by mail-ob0-f177.google.com with SMTP id ta17so1169709obb.8
        for <user@hadoop.apache.org>; Tue, 04 Jun 2013 13:08:50 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=google.com; s=20120113;
        h=mime-version:sender:x-originating-ip:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :x-gm-message-state;
        bh=5OJ7tL/ZVuTWWfbwbKGZVg+I+25Jl2puLYGGQNDWpS0=;
        b=kdCwYlrnlIAf1HwSBAny5li5I+AVtnafX+iKFT0h4uhKQAU1PQfiBwZZMStTyy1cmY
         YOZJ0WqHtZNJiUTQjznAvjAC6QIvYM665pczbHrM+W3ONP7kWg3v6TLKvX7DBeNjEpXx
         BuCLYSalSg1lL7jSd4DmE9ZgREwTs+/YsgHAYJxUw+kLf+ATLr9FvBgCuOrBLR0JIWEN
         SgTEKz/Z+I/Rb7uXX1RLGphFD4JqGnymIQYHg8fAQnYGBFTZtGu5Ojci0g49p4Ij1p+Y
         X7+rfKGYhcLEGy7Rj3XLL2elh+/Eg2LKybSvbTX5uLW54ABi11+eIzcg5e59Nb2dtDzN
         d2dw==
MIME-Version: 1.0
X-Received: by 10.60.141.2 with SMTP id rk2mr12853899oeb.69.1370376529863;
 Tue, 04 Jun 2013 13:08:49 -0700 (PDT)
Sender: niels@basj.es
Received: by 10.76.166.229 with HTTP; Tue, 4 Jun 2013 13:08:49 -0700 (PDT)
X-Originating-IP: [87.187.134.78]
Received: by 10.76.166.229 with HTTP; Tue, 4 Jun 2013 13:08:49 -0700 (PDT)
In-Reply-To: 
 <CAONdThrEmk-yMifeCvgNEV8_nZssC2dPKNEFYkhFFKj84j9zTw@mail.gmail.com>
References: 
 <CAONdThrEmk-yMifeCvgNEV8_nZssC2dPKNEFYkhFFKj84j9zTw@mail.gmail.com>
Date: Tue, 4 Jun 2013 22:08:49 +0200
X-Google-Sender-Auth: 53TaR_ZdOKunrNOabtfX_HpwVGQ
Message-ID: 
 <CADoiZqqnrm8pJngVZAWV5Lty=TByn1MUYeWMTw9AsfQj09whQw@mail.gmail.com>
Subject: Re: Reducer to output only json
From: Niels Basjes <Niels@basjes.nl>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b33c83a4578ec04de59a61a
X-Gm-Message-State: 
 ALoCoQmvnj/PDhUeiXE19nXDohrS/4ExfeLzul49y3jMonpBx6CV78aaLw6ik3wGZZpo5wYAw63O
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b33c83a4578ec04de59a61a
Content-Type: text/plain; charset=ISO-8859-1

Have you tried something like this (i do not have a pc here to check this
code)

context.write(NullWritable, new Text(jsn.toString()));
On Jun 4, 2013 8:10 PM, "Chengi Liu" <chengi.liu.86@gmail.com> wrote:

> Hi,
>
>  I have the following redcuer class
>
> public static class TokenCounterReducer
>     extends Reducer<Text, Text, Text, Text> {
>     public void reduce(Text key, Iterable<Text> values, Context context)
>         throws IOException, InterruptedException {
>
>     //String[] fields = s.split("\t", -1)
>     JSONObject jsn = new JSONObject();
>         int sum = 0;
>         for (Text value : values) {
>         String[] vals = value.toString().split("\t");
>         String[] targetNodes = vals[0].toString().split(",",-1);
>         jsn.put("source",vals[1] );
>         jsn.put("target",targetNodes);
>             //sum += value.get();
>         }
>        // context.write(key, new Text(sum));
>     }
> }
>
> I want to save that json to hdfs?
>
> It was very trivial in hadoop streaming.. but how do i do it in hadoop
> java?
> Thanks
>

--047d7b33c83a4578ec04de59a61a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">Have you tried something like this (i do not have a pc here =
to check this code)</p>
<p dir=3D"ltr">context.write(NullWritable, new Text(jsn.toString()));</p>
<div class=3D"gmail_quote">On Jun 4, 2013 8:10 PM, &quot;Chengi Liu&quot; &=
lt;<a href=3D"mailto:chengi.liu.86@gmail.com">chengi.liu.86@gmail.com</a>&g=
t; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir=3D"ltr">Hi,=A0<div><br></div><div>=A0I have the following redcuer =
class</div><div><br></div><div><div>public static class TokenCounterReducer=
</div><div>=A0 =A0 extends Reducer&lt;Text, Text, Text, Text&gt; {</div>
<div>=A0 =A0 public void reduce(Text key, Iterable&lt;Text&gt; values, Cont=
ext context)</div><div>=A0 =A0 =A0 =A0 throws IOException, InterruptedExcep=
tion {</div><div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span></div=
><div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span>//String[] field=
s =3D s.split(&quot;\t&quot;, -1)</div>

<div>=A0 =A0 <span style=3D"white-space:pre-wrap">	</span>JSONObject jsn =
=3D new JSONObject();</div><div>=A0 =A0 =A0 =A0 int sum =3D 0;</div><div>=
=A0 =A0 =A0 =A0 for (Text value : values) {</div><div>=A0 =A0 =A0 =A0 <span=
 style=3D"white-space:pre-wrap">	</span>String[] vals =3D value.toString().=
split(&quot;\t&quot;);</div>

<div>=A0 =A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>String[] =
targetNodes =3D vals[0].toString().split(&quot;,&quot;,-1);</div><div>=A0 =
=A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>jsn.put(&quot;sour=
ce&quot;,vals[1] );</div>

<div>=A0 =A0 =A0 =A0 <span style=3D"white-space:pre-wrap">	</span>jsn.put(&=
quot;target&quot;,targetNodes);</div><div>=A0 =A0 =A0 =A0 =A0 =A0 //sum +=
=3D value.get();</div><div>=A0 =A0 =A0 =A0 }</div><div>=A0 =A0 =A0 =A0// co=
ntext.write(key, new Text(sum));</div>

<div>=A0 =A0 }</div><div>}</div><div><br></div><div>I want to save that jso=
n to hdfs?</div><div><br></div><div>It was very trivial in hadoop streaming=
.. but how do i do it in hadoop java?</div><div>Thanks</div>
</div></div>
</blockquote></div>

--047d7b33c83a4578ec04de59a61a--