hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: Reducer to output only json
Date Tue, 04 Jun 2013 19:53:51 GMT
If you need to save the JSON as it is then you could implement OutputFormat
to create you custom outputformat that'll allow you to write the data as
per your wish.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 4, 2013 at 11:39 PM, Chengi Liu <chengi.liu.86@gmail.com> wrote:

> Hi,
>
>  I have the following redcuer class
>
> public static class TokenCounterReducer
>     extends Reducer<Text, Text, Text, Text> {
>     public void reduce(Text key, Iterable<Text> values, Context context)
>         throws IOException, InterruptedException {
>
>     //String[] fields = s.split("\t", -1)
>     JSONObject jsn = new JSONObject();
>         int sum = 0;
>         for (Text value : values) {
>         String[] vals = value.toString().split("\t");
>         String[] targetNodes = vals[0].toString().split(",",-1);
>         jsn.put("source",vals[1] );
>         jsn.put("target",targetNodes);
>             //sum += value.get();
>         }
>        // context.write(key, new Text(sum));
>     }
> }
>
> I want to save that json to hdfs?
>
> It was very trivial in hadoop streaming.. but how do i do it in hadoop
> java?
> Thanks
>

Mime
View raw message