Return-Path: X-Original-To: apmail-avro-commits-archive@www.apache.org Delivered-To: apmail-avro-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D18C810B10 for ; Thu, 25 Apr 2013 13:51:30 +0000 (UTC) Received: (qmail 78831 invoked by uid 500); 25 Apr 2013 13:51:30 -0000 Delivered-To: apmail-avro-commits-archive@avro.apache.org Received: (qmail 78674 invoked by uid 500); 25 Apr 2013 13:51:26 -0000 Mailing-List: contact commits-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@avro.apache.org Delivered-To: mailing list commits@avro.apache.org Received: (qmail 78641 invoked by uid 99); 25 Apr 2013 13:51:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Apr 2013 13:51:25 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Apr 2013 13:51:22 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id 09E4823888E4; Thu, 25 Apr 2013 13:51:02 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1475773 - in /avro/trunk: CHANGES.txt lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html Date: Thu, 25 Apr 2013 13:51:01 -0000 To: commits@avro.apache.org From: martinkl@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20130425135102.09E4823888E4@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: martinkl Date: Thu Apr 25 13:51:01 2013 New Revision: 1475773 URL: http://svn.apache.org/r1475773 Log: AVRO-1306. Java mapred: Fix incorrect documentation for combiners. Contributed by Mina Naguib. Modified: avro/trunk/CHANGES.txt avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html Modified: avro/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/avro/trunk/CHANGES.txt?rev=1475773&r1=1475772&r2=1475773&view=diff ============================================================================== --- avro/trunk/CHANGES.txt (original) +++ avro/trunk/CHANGES.txt Thu Apr 25 13:51:01 2013 @@ -53,6 +53,9 @@ Trunk (not yet released) AVRO-1308. Java: Fix repeated protobuf messages & enums. (Steve Zesch & cutting) + AVRO-1306. Java mapred: Fix incorrect documentation for combiners. + (Mina Naguib via martinkl) + Avro 1.7.4 (22 February 2012) NEW FEATURES Modified: avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html URL: http://svn.apache.org/viewvc/avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html?rev=1475773&r1=1475772&r2=1475773&view=diff ============================================================================== --- avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html (original) +++ avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/package.html Thu Apr 25 13:51:01 2013 @@ -62,11 +62,16 @@ Avro data, with map and reduce functions this as your job's mapper with {@link org.apache.avro.mapred.AvroJob#setMapperClass}
  • Implement {@link org.apache.hadoop.mapred.Reducer} and specify - your job's reducer and combiner with {@link - org.apache.hadoop.mapred.JobConf#setReducerClass} and {@link - org.apache.hadoop.mapred.JobConf#setCombinerClass}. The input key + your job's reducer with {@link + org.apache.hadoop.mapred.JobConf#setReducerClass}. The input key and value types should be {@link org.apache.avro.mapred.AvroKey} and {@link org.apache.avro.mapred.AvroValue}.
    • +
  • Optionally implement {@link org.apache.hadoop.mapred.Reducer} and + specify your job's combiner with {@link + org.apache.hadoop.mapred.JobConf#setCombinerClass}. You will be unable to + re-use the same Reducer class as the Combiner, as the Combiner will need + input and output key to be {@link org.apache.avro.mapred.AvroKey}, and + input and output value to be {@link org.apache.avro.mapred.AvroValue}.
  • Specify your job's output key and value types {@link org.apache.hadoop.mapred.JobConf#setOutputKeyClass} and {@link org.apache.hadoop.mapred.JobConf#setOutputValueClass}.