From mapreduce-dev-return-1948-apmail-hadoop-mapreduce-dev-archive=hadoop.apache.org@hadoop.apache.org Thu May 13 03:35:10 2010 Return-Path: Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: (qmail 94316 invoked from network); 13 May 2010 03:35:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 13 May 2010 03:35:10 -0000 Received: (qmail 40690 invoked by uid 500); 13 May 2010 03:35:09 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 40346 invoked by uid 500); 13 May 2010 03:35:07 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 40329 invoked by uid 99); 13 May 2010 03:35:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 May 2010 03:35:06 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 May 2010 03:35:03 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o4D3Yg7J015037 for ; Thu, 13 May 2010 03:34:42 GMT Message-ID: <27134873.12231273721682080.JavaMail.jira@thor> Date: Wed, 12 May 2010 23:34:42 -0400 (EDT) From: "Owen O'Malley (JIRA)" To: mapreduce-dev@hadoop.apache.org Subject: [jira] Created: (MAPREDUCE-1786) Add method to support pre-partitioned data MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Add method to support pre-partitioned data ------------------------------------------ Key: MAPREDUCE-1786 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1786 Project: Hadoop Map/Reduce Issue Type: Improvement Components: task Reporter: Owen O'Malley Assignee: Owen O'Malley There are some applications where the map wants to partition the data itself. This happens in Pipes, if the user has a C++ partitioner. It would make sense to support it in streaming too. There is also use case where the Java partitioner needs the context object to update counters, etc. This jira is only about adding the method to the mapreduce Java API. The Pipes interface can be updated in a follow up Jira. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.