Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 56938 invoked from network); 4 Sep 2008 23:36:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 4 Sep 2008 23:36:12 -0000 Received: (qmail 18981 invoked by uid 500); 4 Sep 2008 23:36:03 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 18950 invoked by uid 500); 4 Sep 2008 23:36:03 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 18811 invoked by uid 99); 4 Sep 2008 23:36:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 16:36:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 23:35:13 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 65DAA234C1DE for ; Thu, 4 Sep 2008 16:35:44 -0700 (PDT) Message-ID: <1723199920.1220571344416.JavaMail.jira@brutus> Date: Thu, 4 Sep 2008 16:35:44 -0700 (PDT) From: "Amir Youssefi (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3973) Breaking out of a task In-Reply-To: <1108548123.1219180064247.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12628520#action_12628520 ] Amir Youssefi commented on HADOOP-3973: --------------------------------------- When new interface is committed (HADOOP-1230 issue by Owen) this issue is resolved as well. Meanwhile we have provided workarounds in above discussions. I'm closing the issue. Custom MapRunnable can address part A (mapper) but not part B (reducer) in above comment: https://issues.apache.org/jira/browse/HADOOP-3973?focusedCommentId=12623810#action_12623810 BTW, Pig's LIMIT (Top) is at it's pick performance when used with this. In future Pig can break out using coming releases of Hadoop, > Breaking out of a task > ---------------------- > > Key: HADOOP-3973 > URL: https://issues.apache.org/jira/browse/HADOOP-3973 > Project: Hadoop Core > Issue Type: New Feature > Components: mapred > Reporter: Amir Youssefi > > Occasionally a mapper/reducer is done without need to see more input data. If we provide a way to break out and skip reading the rest of input then job finishs earlier and resources are spared. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.