Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 79386 invoked from network); 11 Aug 2010 22:13:40 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 11 Aug 2010 22:13:40 -0000 Received: (qmail 46590 invoked by uid 500); 11 Aug 2010 22:13:40 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 46532 invoked by uid 500); 11 Aug 2010 22:13:39 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 46524 invoked by uid 99); 11 Aug 2010 22:13:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Aug 2010 22:13:39 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.97.132.145] (HELO homiemail-a1.g.dreamhost.com) (208.97.132.145) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Aug 2010 22:13:31 +0000 Received: from homiemail-a1.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a1.g.dreamhost.com (Postfix) with ESMTP id 495AE348070 for ; Wed, 11 Aug 2010 15:13:10 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=darose.net; h=message-id:date :from:mime-version:to:subject:content-type: content-transfer-encoding; q=dns; s=darose.net; b=gsRMrNHbecsVRL RGjWpQMroUkPe4P1gcXr4vxi1yitIhOvy5FPewgoxNEU4pcKHEzZlDH7/BdFi31d Sm6kG7eI35WuJEIsruADqLNcybgHF435JdJJducwAd1YF5luFqitTCfuYUwvEYYz 0jaE9EwDhbBYe2jmMbRL0HESZ9sMc= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=darose.net; h=message-id :date:from:mime-version:to:subject:content-type: content-transfer-encoding; s=darose.net; bh=j1g2C18rYR697rrE/AeA +2zgQNM=; b=z6zWJGmHV/wXBjafq/Azl8kEpWc37LXUsHdc1yDcRM/U0c4UVm36 87mWUyMdgY24X+8vNWyPA4rneuTKiPbNicqNfZOG6fgcOkO3hxhRKP3NK7pozK+T Qoz4DLtoB1W+CyMNlWqO3/FbVtGfP+FKpuyqNVyRZjVx/zdJaYq9nWE= Received: from darsys12 (cpe-66-108-142-190.nyc.res.rr.com [66.108.142.190]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: darose@darose.net) by homiemail-a1.g.dreamhost.com (Postfix) with ESMTPSA id 2688334806B for ; Wed, 11 Aug 2010 15:13:10 -0700 (PDT) Received: from [10.1.0.2] by darsys12 with esmtp (Exim 4.72) (envelope-from ) id 1OjJXo-0005vU-Og for mapreduce-user@hadoop.apache.org; Wed, 11 Aug 2010 18:13:08 -0400 Message-ID: <4C632081.7030907@darose.net> Date: Wed, 11 Aug 2010 18:13:21 -0400 From: David Rosenstrauch User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.8) Gecko/20100806 Lanikai/3.1.2 MIME-Version: 1.0 To: mapreduce-user@hadoop.apache.org Subject: Preferred way to submit a job? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org What's the preferred way to submit a job these days? org.apache.hadoop.mapreduce.Job.submit() ? Or org.apache.hadoop.mapred.JobClient.runJob()? Or does it even matter? (i.e., is there any difference between them?) I've been trying to run a job using org.apache.hadoop.mapreduce.Job.submit() (since I assumed that the org.apache.hadoop.mapred.* classes were deprecated). However, I'm seeing some weirdness (the "mapred.job.tracker" setting that I set on my job's Configuration is getting ignored, and making the job get run locally) and I was wondering if the way I was submitting my job might have something to do with it. On a related note, if there's actually no difference between the 2 methods, would anybody have any idea what could make the "mapred.job.tracker" setting on a job Configuration get ignored? (I currently have it set to "hdfs://:9001".) TIA, DR