Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 11425 invoked from network); 8 Apr 2011 04:36:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 8 Apr 2011 04:36:04 -0000 Received: (qmail 30559 invoked by uid 500); 8 Apr 2011 04:36:03 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 30512 invoked by uid 500); 8 Apr 2011 04:36:02 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 30503 invoked by uid 99); 8 Apr 2011 04:36:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Apr 2011 04:36:00 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jeremy@lewi.us designates 67.222.39.38 as permitted sender) Received: from [67.222.39.38] (HELO cpoproxy2-pub.bluehost.com) (67.222.39.38) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 08 Apr 2011 04:35:53 +0000 Received: (qmail 11722 invoked by uid 0); 8 Apr 2011 04:35:32 -0000 Received: from unknown (HELO host162.hostmonster.com) (74.220.207.162) by cpoproxy2.bluehost.com with SMTP; 8 Apr 2011 04:35:32 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=default; d=lewi.us; h=Received:Subject:From:To:Content-Type:Date:Message-Id:Mime-Version:X-Mailer:Content-Transfer-Encoding:X-Identified-User; b=QCYbNav+so8id4KpkOFl7SI3ovD26T4X1JMhnaSML2fG6m5jBLA2wi9LFRCJ31wZj0l+k4UPD1ISPYg2LFyqz69UU0ue2sDIFWIVmsEcLqKgqlfHMDAuRXUDD8FH/nCN; Received: from ip98-176-124-78.sd.sd.cox.net ([98.176.124.78] helo=[192.168.102.102]) by host162.hostmonster.com with esmtpsa (SSLv3:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1Q83Pw-0006PW-GO for mapreduce-user@hadoop.apache.org; Thu, 07 Apr 2011 22:35:32 -0600 Subject: Can't set stream.addenvironment in job configuration file From: Jeremy Lewi To: mapreduce-user@hadoop.apache.org Content-Type: text/plain Date: Thu, 07 Apr 2011 21:35:31 -0700 Message-Id: <1302237331.12607.45.camel@massimo> Mime-Version: 1.0 X-Mailer: Evolution 2.26.3 (2.26.3-1.fc11) Content-Transfer-Encoding: 7bit X-Identified-User: {1094:host162.hostmonster.com:lewilabo:lewi.us} {sentby:smtp auth 98.176.124.78 authed with jeremy@lewi.us} Hi, I'm trying to submit a streaming job using the -conf option to specify a job configuration file. One of the options in my configuration file is stream.addenvironment but this option doesn't appear to be getting set; i.e when I run the job and use the web interface to look at job.xml this property is missing. Does anybody have any ideas? My jobconf file is: stream.addenvironment"dumbo_mrbase_class=dumbo.backends.common.MapRedBase dumbo_jk_class=dumbo.backends.common.JoinKey dumbo_runinfo_class=dumbo.backends.streaming.StreamingRunInfo PYTHONPATH=common.pyc:typedbytes-0.3.6-py2.6.egg" stream.map.inputtypedbytes stream.reduce.inputtypedbytes stream.map.outputtypedbytes stream.reduce.outputtypedbytes mapred.job.namegroup_clusters.py (1/1) Is it possible that the value I set for stream.addenvironment in the job configuration file is overwritten by the call jobConf._set("stream.addenvironment",addTaskEnvironment_); in StreamJob.setJobConf()? I'm using CDH3B. Thanks Jeremy