Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 35218 invoked from network); 13 Oct 2009 10:23:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 13 Oct 2009 10:23:54 -0000 Received: (qmail 65337 invoked by uid 500); 13 Oct 2009 10:23:54 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 65277 invoked by uid 500); 13 Oct 2009 10:23:54 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 65267 invoked by uid 99); 13 Oct 2009 10:23:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Oct 2009 10:23:54 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Oct 2009 10:23:52 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 92120234C045 for ; Tue, 13 Oct 2009 03:23:31 -0700 (PDT) Message-ID: <1248118165.1255429411592.JavaMail.jira@brutus> Date: Tue, 13 Oct 2009 03:23:31 -0700 (PDT) From: "Ravi Gummadi (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Updated: (MAPREDUCE-1086) hadoop commands in streaming tasks are trying to write to tasktracker's log In-Reply-To: <602033202.1255076431290.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Gummadi updated MAPREDUCE-1086: ------------------------------------ Attachment: MR-1086.patch Attaching patch for trunk. Please review and provide your comments. > hadoop commands in streaming tasks are trying to write to tasktracker's log > --------------------------------------------------------------------------- > > Key: MAPREDUCE-1086 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1086 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: tasktracker > Affects Versions: 0.20.1, 0.21.0, 0.22.0 > Reporter: Ravi Gummadi > Assignee: Ravi Gummadi > Fix For: 0.20.2 > > Attachments: MR-1086.patch > > > As HADOOP_ROOT_LOGGER is not set in the environment by TT for the children, the children of task jvm(in case of streaming) are trying to write to TT's log and getting the following Exception. Jobs are succeeded, but the issue is to be resolved by setting the environment variables by TT for use by children of task jvm in case of streaming job. > When streaming calls hadoop commands, it's trying to write to TaskTracker log file. > log4j:ERROR setFile(null,true) call failed. > java.io.FileNotFoundException: > /a/b/tasktracker.log (Permission denied) > at java.io.FileOutputStream.openAppend(Native Method) > at java.io.FileOutputStream.(FileOutputStream.java:177) > at java.io.FileOutputStream.(FileOutputStream.java:102) > at org.apache.log4j.FileAppender.setFile(FileAppender.java:290) > at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164) > at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216) > at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257) > at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133) > at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:97) > at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:689) > at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647) > at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544) > at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440) > at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476) > at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:471) > at org.apache.log4j.LogManager.(LogManager.java:125) > at org.apache.log4j.Logger.getLogger(Logger.java:105) > at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229) > at org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:65) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529) > at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235) > at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209) > at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351) > at org.apache.hadoop.conf.Configuration.(Configuration.java:138) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > at org.apache.hadoop.fs.FsShell.main(FsShell.java:1880) > log4j:ERROR Either File or DatePattern options are not set for appender [DRFA]. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.