Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6AFCD9AE7 for ; Fri, 16 Mar 2012 19:09:48 +0000 (UTC) Received: (qmail 33689 invoked by uid 500); 16 Mar 2012 19:09:45 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 33629 invoked by uid 500); 16 Mar 2012 19:09:45 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 33617 invoked by uid 99); 16 Mar 2012 19:09:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Mar 2012 19:09:45 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bejoy.hadoop@gmail.com designates 209.85.160.176 as permitted sender) Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Mar 2012 19:09:37 +0000 Received: by ghbz10 with SMTP id z10so5861635ghb.35 for ; Fri, 16 Mar 2012 12:09:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=28zU7TewK03qUsSphaC2YZpK/ChmuGQzwWqzTvk+7KA=; b=dFv2hnI7PbJ+WeszXBTRRGHmATvcr8rzGGr3/Mi1R89RohoQlC2l0Pc81Ypxz7ndn4 znuTwf2A8LV0XEXajmprBuRVmi9Hmt9Kr8hPVOI6bp8Nrs5QrVQ2k0GlO6OtTjQAN/Cg 6Wj4pD2i5EO3gg5wIpz6h9iNr71cxJSYIPydbDjHZAfmS27f1/tOY5vrqf/2tb1pKk3N fI2fyS3HEeuPs3rmLpFL9E0dqbh71hwBc2OvyAnqcy+VaCeP5OpCOazf2c9yip1mtzsC INFKm/ud2weCNYoLD30usxp+cHtkl+6c2SaJJKK+ck3R/DHy0IfcwckPRv05P5FishjV Dk0Q== MIME-Version: 1.0 Received: by 10.68.240.41 with SMTP id vx9mr16952044pbc.10.1331924949702; Fri, 16 Mar 2012 12:09:09 -0700 (PDT) Received: by 10.143.16.14 with HTTP; Fri, 16 Mar 2012 12:09:09 -0700 (PDT) In-Reply-To: References: Date: Sat, 17 Mar 2012 00:39:09 +0530 Message-ID: Subject: Re: _temporary doesn't exist From: Bejoy Ks To: common-user@hadoop.apache.org Cc: common-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b33923d7e96ab04bb60f14b X-Virus-Checked: Checked by ClamAV on apache.org --047d7b33923d7e96ab04bb60f14b Content-Type: text/plain; charset=ISO-8859-1 Hi Vipul Is there any reason you are with 0.17 version of hadoop? It is a pretty old version of hadoop (more than 2 years back) and tons of bug fixes and optimizations have gone into trunk after the same. You should badly upgrade to any 1.0.X releases. It would be hard for any one on the list to help you out with such an outdated version,Try an upgrade and see whether this issue still persists. Regards Bejoy On Sat, Mar 17, 2012 at 12:27 AM, Vipul Bharakhada wrote: > One more observation: usually this job takes 3 to 4 minutes, however when > it fails, at that particular time it takes more than 42 to 50 minutes. > -Vipul > > On Fri, Mar 16, 2012 at 11:38 AM, Vipul Bharakhada >wrote: > > > Hi, > > I am using the old hadoop version 0.17.2 and I am getting the following > > exception when I am trying to run a Job. But it only happens at > particular > > time, as cron jobs do run those task at particular intervals but it only > > fails at one particular time in day. > > > > Mar 14 06:49:23 7 08884: java.io.IOException: The directory > > hdfs://<{IPADDRESS}>:<{PORT}>/myserver/matcher/output/_temporary doesnt > > exist > > Mar 14 06:49:23 7 08884: \09at > > > org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1439) > > Mar 14 06:49:23 7 08884: \09at > > > org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1511) > > Mar 14 06:49:23 7 08884: \09at > > > org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:723) > > Mar 14 06:49:23 7 08884: \09at > > org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:716) > > Mar 14 06:49:23 7 08884: \09at > > org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1274) > > Mar 14 06:49:23 7 08884: \09at > > org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:915) > > Mar 14 06:49:23 7 08884: \09at > > org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1310) > > Mar 14 06:49:23 7 08884: \09at > > org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2251) > > > > What can be a problem? as this folder is created by hadoop internally and > > used internally, clean up is also done internally by hadoop. So why this > > directory is missing at some particular time? > > Any clue? > > -Vipul > > > > > --047d7b33923d7e96ab04bb60f14b--