Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of vipulrb29@gmail.com designates
 209.85.215.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALN6TjZ70a6F34hmjfMEnLy-yubsRu=e-mxrmQ69MPfXysKFBw@mail.gmail.com>
References: 
 <CALN6TjZ70a6F34hmjfMEnLy-yubsRu=e-mxrmQ69MPfXysKFBw@mail.gmail.com>
Date: Mon, 19 Mar 2012 11:30:56 -0700
Message-ID: 
 <CALN6Tjb0fsoSnMoyoNGGhPzpSvrTc83qWO-6GLh2-GNCGW2M4Q@mail.gmail.com>
Subject: Re: _temporary doesn't exist
From: Vipul Bharakhada <vipulrb29@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=bcaec52c6a4f5cc20604bb9cc2bc

--bcaec52c6a4f5cc20604bb9cc2bc
Content-Type: text/plain; charset=ISO-8859-1

I found that "_temporary" directory is getting created and getting deleted
it self by hadoop. So is there any timeout for "_temporary" folder? I
noticed that if the job finishes within 5 minutes then I am not getting
this problem, but when it takes more than 50 minutes, the
"/output/_temporary" directory is missing.
Just to remind, I am working on 0.17.2 version.
-Vipul

On Fri, Mar 16, 2012 at 11:29 AM, Vipul Bharakhada <vipulrb29@gmail.com>wrote:

> Hi,
> I am using the old hadoop version 0.17.2 and I am getting the following
> exception when I am trying to run a Job. But it only happens at particular
> time, as cron jobs do run those task at particular intervals but it only
> fails at one particular time in day.
>
> Mar 14 06:49:23 7 08884: java.io.IOException: The directory
> hdfs://<{IPADDRESS}>:<{PORT}>/myserver/matcher/output/_temporary doesnt
> exist
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1439)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1511)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:723)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:716)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1274)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:915)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1310)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2251)
>
> What can be a problem? as this folder is created by hadoop internally and
> used internally, clean up is also done internally by hadoop. So why this
> directory is missing at some particular time?
> Any clue?
> -Vipul
>

--bcaec52c6a4f5cc20604bb9cc2bc--