Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6C3021073D for ; Fri, 7 Jun 2013 21:21:05 +0000 (UTC) Received: (qmail 86172 invoked by uid 500); 7 Jun 2013 21:21:00 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 86004 invoked by uid 500); 7 Jun 2013 21:21:00 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 85997 invoked by uid 99); 7 Jun 2013 21:21:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jun 2013 21:21:00 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of boyuzhang35@gmail.com designates 74.125.82.49 as permitted sender) Received: from [74.125.82.49] (HELO mail-wg0-f49.google.com) (74.125.82.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jun 2013 21:20:53 +0000 Received: by mail-wg0-f49.google.com with SMTP id a12so1637288wgh.4 for ; Fri, 07 Jun 2013 14:20:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=r+hZm1Tame2MB/CZwb488dfPopn7FhGFjqGuzjObCwc=; b=FWqLWeLWX8nJtyetAgAG1jBKkZqe0C/7VR+Rqq3ohyAx45fbUWFHBrHRRG6CsgzJBn fwlljbg2puhc2MmCfmovAmQEHjw6THJ/iJF7GEWULU4ucsBEK10Frvt2QmgHH/Q0Usfe kR2ZXVi4BaJb1IqYNBOE5t35Nn4HQvTAcGFghQ6vlO1iQDXwg9cmfhPDle90L0TE33KV 0vQxocCti/XFY3FZcrEzB1ZyxcdJEylB94fmKoAL2mFi17xO27crCWy2ySbmg1o8uccO 30U7f817IDLbf0tbcVendYtQo1k4Ga8nKZ3hGe1P+anozqJZ53fSybFBlSA34Xp5elH2 5jUw== MIME-Version: 1.0 X-Received: by 10.180.205.206 with SMTP id li14mr2519836wic.33.1370640033783; Fri, 07 Jun 2013 14:20:33 -0700 (PDT) Received: by 10.194.43.227 with HTTP; Fri, 7 Jun 2013 14:20:33 -0700 (PDT) In-Reply-To: References: Date: Fri, 7 Jun 2013 14:20:33 -0700 Message-ID: Subject: Re: Job History files location of 2.0.4 From: Boyu Zhang To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c32b465422e404de97004e X-Virus-Checked: Checked by ClamAV on apache.org --001a11c32b465422e404de97004e Content-Type: text/plain; charset=ISO-8859-1 Hi Shahab, How old were they? > They are new, I did the copy automatically right after the job completed, in a script. I am assuming they were from the jobs run on the older version, right? > I run the job using the hadoop version 2.0.4 if this is what you mean. Or are you looking for new jobs's log that you are running after the > upgrade? > I am looking for new job's log, I did a fresh install of hadoop2.0.4, then run the job, then copied back the entire hdfs directory. > What about the local file systems? Are the logs there still? > Where should I find the logs (job logs, not daemon logs) in the local file systems? Thanks, Boyu > > Regards, > Shahab > > > On Fri, Jun 7, 2013 at 4:56 PM, Boyu Zhang wrote: > >> Thanks Shahab, >> >> I saw the link, but it is not the case for me. I copied everything from >> hdfs ($HADOOP_HOME/bin/hdfs dfs -copyToLocal / $local_dir). But did not see >> the logs. >> >> Did it work for you? >> >> Thanks, >> Boyu >> >> >> On Fri, Jun 7, 2013 at 1:52 PM, Shahab Yunus wrote: >> >>> See this; >>> >>> http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201302.mbox/%3C1360184802.61630.YahooMailNeo@web141205.mail.bf1.yahoo.com%3E >>> >>> Regards, >>> Shahab >>> >>> >>> On Fri, Jun 7, 2013 at 4:33 PM, Boyu Zhang wrote: >>> >>>> Dear All, >>>> >>>> I recently moved from Hadoop0.20.2 to 2.0.4, and I am trying to find >>>> the old job history files (used to be in hdfs, output/_logs/history), it >>>> records detailed time information for every task attempts. >>>> >>>> But now it is not on hdfs anymore, I copied the entire "/" from hdfs to >>>> my local dir, but am not able to find this location. >>>> >>>> Could anyone give any advise on where are the files? >>>> >>>> Thanks, >>>> Boyu >>>> >>> >>> >> > --001a11c32b465422e404de97004e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Shahab,


How old were they?
They are new, I did the copy automatically right after th= e job completed, in a script.

I am assuming they were from the jobs run on the older ver= sion, right?
I run the job using the hadoop version= 2.0.4 if this is what you mean.

Or are you looking for new jobs's log that you are run= ning after the upgrade?
I am looking for new job= 9;s log, I did a fresh install of hadoop2.0.4, then run the job, then copie= d back the entire hdfs directory.
=A0
What about the= local file systems? Are the logs there still?
Where= should I find the logs (job logs, not daemon logs) in the local file syste= ms?

Thanks,
Boyu
=A0

Regards,
Shahab


On Fr= i, Jun 7, 2013 at 4:56 PM, Boyu Zhang <boyuzhang35@gmail.com> wrote:
Thanks = Shahab,

I saw the link, but it is not the case for me. I copie= d everything from hdfs ($HADOOP_HOME/bin/hdfs dfs -copyToLocal / $local_dir= ). But did not see the logs.

Did it work for you?

Thanks,
Boyu
=


On Fri, Jun 7= , 2013 at 1:52 PM, Shahab Yunus <shahab.yunus@gmail.com> wrote:


On Fri, Jun 7, = 2013 at 4:33 PM, Boyu Zhang <boyuzhang35@gmail.com> wrot= e:
De= ar All,

I recently moved from Hadoop0.20.2 to 2.0.4, and I am = trying to find the old job history files (used to be in hdfs, output/_logs/= history), it records detailed time information for every task attempts.

But now it is not on hdfs anymore, I copied the entire "/&qu= ot; from hdfs to my local dir, but am not able to find this location.
Could anyone give any advise on where are the files?

Thanks,
Boyu





--001a11c32b465422e404de97004e--