Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <5069C0B0.2090201@cs.uni-kassel.de>
References: <5069C0B0.2090201@cs.uni-kassel.de>
Date: Mon, 1 Oct 2012 10:12:22 -0700
Message-ID: 
 <CA+KHwQb2O4mozqN8ghupGbPVGk3mDKM4o9rYnDcTkgpRyUnRsQ@mail.gmail.com>
Subject: Re: HDFS "file" missing a part-file
From: Robert Molina <rmolina@hortonworks.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf307d034e485a0f04cb0282ac

--20cf307d034e485a0f04cb0282ac
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Bjorn,
Can you post the exception you are getting during the map phase?


On Mon, Oct 1, 2012 at 9:11 AM, Bj=F6rn-Elmar Macek <macek@cs.uni-kassel.de=
>wrote:

> Hi,
>
> i am kind of unsure where to post this problem, but i think it is more
> related to hadoop than to pig.
>
> By successfully executing a pig script i created a new file in my hdfs.
> Sadly though, i cannot use it for further processing except for "dump"ing
> and viewing the data: every data-manipulation script-command just as
> "foreach" gives exceptions during the map phase.
> Since there was no problem executing the same script on the first 100
> lines of my data (LIMIT statement),i copied it to my local fs folder.
> What i realized is, that one of the files namely part-r-000001 was empty
> and contained within the _temporary folder.
>
> Is there any reason for this? How can i fix this issue? Did the job (whic=
h
> created the file we are talking about) NOT run properly til its end,
> although the tasktracker worked til the very end and the file was created=
?
>
> Best regards,
> Bj=F6rn
>

--20cf307d034e485a0f04cb0282ac
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Bjorn,=A0<div>Can you post the exception you are getting during the map =
phase?</div><div><br></div><div><br><br><div class=3D"gmail_quote">On Mon, =
Oct 1, 2012 at 9:11 AM, Bj=F6rn-Elmar Macek <span dir=3D"ltr">&lt;<a href=
=3D"mailto:macek@cs.uni-kassel.de" target=3D"_blank">macek@cs.uni-kassel.de=
</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Hi,<br>
<br>
i am kind of unsure where to post this problem, but i think it is more rela=
ted to hadoop than to pig.<br>
<br>
By successfully executing a pig script i created a new file in my hdfs. Sad=
ly though, i cannot use it for further processing except for &quot;dump&quo=
t;ing and viewing the data: every data-manipulation script-command just as =
&quot;foreach&quot; gives exceptions during the map phase.<br>

Since there was no problem executing the same script on the first 100 lines=
 of my data (LIMIT statement),i copied it to my local fs folder.<br>
What i realized is, that one of the files namely part-r-000001 was empty an=
d contained within the _temporary folder.<br>
<br>
Is there any reason for this? How can i fix this issue? Did the job (which =
created the file we are talking about) NOT run properly til its end, althou=
gh the tasktracker worked til the very end and the file was created?<br>

<br>
Best regards,<br>
Bj=F6rn<br>
</blockquote></div><br></div>

--20cf307d034e485a0f04cb0282ac--