hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Elia Mazzawi <elia.mazz...@casalemedia.com>
Subject Re: can hadoop read files backwards
Date Thu, 17 Jul 2008 21:41:07 GMT

I have a program based on wordcount.java
and I have files that are smaller than 64mb files (so i believe each 
file is one task )

do does wordcount get the lines in order? or are they random? can i have 
hadoop return them in reverse order?

Jim R. Wilson wrote:
> It sounds to me like you're talking about hadoop streaming (correct me
> if I'm wrong there).  In that case, there's really no "order" to the
> lines being doled out as I understand it.  Any given line could be
> handed to any given mapper task running on any given node.
>
> I may be wrong, of course, someone closer to the project could give
> you the right answer in that case.
>
> -- Jim R. Wilson (jimbojw)
>
> On Thu, Jul 17, 2008 at 4:06 PM, Elia Mazzawi
> <elia.mazzawi@casalemedia.com> wrote:
>   
>> is there a way to have hadoop hand over the lines of a file backwards to my
>> mapper ?
>>
>> as in give the last line first.
>>
>>     


Mime
View raw message