hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bertrand Dechoux <decho...@gmail.com>
Subject Re: Copy the content of the input splits
Date Thu, 23 Aug 2012 05:43:10 GMT
I don't know any helper class doing it but you could simply open a local
file and with your mapper write all the key/value which are provided.
Now the question is why would you want to do that? If it is in preparation
of a map join, you might want to user a higher abstraction tool (cascading,
pig, hive ...). You also may want to check out how DistributedCache works.

Regards

Bertrand

On Thu, Aug 23, 2012 at 5:18 AM, Grandl Robert <rgrandl@yahoo.com> wrote:

> Hi,
>
> Do you know how I can copy using Hadoop code the content of input splits
> into local files ? I saw something like InputSplit class but still not able
> to figure out how to copy it. Is there somewhere in the code something
> similar I can look at ?
>
> Thanks,
> Robert
>
>


-- 
Bertrand Dechoux

Mime
View raw message