hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen O'Malley <omal...@apache.org>
Subject Re: can one map instance handle many data of input paths at the same time
Date Thu, 20 Jan 2011 18:32:54 GMT
As defined in http://hadoop.apache.org/mailing_lists.html , please  
send user questions to
mapreduce-user@hadoop.apache.org.

-- Owen

On Jan 20, 2011, at 10:21 AM, Eric Sammer wrote:

> LiuLei:
>
> Yes. What you're looking for is TextInputFormat.addPath() (assuming  
> you're
> talking about text). You can call this multiple times and add  
> multiple input
> paths if they are all of the same data format (i.e. text). If you have
> multiple paths that contain different format data, you'll need to use
> MultipleInputs. See the javadoc for details on usage.
>
> On Thu, Jan 20, 2011 at 1:52 AM, lei liu <liulei412@gmail.com> wrote:
>
>> There are two input paths, example: /user/test1/ and /user/test2/  
>> path.
>> Can
>> one map instance handle many data of input paths at the same time?
>>
>>
>> Thanks,
>>
>> LiuLei
>>
>
>
>
> -- 
> Eric Sammer
> twitter: esammer
> data: www.cloudera.com


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message