hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Sammer <esam...@cloudera.com>
Subject Re: can one map instance handle many data of input paths at the same time
Date Thu, 20 Jan 2011 18:21:25 GMT
LiuLei:

Yes. What you're looking for is TextInputFormat.addPath() (assuming you're
talking about text). You can call this multiple times and add multiple input
paths if they are all of the same data format (i.e. text). If you have
multiple paths that contain different format data, you'll need to use
MultipleInputs. See the javadoc for details on usage.

On Thu, Jan 20, 2011 at 1:52 AM, lei liu <liulei412@gmail.com> wrote:

> There are two input paths, example: /user/test1/ and /user/test2/ path.
>  Can
> one map instance handle many data of input paths at the same time?
>
>
> Thanks,
>
> LiuLei
>



-- 
Eric Sammer
twitter: esammer
data: www.cloudera.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message