Return-Path: 
 <user-return-13133-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id E966E10716
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Fri, 10 Jan 2014 09:25:08 +0000 (UTC)
Received: (qmail 77849 invoked by uid 500); 10 Jan 2014 09:22:08 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 77599 invoked by uid 500); 10 Jan 2014 09:21:52 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 77561 invoked by uid 99); 10 Jan 2014 09:21:48 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jan 2014 09:21:48 +0000
X-ASF-Spam-Status: No, hits=1.7 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of kchew534@gmail.com designates
 209.85.217.172 as permitted sender)
Received: from [209.85.217.172] (HELO mail-lb0-f172.google.com)
 (209.85.217.172)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jan 2014 09:21:41 +0000
Received: by mail-lb0-f172.google.com with SMTP id x18so3187257lbi.17
        for <user@hadoop.apache.org>; Fri, 10 Jan 2014 01:21:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=1rW6FlA3mzNstkyVofYtZbIEvAUEJkJMzXMjgElZ0o8=;
        b=coxorhGhBB5roEAk33d5mGzy6Ih55/q3jQZXJOsz2BCF/+gFtszFqvfkdAcRdtk6FG
         aKyDMuENZzBkV8Fwv5y8TK1wgSv6gadCXLtzfRr8obesMHxaBzf6m9qiz3r3it95I1TF
         phMSmEvlL5WXrQ6dV0j40BCEYTCLltUC6OKEWZEkpkrVc8bz7YctO9wZMZszUu7vh6XZ
         cWuqbMFu18QvDvuzrH+SL3hrkmPNtbH1aq6avHmKgCPzUMExMiWPxoUi26XWpQUV+/1N
         bN5ZSeLgKKVJjv1xhBcOhA/Y3Nq4osTh/AXtixb9Wh9zDc7It/KCa6QheeKf+muvoK2Q
         rmcw==
MIME-Version: 1.0
X-Received: by 10.112.139.35 with SMTP id qv3mr3085033lbb.47.1389345679513;
 Fri, 10 Jan 2014 01:21:19 -0800 (PST)
Received: by 10.112.199.233 with HTTP; Fri, 10 Jan 2014 01:21:19 -0800 (PST)
Date: Fri, 10 Jan 2014 01:21:19 -0800
Message-ID: 
 <CAOTDg_TrWF8BERorGknwZQKCFcU=AkxHc9E8nE-Rs2RKFn710Q@mail.gmail.com>
Subject: Reading multiple input files.
From: Kim Chew <kchew534@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e0115fb12b29f1404ef9a3f4a
X-Virus-Checked: Checked by ClamAV on apache.org

--089e0115fb12b29f1404ef9a3f4a
Content-Type: text/plain; charset=UTF-8

How does a MR job read multiple input files from different locations?

What if the input files are not in hdfs and located on different servers?
Do I have to copy them to hdfs first and instruct my MR job to read from
them? Can I instruct my MR job to read directly from those servers?

Thanks.

Kim

--089e0115fb12b29f1404ef9a3f4a
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>How does a MR job read multiple input files from=
 different locations?<br><br></div>What if the input files are not in hdfs =
and located on different servers? Do I have to copy them to hdfs first and =
instruct my MR job to read from them? Can I instruct my MR job to read dire=
ctly from those servers?<br>
<br></div>Thanks.<br><br>Kim<br></div>

--089e0115fb12b29f1404ef9a3f4a--