Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 56423 invoked from network); 15 Dec 2010 20:17:17 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Dec 2010 20:17:17 -0000 Received: (qmail 75868 invoked by uid 500); 15 Dec 2010 20:17:14 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 75829 invoked by uid 500); 15 Dec 2010 20:17:14 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 75821 invoked by uid 99); 15 Dec 2010 20:17:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Dec 2010 20:17:14 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of awittenauer@linkedin.com designates 69.28.149.25 as permitted sender) Received: from [69.28.149.25] (HELO esv4-mav03.corp.linkedin.com) (69.28.149.25) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Dec 2010 20:17:09 +0000 DomainKey-Signature: s=prod; d=linkedin.com; c=nofws; q=dns; h=X-IronPort-AV:Received:From:To:Subject:Thread-Topic: Thread-Index:Date:Message-ID:References:In-Reply-To: Accept-Language:Content-Language:X-MS-Has-Attach: X-MS-TNEF-Correlator:x-originating-ip:Content-Type: Content-ID:Content-Transfer-Encoding:MIME-Version; b=n27+4cqupFIt5Bkn/CgCtN/nKrkxTN4I060R6tw4J1hhOpMFEQGDRT3F X/LvTIl+dV8Plkljx59nu/bhgEl/w0r1rYPMGoM7qKY9p2dkdsSsrd8AL YTYJ8YRlJuzbQNw; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linkedin.com; i=awittenauer@linkedin.com; q=dns/txt; s=proddkim; t=1292444227; x=1323980227; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Allen=20Wittenauer=20 |Subject:=20Re:=20Deprecated=20...=20damaged?|Date:=20Wed ,=2015=20Dec=202010=2020:16:48=20+0000|Message-ID:=20<868 118FD-BB6F-49B3-9F6D-0470B45D6274@linkedin.com>|To:=20""=20|MIME-Version:=201.0|Content-Transfer-Encoding:=20 quoted-printable|Content-ID:=20|In-Reply-To:=20<71743C3E-C6A3-4B57- 98FF-4F58D5720DCB@umail.ucsb.edu>|References:=20<71743C3E -C6A3-4B57-98FF-4F58D5720DCB@umail.ucsb.edu>; bh=gL+jqLstS7DLzrk5waAWnfTSspF63dAUdMdHQqWGB6s=; b=K5wRca9dLZWnZIZ5cow8oxSLFGTR+5qpeh7S6nyOJWrp3D/JDxguyjS7 KmQSf0E5SX+8DhAEtavn0i8Fr46D1x3d3UircGKzwPfzqf8FCxtjTxwMi XZJxGw0pNh4/Saw; X-IronPort-AV: E=Sophos;i="4.59,350,1288594800"; d="scan'208";a="18378007" Received: from ESV4-EXC01.linkedin.biz ([fe80::d7c:dc04:aea1:97d7]) by esv4-cas02.linkedin.biz ([172.18.46.142]) with mapi id 14.01.0218.012; Wed, 15 Dec 2010 12:16:49 -0800 From: Allen Wittenauer To: "" Subject: Re: Deprecated ... damaged? Thread-Topic: Deprecated ... damaged? Thread-Index: AQHLnEDkgxaMxPZIaUmBAMcJK6ky/JOid5mA Date: Wed, 15 Dec 2010 20:16:48 +0000 Message-ID: <868118FD-BB6F-49B3-9F6D-0470B45D6274@linkedin.com> References: <71743C3E-C6A3-4B57-98FF-4F58D5720DCB@umail.ucsb.edu> In-Reply-To: <71743C3E-C6A3-4B57-98FF-4F58D5720DCB@umail.ucsb.edu> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.18.46.247] Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 On Dec 15, 2010, at 2:13 AM, maha wrote: > Hi everyone, >=20 > Using Hadoop-0.20.2, I'm trying to use MultiFileInputFormat which is sup= posed to put each file from the input directory in a SEPARATE split. Is there some reason you don't just use normal InputFormat with an extreme= ly high min.split.size?