Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BBE8CD983 for ; Mon, 8 Oct 2012 14:22:20 +0000 (UTC) Received: (qmail 9431 invoked by uid 500); 8 Oct 2012 14:22:16 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 9202 invoked by uid 500); 8 Oct 2012 14:22:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 9186 invoked by uid 99); 8 Oct 2012 14:22:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Oct 2012 14:22:15 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of thealy@bnl.gov designates 130.199.3.132 as permitted sender) Received: from [130.199.3.132] (HELO smtpgw.bnl.gov) (130.199.3.132) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Oct 2012 14:22:06 +0000 X-BNL-policy-q: X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AiY8AHPgclCCx/7+/2dsb2JhbABFiF+FOq9/AgICAoUxPRYYAwIBAgFYCAEBiAGYSqBqjj6DIQOmGYMJ X-IronPort-AV: E=Sophos;i="4.80,554,1344225600"; d="scan'208";a="11505465" Received: from t5.itd.bnl.gov (HELO [130.199.254.254]) ([130.199.254.254]) by smtpgw.sec.bnl.local with ESMTP/TLS/DHE-RSA-CAMELLIA256-SHA; 08 Oct 2012 10:21:45 -0400 Message-ID: <5072E178.5090403@bnl.gov> Date: Mon, 08 Oct 2012 10:21:44 -0400 From: Terry Healy User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: user@hadoop.apache.org Subject: One file per mapper? X-Enigmail-Version: 1.5a1pre Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Hello- I know that it is contrary to normal Hadoop operation, but how can I configure my M/R job to send one complete file to each mapper task? This is intended to be used on many files in the 1.5 MB range as the first step in a chain of processes. thanks.