Return-Path: 
 <user-return-17318-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id A81EE17C53
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Wed,  8 Oct 2014 02:09:09 +0000 (UTC)
Received: (qmail 61686 invoked by uid 500); 8 Oct 2014 02:09:04 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 61544 invoked by uid 500); 8 Oct 2014 02:09:04 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 61534 invoked by uid 99); 8 Oct 2014 02:09:03 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Oct 2014 02:09:03 +0000
X-ASF-Spam-Status: No, hits=3.1 required=5.0
	tests=HK_RANDOM_ENVFROM,HK_RANDOM_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of hafzcdcn@gmail.com designates
 209.85.212.182 as permitted sender)
Received: from [209.85.212.182] (HELO mail-wi0-f182.google.com)
 (209.85.212.182)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Oct 2014 02:08:58 +0000
Received: by mail-wi0-f182.google.com with SMTP id n3so9544455wiv.15
        for <user@hadoop.apache.org>; Tue, 07 Oct 2014 19:08:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=6SO3vAq9tvkxA4CpjcbEKckml1DoYOFogsNbaeOlRPs=;
        b=AGPd94TJ7HwIQHHfabbvdPYe2rpB6fnPZbiQtk+VzkI+6CVofggdZasVaH893ZMN6u
         sVaeFxgMYnJgPRSxlYjGPwGsEGfI1yAWZuUuRgLrS4ftTpjfJPI9GZVlGGUgH4H0Kd9C
         2d2X2C9izYdve44P3ptFYqBFMhSf/O5Q+WPpwfRTys7kFLumFoT+ju0meKJ02pE68FoC
         7o9AuKl8Y6KnkVk0PxQC1FHww/zAzHbBUPsxjmszyZIT7GXSpglE6J7rdJmnX/hfDCpq
         zkMGSaX5zEWa943nhYBtFBqUl+CFaAub7gYHREV8y9FHOF6gCZHd3jospIwGnmyPPRq2
         zKrg==
MIME-Version: 1.0
X-Received: by 10.181.13.165 with SMTP id ez5mr8438057wid.64.1412734117122;
 Tue, 07 Oct 2014 19:08:37 -0700 (PDT)
Received: by 10.180.100.164 with HTTP; Tue, 7 Oct 2014 19:08:37 -0700 (PDT)
Date: Wed, 8 Oct 2014 10:08:37 +0800
Message-ID: 
 <CAAFSTDUZrzApMOnDw7UyJ=Z9nQFynhDY+r-LhcFzxQUQmoGwLA@mail.gmail.com>
Subject: Setting NLinesInputFormat with varaible values in MapReduce
From: Blade Liu <hafzcdcn@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d043c80d03698370504dfcbf3
X-Virus-Checked: Checked by ClamAV on apache.org

--f46d043c80d03698370504dfcbf3
Content-Type: text/plain; charset=UTF-8

Hi folks,

There are several input files to feed into mapper, each of which has
similar format(N is variable in each file)

N,
line1,
line2,
...
lineN

A common practice is to set a fixed value of N
(mapreduce.input.linesinputformat.linespermap). So how to let mapper read
each input file of variable N lines?

Many thanks for your tips.

Cheers,
Blade

--f46d043c80d03698370504dfcbf3
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi folks,<div><br></div><div>There are several input files=
 to feed into mapper, each of which has similar format(N is variable in eac=
h file)</div><div><br></div><div>N,</div><div>line1,</div><div>line2,</div>=
<div>...</div><div>lineN</div><div><br></div><div>A common practice is to s=
et a fixed value of N (mapreduce.input.linesinputformat.linespermap). So ho=
w to let mapper read each input file of variable N lines?</div><div><br></d=
iv><div>Many thanks for your tips.</div><div><br></div><div>Cheers,</div><d=
iv>Blade</div></div>

--f46d043c80d03698370504dfcbf3--