hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Blade Liu <hafzc...@gmail.com>
Subject Setting NLinesInputFormat with varaible values in MapReduce
Date Wed, 08 Oct 2014 02:08:37 GMT
Hi folks,

There are several input files to feed into mapper, each of which has
similar format(N is variable in each file)

N,
line1,
line2,
...
lineN

A common practice is to set a fixed value of N
(mapreduce.input.linesinputformat.linespermap). So how to let mapper read
each input file of variable N lines?

Many thanks for your tips.

Cheers,
Blade

Mime
View raw message