hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Reed <br...@yahoo-inc.com>
Subject Re: A record(one text line) is laid across two blocks
Date Tue, 17 Oct 2006 14:34:42 GMT
Most InputFormats handle records that span blocks by always reading one
record into the next block and always skipping the first record of the
block unless it is reading the first block.


김형준 wrote:
> I have a question.
> If a record(one text line) is laid across two blocks, map function  can't process that
> because the line from TextInputFormat is not complete line.
> How do I resolve this problem?
> Does HDFS support line formatted upload?(like DFSTextOutputStream),
> Thank for your reply.

View raw message