hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: How to count rows of output files ?
Date Tue, 08 Mar 2011 10:24:35 GMT
Count them as you sink using the Counters functionality of Hadoop
Map/Reduce (If you're using MultipleOutputs, it has a way to enable
counters for each name used). You can then aggregate related counters
post-job, if needed.

On Tue, Mar 8, 2011 at 3:11 PM, Jun Young Kim <juneng603@gmail.com> wrote:
> Hi.
>
> my hadoop application generated several output files by a single job.
> (for example, A, B, C are generated as a result)
>
> after finishing a job, I want to count each files' row counts.
>
> is there any way to count each files?
>
> thanks.
>
> --
> Junyoung Kim (juneng603@gmail.com)
>
>



-- 
Harsh J
www.harshj.com

Mime
View raw message