hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Bhattacharjee <rahul.rec....@gmail.com>
Subject Re: Number of records in an HDFS file
Date Mon, 13 May 2013 18:04:24 GMT
few pointers.

what kind of files are we talking about. for text you can use wc , for avro
data files you can use avro-tools.

or get the job that pig is generating , get the counters for that job from
the jt of your hadoop cluster.

Thanks,
Rahul


On Mon, May 13, 2013 at 11:21 PM, Mix Nin <pig.mixed@gmail.com> wrote:

> Hello,
>
> What is the bets way to get the count of records in an HDFS file generated
> by a PIG script.
>
> Thanks
>
>

Mime
View raw message