hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Balija <balijamahesh....@gmail.com>
Subject Re: discrepancy du in dfs are fs
Date Wed, 28 Nov 2012 14:47:18 GMT
Hi Chris,

          Can you try the following in your local machine,

               du -b myfile.txt

          and compare this with the hadoop fs -du myfile.txt.

Best,
Mahesh Balija,
Calsoft Labs.

On Wed, Nov 28, 2012 at 7:43 PM, <listenbruder@gmx.net> wrote:

>
> Hi all,
>
> I wonder wy there is a difference between "du" on HDFS and "get" + "du" on
> my local machnine.
>
> Here is an example:
>
> hadoop fs -du myfile.txt
> > 81355258
>
> hadoop fs -get myfile.txt .
> du myfile.txt
> > 34919
>
> --- nevertheless ---
>
> hadoop fs -cat  myfile.txt | wc -l
> > 4789943
>
> cat myfile.txt | wc -l
> > 4789943
>
>
> Any idea?
> Thanks.
> Chris
>

Mime
View raw message