hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christoph Böhm" <listenbru...@gmx.net>
Subject Re: discrepancy du in dfs are fs
Date Wed, 28 Nov 2012 20:10:03 GMT

You're right.
"du -b" returns the expected value.

Thanks.
Chris

-------- Original-Nachricht --------
> Datum: Wed, 28 Nov 2012 20:17:18 +0530
> Von: Mahesh Balija <balijamahesh.mca@gmail.com>
> An: user@hadoop.apache.org
> Betreff: Re: discrepancy du in dfs are fs

> Hi Chris,
> 
>           Can you try the following in your local machine,
> 
>                du -b myfile.txt
> 
>           and compare this with the hadoop fs -du myfile.txt.
> 
> Best,
> Mahesh Balija,
> Calsoft Labs.
> 
> On Wed, Nov 28, 2012 at 7:43 PM, <listenbruder@gmx.net> wrote:
> 
> >
> > Hi all,
> >
> > I wonder wy there is a difference between "du" on HDFS and "get" + "du"
> on
> > my local machnine.
> >
> > Here is an example:
> >
> > hadoop fs -du myfile.txt
> > > 81355258
> >
> > hadoop fs -get myfile.txt .
> > du myfile.txt
> > > 34919
> >
> > --- nevertheless ---
> >
> > hadoop fs -cat  myfile.txt | wc -l
> > > 4789943
> >
> > cat myfile.txt | wc -l
> > > 4789943
> >
> >
> > Any idea?
> > Thanks.
> > Chris
> >

Mime
View raw message