hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mohanpothula <mohanpoth...@gmail.com>
Subject Terasort query
Date Thu, 23 Jul 2015 02:03:10 GMT
I have setup 3 node cluster each node having 100GB for configured VM on 3
nodes .
When I did Terasort first time ,very less space reserved for NonHDFS , due
to that blocks are corrupted on 3 nodes .Again I had setup the cluster with
300GB on each node .
To get HDFS size use the below command on each node .
 sudo -u hdfs hadoop fs -du -h /
0        0       /system
3.4 M    10.1 M  /tmp
385.1 M  1.1 G   /user

There are total 4 GB used for HDFS

Can you please help on the below  terasort testing on 3 node cluster

1.How much HDFS size?
2.How much Non HDFS size?
3.Any customization parameters are required?

Regards,
Mohan

Mime
View raw message