hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Virtual Hadoop" by SteveLoughran
Date Wed, 05 Oct 2011 20:55:36 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Virtual Hadoop" page has been changed by SteveLoughran:

   1. If the cluster is idle. some machines can be decomissioned.
   1. If the cluster is overloaded, some temporary TaskTracker only servers can be brought
up for short periods of time, and killed when no longer needed.
   1. If the cluster needs to be expanded for a longer duration, worker nodes acting as both
a DataNode and TaskTracker can be brought up.
+  1. If the entire cluster goes down or restarts, all transient hard disks will be lost,
and all data stored within the HDFS cluster with it.
  The most significant implication is in storage. A core architectural design of both Google's
GFS and Hadoop's GFS is that three-way replication onto local storage is the lowest cost way
of storing Petabytes of data. 

View raw message