hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "HdfsFutures" by SanjayRadia
Date Fri, 28 Mar 2008 00:38:15 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by SanjayRadia:
http://wiki.apache.org/hadoop/HdfsFutures

------------------------------------------------------------------------------
  
  Below is a categorized list and descriptions of HDFS Future Features
  
- 
- '''The following page is under development - it is being converted from TWiki to Wiki'''
  
  == Goal: HDFS for Production Use ==
  
@@ -31, +29 @@

  
  == Service Scaling ==
  
+ This means scaling the Name Service (aka Namenode) and the number of Datanodes that can
be present in a 
+ HDFS system.
  
- There are two main issues here
+ For scaling the Name service (Namenode), there are two main issues here
     * scaling the name space (i.e. the number of files and directories we can handle
     * scale the performance of the name service - i.e. its throughput and latency and in
particular the number of concurrent clients
  Improving one  may improve the other.
     * E.g. moving Block map functionality to slave NNs will free up storage for Name entries
     * E.g. Paritioning name space can also improve performance of each NN slave
  
- === Summary of various options that scale name space and performance (details below) ===
+ === Summary of various options that scale name space and its performance (details below)
===
   (Also see attachment:ScaleNN_Sea_of_Options.pdf)
     * Grow memory
        * Scales name space but not performance

Mime
View raw message