Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification. The following page has been changed by SanjayRadia: http://wiki.apache.org/hadoop/HdfsFutures ------------------------------------------------------------------------------ Below is a categorized list and descriptions of HDFS Future Features - - '''The following page is under development - it is being converted from TWiki to Wiki''' == Goal: HDFS for Production Use == @@ -31, +29 @@ == Service Scaling == + This means scaling the Name Service (aka Namenode) and the number of Datanodes that can be present in a + HDFS system. - There are two main issues here + For scaling the Name service (Namenode), there are two main issues here * scaling the name space (i.e. the number of files and directories we can handle * scale the performance of the name service - i.e. its throughput and latency and in particular the number of concurrent clients Improving one may improve the other. * E.g. moving Block map functionality to slave NNs will free up storage for Name entries * E.g. Paritioning name space can also improve performance of each NN slave - === Summary of various options that scale name space and performance (details below) === + === Summary of various options that scale name space and its performance (details below) === (Also see attachment:ScaleNN_Sea_of_Options.pdf) * Grow memory * Scales name space but not performance