hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "ZooKeeper/MountRemoteZookeeper" by ebortnik
Date Wed, 15 Jun 2011 20:11:33 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "ZooKeeper/MountRemoteZookeeper" page has been changed by ebortnik:
http://wiki.apache.org/hadoop/ZooKeeper/MountRemoteZookeeper?action=diff&rev1=11&rev2=12

  (containers). Hence, this discussion is largely orthogonal to our proposal. 
  
  Several Distributed Shared Memory (DSM) systems proposed in 1990's implemented sequential
consistency, but hit
- performance bottlenecks around false sharing. ZK is a different case, because the namespace
is structured as a filesystem, 
+ performance bottlenecks around false sharing. ZK is a different case, because the namespace
is structured as a filesystem, which prevents falsely shared accesses. 
- which prevents falsely shared accesses. 
  
- An attempt to describe a similar system was made in http://davidnoblet.com/assets/Research/Papers/ispdc06mojavefs.pdf,
- however this is a very preliminary work that does not address many design issues and lacks
evaluation.
+ We expect the remote partition mounting to be advantageous for workloads with a highly skewed
access pattern:
+ frequent R/W access to one partition, and infrequent R/W access to other partition(s). The
advantages of our proposal are as follows:
+  1. Transparency to clients - there are no semantic differences in accessing multiple partitions.

+  2. Minimum (if any impact) on R/W operations in the home partition - see details below.

  
- === Changes to the API ===
+ 
+ === API/system management modifications ===
  
  Our proposal is to provide ''mount'' and ''unmount'' commands. Mount gets the following
parameters:
   * Identifier of remote ZK cluster.

Mime
View raw message