hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "HedWig/TopicManagement" by ErwinTam
Date Tue, 11 Jan 2011 19:19:18 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "HedWig/TopicManagement" page has been changed by ErwinTam.
http://wiki.apache.org/hadoop/HedWig/TopicManagement?action=diff&rev1=4&rev2=5

--------------------------------------------------

  Metadata about topics, subscribers, and hubs will be stored in ZooKeeper. For a given Hedwig
region, we will store the following structure:
  
  The rectangles in this diagram are znodes; rectangles with dashed borders are ephemeral
znodes.
-    * '''hedwig''' is the root. If the !ZooKeeper instance is shared between regions, then
there would be a region-specific root.
+    * '''hedwig''' is the root. If the ZooKeeper instance is shared between regions, then
there would be a region-specific root.
        * '''regionname''' is the region this Hedwig cluster lives in.
           * '''topics''' is the root for the topics subtree. All topics that have been created
live under this root.
              * '''T1, T2 ... ''' are nodes for each topic. The nodes are named by the topic
name. The fact that a topic has a node under the '''Topics''' node means that the topic exists.
If we had any other topic metadata (like permissions) that we wanted to store, we could store
them as the content of the node.

Mime
View raw message