hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "ZooKeeper/ServiceLatencyOverview" by PatrickHunt
Date Wed, 28 Oct 2009 16:27:39 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "ZooKeeper/ServiceLatencyOverview" page has been changed by PatrickHunt.
http://wiki.apache.org/hadoop/ZooKeeper/ServiceLatencyOverview?action=diff&rev1=26&rev2=27

--------------------------------------------------

  All systems were dual quad core Intel(R) Xeon(R) CPUs running at 2.50GHz. Eight cores were
available however as noted below Linux's processor affinity feature was used to limit CPU
availability to the JVM. In the tests below I use 1, 2, or 4 cores from the first CPU (taskset
0x01 or 0x03 or 0x0f respectively).
  
  All systems had 16gig ECC memory available, however unless specifically noted the JVM's
-Xmx option was used to limit the size of the JVM heap to 512m.
+ 
+ All systems are interconnected with 1gig ethernet, approximate ping time is steady at 0.09ms
roundtrip.
+  * scp host60:/tmp/test /tmp/test
+   * test 100%  513MB  64.1MB/s   00:08  
  
  All systems had 7200RPM SATA drives
   * hdparm -tT reported:
@@ -28, +32 @@

  
  During the tests the snapshot (on disk copy of the znode data) reached approximately 100meg
in size (as mentioned previously the JVM heap is limited to 512 meg), by default transactional
log files are pre-allocated to ~60meg. Additional snapshots and logs are written as needed.
Depending on your workload, the frequency of your snap/log cleanup, and your cluster configuration
you should allow sufficient storage space. For example running a 20 client test required approximately
5 gig of disk storage. (the tests were not cleaning up old snaps/logs, so this was accumulated
over the test lifetime).
  
- All systems are interconnected with 1gig ethernet, approximate ping time is steady at 0.09ms
roundtrip.
- 
  === Operating System ===
  
  Linux version 2.6.18-53.1.13.el5 compiled using gcc version 4.1.2 20070626 (Red Hat 4.1.2-14))

Mime
View raw message