hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "DevelopmentHints" by OwenOMalley
Date Fri, 14 Sep 2007 18:13:59 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by OwenOMalley:
http://wiki.apache.org/lucene-hadoop/DevelopmentHints

------------------------------------------------------------------------------
  grep ' discard'  < logfile | sed -e 's/[^ ]* //' -e 's/,.*//' | sort | uniq -c
  }}}
  
+ the output looks like:
+ 
+ {{{
+       1 00:00:34
+       1 00:03:05
+     798 00:04:34
+     600 00:04:35
+      85 00:04:36
+     132 00:04:37
+    1347 00:04:38
+ }}}
+ 
  When RPCs timeout on the server side, the server dumps the thread stacks, but the stacks
have newlines in them so they don't work well with the normal unix tools. So I wrote a little
sed script that scans a log file and produces one line for each thread:
  
  {{{
@@ -17, +29 @@

         -e ':inner' -e n -e '/^ /{H;b inner;}' -e '{x;s/\n/ /g;p;x;b start}' < logfile
  }}}
  
- Once you have each thread you can do things like look at what is blocking the various threads:
+ Once you have each thread on a separate line you can do things like look at what is blocking
the various threads:
  
  {{{
  grep 'BLOCKED' < stacks | sed -e 's/.*Blocked on //' -e 's/ .*//' | sort | uniq -c

Mime
View raw message