Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 31436 invoked from network); 28 Jun 2006 21:13:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 28 Jun 2006 21:13:59 -0000 Received: (qmail 25320 invoked by uid 500); 28 Jun 2006 21:13:53 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 25033 invoked by uid 500); 28 Jun 2006 21:13:52 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 24888 invoked by uid 99); 28 Jun 2006 21:13:51 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2006 14:13:51 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2006 14:13:49 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5397B7141FA for ; Wed, 28 Jun 2006 21:11:56 +0000 (GMT) Message-ID: <11763326.1151529116339.JavaMail.jira@brutus> Date: Wed, 28 Jun 2006 21:11:56 +0000 (GMT+00:00) From: "Doug Cutting (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-165) long response times from task trackers under load In-Reply-To: <28414302.1145982857680.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-165?page=all ] Doug Cutting updated HADOOP-165: -------------------------------- Fix Version: 0.5.0 (was: 0.4.0) > long response times from task trackers under load > ------------------------------------------------- > > Key: HADOOP-165 > URL: http://issues.apache.org/jira/browse/HADOOP-165 > Project: Hadoop > Type: Bug > Components: mapred > Versions: 0.2.0 > Environment: 190 redhat linux boxes, each with 2 hyperthreaded cpus, 2gb memory > Reporter: Owen O'Malley > Assignee: Owen O'Malley > Fix For: 0.5.0 > > we are seeing very slow response times from the task tracker. I put in some instrumentation to measure how long each call took for the RPC.Sever code to run the method (so it does not include serialization/deserialization time). The top of the list (in ms) looks like: > 7581 progress node1192 > 7022 ping node1192 > 5393 ping node1162 > 4854 progress node1162 > 4749 progress node1194 > 4709 ping node1194 > 3813 ping node1100 > 3486 ping node1190 > 3266 progress node1190 > 3187 progress node1265 > 3078 ping node1203 > 2972 progress node1203 > 2947 progress node1240 > 2889 progress node1100 > 2875 ping node1116 > 2843 ping node1189 > 2772 ping node1183 > 2737 ping node1110 > 2727 progress node1183 > 2710 ping node1123 > 2563 ping node1304 > 2527 progress node1144 > 2479 ping node1137 > 2476 progress node1304 > 2430 ping node1240 > 2416 ping node1144 > 2377 progress node1176 > 2339 ping node1109 > 2321 progress node1114 > 2311 ping node1157 > 2185 ping node1265 > 2185 ping node1109 > 2172 ping node1114 > 2145 progress node1109 > 2127 ping node1176 > 2083 progress node1189 > 2076 ping node1229 > 2073 progress node1188 > 2072 progress node1123 > 2048 ping node1161 > 2003 progress node1110 > 1989 ping node1180 > 1963 ping node1114 -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira