Return-Path: X-Original-To: apmail-httpd-users-archive@www.apache.org Delivered-To: apmail-httpd-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 40A409B73 for ; Fri, 9 Mar 2012 10:34:53 +0000 (UTC) Received: (qmail 59549 invoked by uid 500); 9 Mar 2012 10:34:50 -0000 Delivered-To: apmail-httpd-users-archive@httpd.apache.org Received: (qmail 59519 invoked by uid 500); 9 Mar 2012 10:34:50 -0000 Mailing-List: contact users-help@httpd.apache.org; run by ezmlm Precedence: bulk Reply-To: users@httpd.apache.org list-help: list-unsubscribe: List-Post: List-Id: Delivered-To: mailing list users@httpd.apache.org Received: (qmail 59510 invoked by uid 99); 9 Mar 2012 10:34:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Mar 2012 10:34:50 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of simone.frattegiani@gmail.com designates 209.85.160.45 as permitted sender) Received: from [209.85.160.45] (HELO mail-pw0-f45.google.com) (209.85.160.45) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Mar 2012 10:34:43 +0000 Received: by pbcuo5 with SMTP id uo5so2550267pbc.18 for ; Fri, 09 Mar 2012 02:34:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=OyQ2rpJ8QnCPbOO23OGw+e2i+XN/kxSTuQF6smMb2dE=; b=zvSr/DT+bXO9DnbRzFMaW7H784nUEfKdb9QcyAH4+xlSDbCanYWrb2+1N9MkjH+M8E WN4/lHgNnBkmOr1R12NXS+Cj+40/Als1U0xZhrwPq/iXYD1WZ3leiZxI6aI4X0GHXUR2 RMufz1akuTekbX1ZRc9l2gvUL4134SD8cmn1jMcoUsuwOyBk+MD+I8GiWq2npgh+PxIe Y+Em/8G0SZvkEj7cuoMkaJbiDNDq7iwI/+EHxDuiBjgLmAXjGtM+yPYog9YIH3uB0TTt A8BTMB3t1oW6A8Nh/CkQIw9zfUqUhzjt3v49t1UPRDyIVghtDZQ/dr/hMhjXjA5E29w/ Q9Ag== MIME-Version: 1.0 Received: by 10.68.240.135 with SMTP id wa7mr3764773pbc.7.1331289262475; Fri, 09 Mar 2012 02:34:22 -0800 (PST) Received: by 10.68.34.167 with HTTP; Fri, 9 Mar 2012 02:34:22 -0800 (PST) In-Reply-To: References: Date: Fri, 9 Mar 2012 11:34:22 +0100 Message-ID: From: Simone Frattegiani To: users@httpd.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Subject: Re: [users@httpd] suddendly high cpu load because of googlebot Hello, thanks for your reply. Here are my settings (never changed them): Timeout 60 KeepAlive On MaxKeepAliveRequests 100 KeepAliveTimeout 1 On Fri, Mar 9, 2012 at 11:11 AM, Igor Cicimov wrote: > What are your TimeOut and KeepAliveTimeout values? > > On Mar 9, 2012 7:08 PM, "Simone Frattegiani" > wrote: >> >> Hello, >> >> i suddendly started having CPU load issues, like this: >> >> top - 03:52:04 up 3 days, 8:52, 0 users, load average: 74.35, 73.66, 71.= 41 >> Tasks: 304 total, 75 running, 229 sleeping, 0 stopped, 0 zombie >> Cpu(s): 72.1%us, 2.0%sy, 0.1%ni, 23.9%id, 1.2%wa, 0.4%hi, 0.4%si, 0.0%st >> Mem: 3115464k total, 2840484k used, 274980k free, 197472k buffers >> Swap: 5177336k total, 76k used, 5177260k free, 1702148k cached >> >> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND >> 19392 apache 25 0 34096 15m 3548 R 19.6 0.5 0:10.49 /usr/sbin/httpd -k >> start -DSSL >> 19480 apache 24 0 34172 15m 3788 R 19.6 0.5 0:04.79 /usr/sbin/httpd -k >> start -DSSL >> 19481 apache 25 0 34048 14m 3436 R 19.6 0.5 0:10.49 /usr/sbin/httpd -k >> start -DSSL >> 19482 apache 25 0 34180 14m 3500 R 19.6 0.5 0:06.63 /usr/sbin/httpd -k >> start -DSSL >> 19881 apache 25 0 34048 14m 3436 R 19.6 0.5 0:10.49 /usr/sbin/httpd -k >> start -DSSL >> 20262 root 20 0 2424 1032 696 R 2.0 0.0 0:00.01 /usr/bin/top -c -b -n 1 >> 1 root 15 0 2160 596 516 S 0.0 0.0 0:00.62 init [3] >> 2 root RT -5 0 0 0 S 0.0 0.0 0:00.00 [migration/0] >> 3 root 34 19 0 0 0 R 0.0 0.0 0:00.00 [ksoftirqd/0] >> 4 root RT -5 0 0 0 S 0.0 0.0 0:00.00 [watchdog/0] >> >> [...] >> >> >> I can also see from my panel that apache spawned like 50 children, >> which is very unusual. >> >> >> Server-status shows this: >> >> Total Accesses: 292068 >> Total kBytes: 5540956 >> CPULoad: .0884054 >> Uptime: 45823 >> ReqPerSec: 6.37383 >> BytesPerSec: 123823 >> BytesPerReq: 19426.8 >> BusyWorkers: 99 >> IdleWorkers: 10 >> Scoreboard: WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW >> >> WWWWWWWWWWWWWWWWWWWWWWWWWWKWWWWWCWWWWWWWWWKWWWWWWWWWWKWWW_W_CWWW__WS__K_= WWK__K_S........ >> ........................................................ >> ................................................... >> >> With hundreds of lines like this (66.249.66.44 is googlebot): >> >> 24-0 - 0/0/8 . 0.02 661 34 0.0 0.00 0.00 66.249.66.44 >> www.mydomain.com =A0 =A0 =A0 =A0GET /mypage >> >> So, please correct me if i'm wrong, that 661 in the SS column means >> that 661 seconds have passed since the last time Googlebot used that >> slot to make a request... so basically the server is keeping alive a >> connection that has been idle for like 11 minutes!! >> Did i understand correctly? Is it normal? Is it what is causing the >> problem? >> >> The commands "netstat -a | grep 66.249" shows 20 connections from >> googlebot ip, 1 in ESTABILISHEd status, the others in TIME WAIT. >> >> If i restart apache, everything gets back to normal. >> >> Any suggestions? >> THanks! >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org >> For additional commands, e-mail: users-help@httpd.apache.org >> > --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org For additional commands, e-mail: users-help@httpd.apache.org