Return-Path: Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: (qmail 61869 invoked from network); 1 Feb 2011 19:22:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Feb 2011 19:22:54 -0000 Received: (qmail 69305 invoked by uid 500); 1 Feb 2011 19:22:54 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 69214 invoked by uid 500); 1 Feb 2011 19:22:53 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 69206 invoked by uid 99); 1 Feb 2011 19:22:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Feb 2011 19:22:53 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tsunanet@gmail.com designates 74.125.82.51 as permitted sender) Received: from [74.125.82.51] (HELO mail-ww0-f51.google.com) (74.125.82.51) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Feb 2011 19:22:49 +0000 Received: by wwe15 with SMTP id 15so7134364wwe.20 for ; Tue, 01 Feb 2011 11:22:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=mXLStXX0geYU4W0iBsT4LR1Den2iAG1iq29w4Zir1g4=; b=UDuqdGUhjNQwnUfKNmCgx6FClBMZttJjuPBq1iYYA/VC4WES6WngpsJj4Jd+VyO8/g 3PgILM6nbkPMYnNhj1N2iA7PDqSbZFXm3nagX1T96zLzM9zNzz5UtZb666ZhpGAvK5gH 6VCU3ZVpAfyf5DBoZrk2BsjeNX1TnJomrD7Zg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=oVtFH59mNqDIkZpm+Wis5vFx4WuV2CD2V1640HFaaetEBwzpmHkNfsPKQqivjD566s IBs/NlHaR1te3BXi3+W/88qcAe7ug/aOKmuYPQXTbq7Ylj0MUQSD7EVN4rzN4oDVB4Qz py3lFojDVA+7mrPuFYPhRUS1140zWG+KxjFcU= Received: by 10.216.2.68 with SMTP id 46mr7403581wee.71.1296588144669; Tue, 01 Feb 2011 11:22:24 -0800 (PST) MIME-Version: 1.0 Received: by 10.216.153.105 with HTTP; Tue, 1 Feb 2011 11:22:04 -0800 (PST) In-Reply-To: References: From: tsuna Date: Tue, 1 Feb 2011 11:22:04 -0800 Message-ID: Subject: Re: write performance degradation To: dev@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 On Tue, Feb 1, 2011 at 7:40 AM, Ted Yu wrote: > Thanks for the reminder. > > After adjusting swappiness to 2 on each node, I see: > http://pastebin.com/tFcAj7rw > > Client buffer is now 10MB. > But map tasks seem to be slower than before. The output of vmstat doesn't show anything useful here, the machine is 100% idle up until the 3rd section where it's reading a bit from disk, but it's still mostly idle. Something else that we don't see from this trace is amiss. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com