From dev-return-33341-apmail-directory-dev-archive=directory.apache.org@directory.apache.org Sat May 08 09:14:01 2010 Return-Path: Delivered-To: apmail-directory-dev-archive@www.apache.org Received: (qmail 64604 invoked from network); 8 May 2010 09:14:00 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 8 May 2010 09:14:00 -0000 Received: (qmail 82965 invoked by uid 500); 8 May 2010 09:14:00 -0000 Delivered-To: apmail-directory-dev-archive@directory.apache.org Received: (qmail 82761 invoked by uid 500); 8 May 2010 09:14:00 -0000 Mailing-List: contact dev-help@directory.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Apache Directory Developers List" Delivered-To: mailing list dev@directory.apache.org Received: (qmail 82701 invoked by uid 99); 8 May 2010 09:13:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 May 2010 09:13:59 +0000 X-ASF-Spam-Status: No, hits=-0.4 required=10.0 tests=AWL,FREEMAIL_FROM,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of elecharny@gmail.com designates 74.125.82.50 as permitted sender) Received: from [74.125.82.50] (HELO mail-ww0-f50.google.com) (74.125.82.50) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 May 2010 09:13:52 +0000 Received: by wwb18 with SMTP id 18so322665wwb.37 for ; Sat, 08 May 2010 02:13:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to :user-agent:mime-version:to:subject:content-type :content-transfer-encoding; bh=/TcjkJLLQvr8DTQ7jP5CBgrCaju/LclXVmp+x+odLuA=; b=QcnH9yfNdacEEcqrscWd9mvrcnvmAShekHaKVsUTY2HGEuVMJTkFrXDcz71c7fJIch D+sEOP4O0YMmRg7QPpid1CU95/1VNTEhJegKYNpiWNl5GE5peyV0r56lO8lXzH3MILXm wHiHqegzcxEQBTd4XojS/Rfgf0lRgJ6Pincnk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; b=jkqSNsIs4E6HRFYfvjrD/U/wpjZW/hunOKS72M9zKpabGREpgdOQz0BQ6GdTYevuIG lXxWw3CMcdo34sHvpuidduZSIPa8U4zBE8Y6VZtWVkV9oRPqLXsJU+g/qtlk5B9EbNAP xIGb/jitp60nRu1XckmE7FTZMfRTboXCV0CsQ= Received: by 10.227.157.147 with SMTP id b19mr1127872wbx.84.1273310010755; Sat, 08 May 2010 02:13:30 -0700 (PDT) Received: from emmanuel-lecharnys-MacBook-Pro.local (vol75-3-82-66-216-176.fbx.proxad.net [82.66.216.176]) by mx.google.com with ESMTPS id u8sm22627894wbc.11.2010.05.08.02.13.30 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 08 May 2010 02:13:30 -0700 (PDT) Message-ID: <4BE52B36.4010007@gmail.com> Date: Sat, 08 May 2010 11:13:26 +0200 From: Emmanuel Lecharny Reply-To: elecharny@apache.org User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4 MIME-Version: 1.0 To: Apache Directory Developers List Subject: Search operation : some more speedup Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Hi guys, this morning, I was able to get an extra 3500 search/s on the coreSession.search() operation : up to 21798 search request per second from 18316 req/s yesterday. This is a 2.8 times improvement since I started playing with Yourkit ! The same test done including the network layer (client + server) gives 3763 search per second. Considering that I'm just searching for a single entry from its DN, with one single thread, I would be curious to know what kind of numbers we can get with external injectors pounding the server... There are more to come, but it will be a bit more difficult. The three things we can improve are : - Avoid normalizing twice the same DN - try to use a DN cache to avoid costly parsings - try to avoid cloning the entry before returning it (this is probably the major improvement, as cloning represents almost 40% of the consumed time) I will try to work on the first and third aspects, as they are easier to implement. More to come ... -- Regards, Cordialement, Emmanuel Lécharny www.nextury.com