Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5F1A4200C33 for ; Sat, 11 Mar 2017 21:52:20 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 5D8A3160B7B; Sat, 11 Mar 2017 20:52:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 80C96160B64 for ; Sat, 11 Mar 2017 21:52:19 +0100 (CET) Received: (qmail 29952 invoked by uid 500); 11 Mar 2017 20:51:40 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 29942 invoked by uid 99); 11 Mar 2017 20:51:40 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Mar 2017 20:51:40 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 6D26C186142 for ; Sat, 11 Mar 2017 20:51:40 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.98 X-Spam-Level: * X-Spam-Status: No, score=1.98 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=scylladb-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Dh9QFihizBAz for ; Sat, 11 Mar 2017 20:51:38 +0000 (UTC) Received: from mail-wm0-f50.google.com (mail-wm0-f50.google.com [74.125.82.50]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 43CB05FAE6 for ; Sat, 11 Mar 2017 20:51:38 +0000 (UTC) Received: by mail-wm0-f50.google.com with SMTP id n11so16582254wma.1 for ; Sat, 11 Mar 2017 12:51:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=scylladb-com.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=QXPb/e84zXD9JTpdXi9NQEnVXVde5S6arEWXyRB++EA=; b=K41k5+VIFDO1bxNmtKQUDQYProaVI7vhRQksAMS8Gk6Svrg2gHNK+AmzSW7yie2IKf WkcXbDNsbgf6qaY9Ng6bffE92vrOob8vh9GZiKYzt4boPYj7MA6nA2Mwhy6lejbC99wE 5Qwf0lGaUQHWtQ7lmzvQcHHSepkZQTXGgUmMo0oAuZBYTh3TsSOXY581os+RCnxXC5Jo 3uTogAeo49BqwnmthkxyNiG++9MT9hh94VcPyqY/MDxnmjWtCLodK5gR9Q4qaysKabrN U6NNM5oYdPTXcqw5WgJfshw663RfaE0uHpEIfPB0dGl+2+C/wFR3IsNnEjRu/VNcrwql i9Zg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=QXPb/e84zXD9JTpdXi9NQEnVXVde5S6arEWXyRB++EA=; b=b3L4brYuaj4iFcDk8eSnmf4nTPhJtbWdGqilCMWhKBDriDgg8fL2vmIHzwL0mdWpS4 P+VjrK6iT2wJcELxIH+uvE0Sj+H6oxD+Dn6qEmFbz8YPiw41yVLIhJK6WxG4f38Brci0 7OMuYLYaB43TTPui+ISLWsdGTgqOytqWrW8ajNJQCGKlMZjsj96VNZmKhASXuN5Wo48j YQHx/5qKNfYOyph/djeXM2Vq3Q4ri9jQkM5t6fOo/HSwGmThdew+3mPzU45VlN2m/B4L KAfacHwgioY3OGWIFseyd7c0pL2JrmkEZkD2NPsSEzPxxeCB56zQZE9O5U1Vz7WHtHyy ZiQQ== X-Gm-Message-State: AFeK/H0ORgnzixRFWKxO0uMv51RlGphx8u5eKv+DAcR1sBpPC7uM7pPIDalSafSFT1gmLHXa X-Received: by 10.28.166.133 with SMTP id p127mr4577194wme.62.1489265497848; Sat, 11 Mar 2017 12:51:37 -0800 (PST) Received: from [10.0.0.2] (bzq-109-65-120-124.red.bezeqint.net. [109.65.120.124]) by smtp.googlemail.com with ESMTPSA id w17sm18620927wra.28.2017.03.11.12.51.36 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 11 Mar 2017 12:51:36 -0800 (PST) Subject: Re: scylladb To: user@cassandra.apache.org References: <0c153096-af45-3a69-28ea-4a6471a47e04@scylladb.com> <7bd42a18-af9c-c9d5-98c9-083ced49cd5d@scylladb.com> <6d45df80-8193-73bc-0f1c-81079ab64d5c@scylladb.com> From: Avi Kivity Message-ID: <5f568408-9e60-1d09-64f9-60e4101f69a6@scylladb.com> Date: Sat, 11 Mar 2017 22:51:35 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/alternative; boundary="------------A6F2D8B8F62014B43AC543E8" archived-at: Sat, 11 Mar 2017 20:52:20 -0000 This is a multi-part message in MIME format. --------------A6F2D8B8F62014B43AC543E8 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Scylla uses a the seastar framework, which provides for both user-level thread scheduling and simple run-to-completion tasks. Huge pages are limited to 2MB (and 1GB, but these aren't available as transparent hugepages). On 03/11/2017 10:26 PM, Kant Kodali wrote: > @Dor > > 1) You guys have a CPU scheduler? you mean user level thread Scheduler > that maps user level threads to kernel level threads? I thought C++ by > default creates native kernel threads but sure nothing will stop > someone to create a user level scheduling library if that's what you > are talking about? > 2) How can one create THP of size 1KB? According to this post > it > looks like the valid values 2MB and 1GB. > > Thanks, > kant > > On Sat, Mar 11, 2017 at 11:41 AM, Avi Kivity > wrote: > > Agreed, I'd recommend to treat benchmarks as a rough guide to see > where there is potential, and follow through with your own tests. > > On 03/11/2017 09:37 PM, Edward Capriolo wrote: >> >> Benchmarks are great for FUDly blog posts. Real world work loads >> matter more. Every NoSQL vendor wins their benchmarks. > > > --------------A6F2D8B8F62014B43AC543E8 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit
Scylla uses a the seastar framework, which provides for both user-level thread scheduling and simple run-to-completion tasks.

Huge pages are limited to 2MB (and 1GB, but these aren't available as transparent hugepages).

On 03/11/2017 10:26 PM, Kant Kodali wrote:
@Dor 

1) You guys have a CPU scheduler? you mean user level thread Scheduler that maps user level threads to kernel level threads? I thought C++ by default creates native kernel threads but sure nothing will stop someone to create a user level scheduling library if that's what you are talking about?
2) How can one create THP of size 1KB? According to this post it looks like the valid values 2MB and 1GB.

Thanks,
kant

On Sat, Mar 11, 2017 at 11:41 AM, Avi Kivity <avi@scylladb.com> wrote:
Agreed, I'd recommend to treat benchmarks as a rough guide to see where there is potential, and follow through with your own tests.

On 03/11/2017 09:37 PM, Edward Capriolo wrote:

Benchmarks are great for FUDly blog posts. Real world work loads matter more. Every NoSQL vendor wins their benchmarks.






--------------A6F2D8B8F62014B43AC543E8--