Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D93AB10B05 for ; Fri, 4 Dec 2015 10:39:36 +0000 (UTC) Received: (qmail 98206 invoked by uid 500); 4 Dec 2015 10:39:33 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 98167 invoked by uid 500); 4 Dec 2015 10:39:33 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 98157 invoked by uid 99); 4 Dec 2015 10:39:33 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Dec 2015 10:39:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2D4D21A5DE5 for ; Fri, 4 Dec 2015 10:39:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.001 X-Spam-Level: X-Spam-Status: No, score=-0.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=gfproducts.onmicrosoft.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 6x1MA4hbigTq for ; Fri, 4 Dec 2015 10:39:25 +0000 (UTC) Received: from emea01-db3-obe.outbound.protection.outlook.com (mail-db3on0120.outbound.protection.outlook.com [157.55.234.120]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 5DD092156B for ; Fri, 4 Dec 2015 10:39:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gfproducts.onmicrosoft.com; s=selector1-edgelab-ch; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=UliwlK5fvLcAdWHRTYoHSUnu+Q118ygtXd1gCh+OopM=; b=dUoS2vdV6xHUm7+yes5wLRLqPS8jOo06AaZ6SgDYAaa0vUXgJbzNAyrfS/vSBtKWQseIvtyKoaLSQfhO7yUZ0uI+suUACKeaYvKbsVRX/0QzQ/aiLu7nfCXdZDYpLpg1AKfRDKJmrPXb9+sjiqAjnbB6IY2z5XuOlpRgMOQ/d6o= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=jballet@edgelab.ch; Received: from [192.168.101.101] (83.173.214.74) by AM2PR09MB0497.eurprd09.prod.outlook.com (10.162.34.155) with Microsoft SMTP Server (TLS) id 15.1.331.20; Fri, 4 Dec 2015 10:39:18 +0000 Subject: Re: Rebuilding a new Cassandra node at 100Mb/s To: References: <5660650F.10300@edgelab.ch> From: Jonathan Ballet Message-ID: <56616D50.2050501@edgelab.ch> Date: Fri, 4 Dec 2015 11:39:12 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Icedove/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [83.173.214.74] X-ClientProxiedBy: HE1PR06CA0030.eurprd06.prod.outlook.com (25.162.181.168) To AM2PR09MB0497.eurprd09.prod.outlook.com (25.162.34.155) X-Microsoft-Exchange-Diagnostics: 1;AM2PR09MB0497;2:8GNsE5JS7x+iCjqabrlOi2AwGRMzTNHrf9+XId2bSqaxOCJWtYtB3RcdoBFgTzel90Koa/1llqNrYtQCMwX1qKAsYWT+PakGtDAsqeoLExtMD6K6xxGUEvssovL0FuIGDgSn93XSv7Zk3smB3NlF2w==;3:45DjptQvkqzN9Kc5eHpQcLP5Z9NdGfJL/IjA4xOUuobX+nda4t4V7fnwkY67/YrDsuFhyGBq0Ztpzvc+WsbI7/UpxziMvh8Fwk/nXoDpWqwV01p+i8aoRmB7r/Yq3S9P;25:gBH8z988ecMHshj33gkyAzvu+XCVJXMHpj4cedzwHX5Ro8iW1uNUDhO2DtIRb6rlVAEMa/khd8gyaa1nZrbY3GW6UT+Qwa5xQH9lJPTvdNXXnB8VmLROlZXVK39BMNn4GaXFfDTHKd0NadwNeSkWGKksSHPDt+NxP4PQRnNgsbF+FgPR5rvf4FO+IYWueHN0a7MPJLQGZvsyBgEqKIEDSOxq6OwYvVOuoavbWE3VWxS99gAzLktZWJaom4BphYLnQdzuoMUliAcBw66TJjBzxA==;4:rG9QQsh51kX7qerjEB/881tBMuGB8KTHfK9lgfhbg4aUOpwFJaw+ZmpV2XtNrioQynub8VPJsge/hsbE5o/3VT33eXp1lo9D14PttVwvZtvuI83GprpTHZA591Cs+PYQmc0q3X8hDuYQC3BdP1tmhCgRhg3LsmpFGI9ObMSii5GbjUMDfakuCFogDBMlaNnNC4+M3gmXPikeyvwggyP8pBNE1Ilry6k5rB3HR59e4ENT9pG350ozKrpm3BiRuLhYV/SUqIse52JxFptgthNprO3QaE3hbTOd31sAmB3Fu65glPjkVr+wr+TtT+Cr+BH0sDngk+h51H13jjjtQA11h+Y+iZZMcde8z3s9s5tXH1SAQSbPiOF4FXwHuvUJpiTJ X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:AM2PR09MB0497; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(601004)(2401047)(5005006)(8121501046)(520078)(10201501046)(3002001);SRVR:AM2PR09MB0497;BCL:0;PCL:0;RULEID:;SRVR:AM2PR09MB0497; X-Forefront-PRVS: 07807C55DC X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(6049001)(377454003)(199003)(189002)(24454002)(479174004)(87266999)(110136002)(65816999)(5004730100002)(80316001)(19580395003)(23676002)(19580405001)(64126003)(189998001)(97736004)(2950100001)(4001350100001)(47776003)(5001960100002)(5008740100001)(122386002)(450100001)(101416001)(107886002)(586003)(106356001)(33656002)(230700001)(74482002)(77096005)(83506001)(2351001)(117156001)(92566002)(105586002)(99136001)(42186005)(87976001)(59896002)(50986999)(54356999)(86362001)(40100003)(81156007)(3846002)(76176999)(6116002)(66066001)(36756003)(1096002)(50466002);DIR:OUT;SFP:1102;SCL:1;SRVR:AM2PR09MB0497;H:[192.168.101.101];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; Received-SPF: None (protection.outlook.com: edgelab.ch does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtBTTJQUjA5TUIwNDk3OzIzOk5UbkpVVTM5TjM4emV0aFE2UzRTSXRmTmxI?= =?utf-8?B?eDR0N2lCT2RRa09CVk80ZTZ6UmNaQmh0aXpLU1ROR2R5YkVWNTVFTk5hZ1da?= =?utf-8?B?bW4rWnE2SktnaXc0Rjc5cTQ0bGZWbFB4Ly9YTTArK28yeFZrV0wxY3hIdEcw?= =?utf-8?B?eXVOMGhMeFdhOWEzTXNwRk9qd3dRZUdGVFpXaytEaFpIQ2tWTkpzdWhDaFQr?= =?utf-8?B?eFQ3UjhROWd5Z0E4NDNEM0NnbXB0dUV3R3ZxYVIzTzBTcllXbDd5MXA0clBu?= =?utf-8?B?TDdmS0FUZVFMN3d3WW4wS2RqbWlQZmVDcHgxUTREN24vTWRpam91eWg4ZThn?= =?utf-8?B?RjdxQk92UFhyeGNVOTNjTThLbG9uaG5YV3h0U01zL1dtbXYxMWVRSDNJMldo?= =?utf-8?B?RXRMY01FNTgxMnN4VHI5WjNLRm5WKzhEVDJCVS9ySW43WFh0NlJXcWNmMU9Y?= =?utf-8?B?dlhrNFBQbkc3ZGV2bEpYb041UVFhMnhvcGJRbVVqUElDTG9yeTh5UVhuYzFU?= =?utf-8?B?bHBBYmh6MGhxbjVMNFQ3VitzNnJGMnRWOEhpdTVlR3FjcFpNUFF2RW5IaWQv?= =?utf-8?B?NXFEK2RFZ0haelNKVEpGcnVZYXdzQVNBcFRJYmdvKzZhMjZLVCs5U3Fadlh1?= =?utf-8?B?UzkwSmxPdVNvLzVFc09iUjdXTzZBYzBNSDRMRTdaNDczYkpaKzJmWGVKa3VO?= =?utf-8?B?YXd2UnVwYWpHV2t3a0hhcXRHN3ZPR0hSZlVrc3NNZlhHYStBd2N0R2Z6U3g5?= =?utf-8?B?K2l0TzB5TTg3TzB5eFJDNDZLU0MrR1p2TCtYdWszTXEyMDE3WGJ3OHM4eWVC?= =?utf-8?B?NmtHdjFNMXB3N0FnUVlUTWEzbENlNzhmODB4N2E1dUVNK1U0bGZ4QTZORXBt?= =?utf-8?B?TkxDNlJLSjVaOHI3VGZ2K2FSZ2hKby9TVlFyOUtxbXdhOHZMMGF0RlFkUXVs?= =?utf-8?B?ZkV5TTVJWjhXUmZ4ejRoRWJSamZzZ0VURmxncHR2OURVZ3Z5eHd2WS9qclBS?= =?utf-8?B?T2E4cW0zeDNZTFJ5YlU0UmdTcXNzZEUwUkpCbC8vaWkyY1ZhNUp2S1d2aGU2?= =?utf-8?B?QTJiMFdORFM2b0thTWFGVVJoL2pmUXo5ZFUyQ0xlZnRucXlVa01uVW51UWFC?= =?utf-8?B?RHFxaXFQbUU5TW40NmVvYVBXYTd0NUJBZFhrb0dDRTV4SzU5N0tDbyt4VXVu?= =?utf-8?B?b01ieFl2S2tPeDdUMS9pbkJ2R29zSGV6STVzWFRMK2tIMVNvMTdFVkRLdk9s?= =?utf-8?B?M2tVY3hIVDdUekVZd0pSa1hFTGNOTGdoOHR5Uy9oTE9lemNhZStBOS9DZGR4?= =?utf-8?B?RTl6NnFKajNOT2JhNk42UmxMRnJ2S0VaK1RacWd3MXhPcjd4TUlENHF0K3RL?= =?utf-8?B?T2djVVVMZG5BWnVvU1g1QlZMMDB4akl2MjdMeFBlb2c0bm1MdGp6aXlLcFZG?= =?utf-8?B?a0FaOVRITkJnUXRvTFRVZE12MEpmMXg2UlIzUWN3ZEpocnl5L2FLMVFLeGJ4?= =?utf-8?B?TVRRUkdBL3NzZUxlTFgvUjhMNDU4WHJ0cE5kWVVmQ0p0V0lGb3ZzYzAyZmZm?= =?utf-8?B?SUJUOC9aWk5mVTVKYVMwSUJBYktKSTlUdEVKZVR3bGtkZXV4R2lpc2kycFlT?= =?utf-8?B?S2lnc0NPTzZnM1RpOXVMV2twR2RTMW5IWnZEQWh6VUNoT0RWT2tRdGtveVZJ?= =?utf-8?B?K2pOdHQrcDVFbTFoK3FrMkd4azgyY3ZGcFZGd2YzWUsxeXlrRFhSb0VBMWNH?= =?utf-8?B?ZlB0UjIwSDRHNkQ1eDFpMURTa2lyZHpXYVZQekgvQ2RDRERpaWpyM1h0NUkr?= =?utf-8?B?T3VBV2gvd2haaFZNTDIxQmcycC9BdGdTdE9HcWk3bWhFVFFWNmZzQ1dvTUda?= =?utf-8?Q?e8KDYqfcqa0=3D?= X-Microsoft-Exchange-Diagnostics: 1;AM2PR09MB0497;5:taWUCHjWSyW0yCYp9lrlq1foQxL7d1/czhes4pnmZy2Tt3ZgatHB8bOlYjBv1UK1f7kO28lA00YwexuYQNGig4Kl/Z6V2xSifGF9lbVtLucKmp0o4S0gMd3NIF6kqFlkGa9Fu3xNvkwNjhEBhuL8/g==;24:IA+4LJq6noENxA6PKkdDwvo/G4Z5tRVLqtroNFmxHzKAwu4PJBUcsgJEQyaY1fmMBfHT5HPYNhNByt96ZrGvqiRPFDNySqfBA9ZwZYsABj0= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: edgelab.ch X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Dec 2015 10:39:18.2647 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM2PR09MB0497 Thanks for your answer Rob, On 12/03/2015 08:32 PM, Robert Coli wrote: > On Thu, Dec 3, 2015 at 7:51 AM, Jonathan Ballet > wrote: > > I noticed it's not really fast and my monitoring system shows that > the traffic incoming on this node is exactly at 100Mb/s (12.6MB/s). > I know it can be much more than that (I just tested sending a file > through SSH between the two machines and it goes up to 1Gb/s), is > there a limitation of some sort on Cassandra which limit the > transfer rate to 100Mb/s? > > > Probably limited by number of simultaneous parallel streams. Many people > do not want streams to go "as fast as possible" because their priority > is maintaining baseline service times while rebuilding/bootstrapping. > > Not sure there's a way to tune it, but this is definitely on the "large > node" radar.. I was actually a bit surprised that the limit seems to really be capped at 100 Mb/s, not more not less. So I was thinking there was something else playing here... Jonathan