Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E275F200BC2 for ; Thu, 3 Nov 2016 02:02:22 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id E1115160B0A; Thu, 3 Nov 2016 01:02:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2FF95160AFB for ; Thu, 3 Nov 2016 02:02:22 +0100 (CET) Received: (qmail 55152 invoked by uid 500); 3 Nov 2016 01:02:21 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 55142 invoked by uid 99); 3 Nov 2016 01:02:21 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Nov 2016 01:02:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id C6C2A180481 for ; Thu, 3 Nov 2016 01:02:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.679 X-Spam-Level: * X-Spam-Status: No, score=1.679 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 8DWhJkSoZ2jn for ; Thu, 3 Nov 2016 01:02:19 +0000 (UTC) Received: from mail-oi0-f41.google.com (mail-oi0-f41.google.com [209.85.218.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id A02D35FBCF for ; Thu, 3 Nov 2016 01:02:18 +0000 (UTC) Received: by mail-oi0-f41.google.com with SMTP id 128so51147918oih.0 for ; Wed, 02 Nov 2016 18:02:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=/a+kr0Y5E54TqNe5doSdrS0fHbHqymqLnOTE4+94uVc=; b=HTWjVQPAdHuAksl/4NBMPbzTXY2PbrdNYy4JvQryMbynjY5yfM1TK4MKwCW4Ne66Qc rjkdUXkcBB8LX+aAOhQe58Lke36OR1bKPi93Sftt3Ubswq4PuWpz8Ce3ORyEtUz+P95z QnF7vpM3ahVu/zRxDC3QRvQ0jmksrwrReITFyqCaXtwNIfTJsPq+u0ghZV2lXuUFSGY6 4AdV8xbyCKpIMz3uEU38toIvQ34sCO1oyqAFanp22opJqUZZjiJTBA6SOvLWfu32SYax Wez98zp8vqHa25RISlDn5tM813JMlp5HUCInirJwy6WAtI/jMi8MXPT4tMWw1l8fPYvs ssoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=/a+kr0Y5E54TqNe5doSdrS0fHbHqymqLnOTE4+94uVc=; b=DT4dQlSapRdboPQ8UufHXb+R9O0rnLJNkV4CT7FPu6n+F8Q6FfUWcWML6u8+QZ2dfy 6lloZVG5yEA4kug0wvH+ZWvcwXB8+qhCHZ7xqS46JYVb2efrxHovjInQXpnkAtmq2Niv mC/pXBJKWl3MhqLynNgTlgPWRCfpOR7anxdmIuyXRvLQSA7zuc2t68rZDOk1dwnK4Tjt 1nmtbDGXIJhkCnJbdYDLpmJ6mJ8moxWw0byYRLcScKkxW/mJq5c1oLAS/Lq+JUdckrAO 3hcJpKQETsWM90Na9WuAR7L122Z63iAXER83MFwzwnJHItjdHRxC8p4CjFB44tjRhfxL YRpg== X-Gm-Message-State: ABUngvfSs4jQspHAVHS6pyLmXHd9YGVDm7lamddV5AWSiLn6TEAikEH3MKVOAhXZj0rSyHYPodrv9YV+7bO86A== X-Received: by 10.107.43.75 with SMTP id r72mr6546473ior.26.1478134937804; Wed, 02 Nov 2016 18:02:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.131.5 with HTTP; Wed, 2 Nov 2016 18:01:57 -0700 (PDT) In-Reply-To: References: From: Jeff Kubina Date: Wed, 2 Nov 2016 21:01:57 -0400 Message-ID: Subject: Re: New Accumulo Blog Post To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a113949f0e5ec5c05405b1b0d archived-at: Thu, 03 Nov 2016 01:02:23 -0000 --001a113949f0e5ec5c05405b1b0d Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks for the blog post, very interesting read. Some questions ... 1. Are the operations "Writes mutation to tablet servers=E2=80=99 WAL/Sync = or flush tablet servers=E2=80=99 WAL" and "Adds mutations to sorted in memory map of= each tablet." performed by threads in parallel? 2. Could the latency of hsync-ing the WALs be overcome by modifying Accumulo to write them to a separate SSD-only HDFS? To maintain data locality it would require two datanode processes (one for the HDDs and one for the SSD), running on the same node, which is not hard to do. --001a113949f0e5ec5c05405b1b0d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks for the blog post, very interesting read. Some ques= tions ...

1. Are the operations "Writes mutation to= tablet servers=E2=80=99 WAL/Sync or flush tablet servers=E2=80=99 WAL"= ; and "Adds mutations to sorted in memory map of each tablet." pe= rformed by threads in parallel?

2. Could the latency of= hsync-ing the WALs be overcome by modifying Accumulo to write them to a se= parate SSD-only HDFS? To maintain data locality it would require two datano= de processes (one for the HDDs and one for the SSD), running on the same no= de, which is not hard to do.

--001a113949f0e5ec5c05405b1b0d--