Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C697B1191D for ; Sun, 27 Apr 2014 01:04:50 +0000 (UTC) Received: (qmail 23706 invoked by uid 500); 27 Apr 2014 01:04:49 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 23636 invoked by uid 500); 27 Apr 2014 01:04:49 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 23628 invoked by uid 99); 27 Apr 2014 01:04:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 27 Apr 2014 01:04:49 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_REPLY,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of josh.elser@gmail.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qc0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 27 Apr 2014 01:04:44 +0000 Received: by mail-qc0-f176.google.com with SMTP id x13so4669124qcv.7 for ; Sat, 26 Apr 2014 18:04:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=+WPv5kSxeUrQ2yOcF88G7VgFJE5T/R8rN39pG8BhqZI=; b=sqxikpCfeBxkgy2QtAgQpCnU7duwqYQVQS49BbqdYBvXBvuZA2g7iaTuqutAGlMAkt vPrN4gNk7T6bcCX0EA5xSmy8JRXgmWapHCHjNeqluGPs1nf0nDGIGe9IjO8P5p5BTBHV UXx+qrrN9RR5WgddYU2WZ0fyl/4CavgCxsgk0k2CpgqYl1pakD/JBSduKNaznsu5etgQ zrD96J9NN7FU/7SHdj80kz9sIi7OBCdrlB5yxaYkmC/M2ftZq44ymuh4N/oDqcJIhI5y 54Mbb2V8JW1KUwyCAYaMjJ9JteT4Pdwp4qlGTJFFhBxbqXYB0m/EGSn+xejz9APFMuXu 4SMQ== X-Received: by 10.140.39.227 with SMTP id v90mr21788082qgv.35.1398560663970; Sat, 26 Apr 2014 18:04:23 -0700 (PDT) Received: from HW10447.local (pool-71-166-48-47.bltmmd.fios.verizon.net. [71.166.48.47]) by mx.google.com with ESMTPSA id f106sm15850828qge.8.2014.04.26.18.04.23 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 26 Apr 2014 18:04:23 -0700 (PDT) Message-ID: <535C5796.5090002@gmail.com> Date: Sat, 26 Apr 2014 21:04:22 -0400 From: Josh Elser User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: user@accumulo.apache.org Subject: Re: Write to table from Accumulo iterator References: <1398478391482-9412.post@n5.nabble.com> <1398480347523-9414.post@n5.nabble.com> <535B3013.3030300@gmail.com> <1398485539287-9422.post@n5.nabble.com> <041B035D-59C2-49EE-A634-9351D211328D@clearedgeit.com> <1398520730164-9424.post@n5.nabble.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org I've been thinking about this some more -- resource management in the tabletservers is definitely a concern, even if deadlock isn't (I still haven't convinced myself one way or another). Difficulty will definitely arise in trying to make sure you don't leak BatchWriters (and the thread it spawns inside which sends mutationst o the appropriate tserver). Not impossible, but definitely tricky :) On 4/26/14, 2:38 PM, Donald Miner wrote: > I haven't actually implemented this, just what we've been thinking > about. But yeah, the idea is that you write using BatchWriter in the > check method of Constraint. > > > On Sat, Apr 26, 2014 at 9:58 AM, BlackJack76 > wrote: > > Donald, > > Thanks for the response. Sounds like we are exactly on the same page. > > Honestly, I wasn't familiar with Constraints until you mentioned > them. I > did some quick reading about them and still trying to understand how > you are > accomplishing this. This is a very interesting idea and I > appreciate that > you shared it. > > I am assuming you are writing back to the table from the check method in > your Constraint. How are you writing back to the table? Through a > BatchWriter? > > I also thought about creating some sort of external buffer but agree > that it > would be a lot of extra work and book keeping. > > > > -- > View this message in context: > http://apache-accumulo.1065345.n5.nabble.com/Write-to-table-from-Accumulo-iterator-tp9412p9424.html > Sent from the Users mailing list archive at Nabble.com. > > > > > -- > * > *Donald Miner > Chief Technology Officer > ClearEdge IT Solutions, LLC > Cell: 443 799 7807 > www.clearedgeit.com