accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Medinets <david.medin...@gmail.com>
Subject Re: Write to table from Accumulo iterator
Date Sun, 27 Apr 2014 01:22:57 GMT
How about writing to the proxy server from inside an iterator? The
information still stays within the server, but without the concern for
resource leakage? Probably not high-performance with the repeated
serialization and de-serialization.


On Sat, Apr 26, 2014 at 9:04 PM, Josh Elser <josh.elser@gmail.com> wrote:

> I've been thinking about this some more -- resource management in the
> tabletservers is definitely a concern, even if deadlock isn't (I still
> haven't convinced myself one way or another).
>
> Difficulty will definitely arise in trying to make sure you don't leak
> BatchWriters (and the thread it spawns inside which sends mutationst o the
> appropriate tserver). Not impossible, but definitely tricky :)
>
>
> On 4/26/14, 2:38 PM, Donald Miner wrote:
>
>> I haven't actually implemented this, just what we've been thinking
>> about. But yeah, the idea is that you write using BatchWriter in the
>> check method of Constraint.
>>
>>
>> On Sat, Apr 26, 2014 at 9:58 AM, BlackJack76 <justin.loy@gmail.com
>> <mailto:justin.loy@gmail.com>> wrote:
>>
>>     Donald,
>>
>>     Thanks for the response.  Sounds like we are exactly on the same page.
>>
>>     Honestly, I wasn't familiar with Constraints until you mentioned
>>     them.  I
>>     did some quick reading about them and still trying to understand how
>>     you are
>>     accomplishing this.  This is a very interesting idea and I
>>     appreciate that
>>     you shared it.
>>
>>     I am assuming you are writing back to the table from the check method
>> in
>>     your Constraint.  How are you writing back to the table?  Through a
>>     BatchWriter?
>>
>>     I also thought about creating some sort of external buffer but agree
>>     that it
>>     would be a lot of extra work and book keeping.
>>
>>
>>
>>     --
>>     View this message in context:
>>     http://apache-accumulo.1065345.n5.nabble.com/Write-
>> to-table-from-Accumulo-iterator-tp9412p9424.html
>>     Sent from the Users mailing list archive at Nabble.com.
>>
>>
>>
>>
>> --
>> *
>> *Donald Miner
>>
>> Chief Technology Officer
>> ClearEdge IT Solutions, LLC
>> Cell: 443 799 7807
>> www.clearedgeit.com <http://www.clearedgeit.com>
>>
>

Mime
View raw message