accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: Write to table from Accumulo iterator
Date Sat, 26 Apr 2014 04:03:31 GMT
I don't believe heavy load is a requirement. I'm pretty sure you can 
deadlock pretty easily if you try writing within an iterator.

Focus on Accismus would be best IMO, but, like Bill said, it's probably 
not fully there.

On 4/25/14, 11:42 PM, William Slacum wrote:
> Our own Keith Turner is trying to make this possible with Accismus
> (https://github.com/keith-turner/Accismus). I don't know the current
> state of it, but I believe it's still in the early stages.
>
> I've always been under the impression that launching a scanner or writer
> from within an iterator, as it can cause deadlock in the system if it is
> under heavy load.
>
>   If it doesn't meet your needs, I'd recommend writing a daemon process
> that identifies new documents via a scanner and filter, then write
> indices for it. It's more network bound than doing it in an iterator,
> but it's safer.
>
>
>
> On Fri, Apr 25, 2014 at 11:29 PM, David Medinets
> <david.medinets@gmail.com <mailto:david.medinets@gmail.com>> wrote:
>
>     Can you change the ingest process to token on ingest?
>
>
>     On Fri, Apr 25, 2014 at 10:45 PM, BlackJack76 <justin.loy@gmail.com
>     <mailto:justin.loy@gmail.com>> wrote:
>
>         Sure thing.  Basically, I am attempting to index a document.
>           When I find the
>         document, I want to insert the tokens directly back into the
>         table.  I want
>         to do it directly from the seek routine so that I don't need to
>         return
>         anything back to the client.
>
>         For example, seek may locate the document that has the following
>         sentence:
>
>         The quick brown fox
>
>          From there, I tokenize the document and want to insert the
>         individual tokens
>         back into tokens back into Accumulo (i.e., The, quick, brown,
>         and fox all as
>         separate mutations).
>
>
>
>         --
>         View this message in context:
>         http://apache-accumulo.1065345.n5.nabble.com/Write-to-table-from-Accumulo-iterator-tp9412p9414.html
>         Sent from the Users mailing list archive at Nabble.com.
>
>
>

Mime
View raw message