accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jared R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-4749) Need a bulk loading test equivalent to continuous ingest
Date Wed, 03 Jan 2018 20:41:00 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310255#comment-16310255
] 

Jared R commented on ACCUMULO-4749:
-----------------------------------

Right right yeah I knew it was a just a starting point, thanks for the clarification. I didn't
mean to suggest multiple ingest processes, but it does make sense for there to be multiple
ones so that will done. And right since simplicity is key I will try to make it as simple
as possible. and I like the idea of one directory that is dumped at a cutoff or something
of the sort.

thanks for the feedback both of you.

> Need a bulk loading test equivalent to continuous ingest
> --------------------------------------------------------
>
>                 Key: ACCUMULO-4749
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-4749
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: test
>            Reporter: Ivan Bella
>            Assignee: Jared R
>              Labels: pull-request-available
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> There are some known cases at least in past versions where bulk loading may fail leaving
the ~blip in place but no transaction left to handle it.  This will result in directories
of files being left around that are not loaded.  We should create a continuous ingest variant
that uses bulk loading instead.  Then if this is run with agitation, the continuous ingest
verification can find data that has been essentially orphaned.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message