accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jared R (JIRA)" <>
Subject [jira] [Commented] (ACCUMULO-4749) Need a bulk loading test equivalent to continuous ingest
Date Wed, 03 Jan 2018 20:41:00 GMT


Jared R commented on ACCUMULO-4749:

Right right yeah I knew it was a just a starting point, thanks for the clarification. I didn't
mean to suggest multiple ingest processes, but it does make sense for there to be multiple
ones so that will done. And right since simplicity is key I will try to make it as simple
as possible. and I like the idea of one directory that is dumped at a cutoff or something
of the sort.

thanks for the feedback both of you.

> Need a bulk loading test equivalent to continuous ingest
> --------------------------------------------------------
>                 Key: ACCUMULO-4749
>                 URL:
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: test
>            Reporter: Ivan Bella
>            Assignee: Jared R
>              Labels: pull-request-available
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
> There are some known cases at least in past versions where bulk loading may fail leaving
the ~blip in place but no transaction left to handle it.  This will result in directories
of files being left around that are not loaded.  We should create a continuous ingest variant
that uses bulk loading instead.  Then if this is run with agitation, the continuous ingest
verification can find data that has been essentially orphaned.

This message was sent by Atlassian JIRA

View raw message