accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher <ctubb...@apache.org>
Subject Re: exception thrown during minor compaction
Date Tue, 01 Sep 2015 20:37:38 GMT
Constraints are only applied to Mutations during live ingest (BatchWriter).
It's applied on write, well before any compactions. So, there's no issue of
it distinguishing between "before" and "after" processing (compacting).

On Tue, Sep 1, 2015 at 4:33 PM z11373 <z11373@outlook.com> wrote:

> Thanks Eric!
> After I posted my question, I realized this may not make sense, even using
> Filter I mentioned earlier.
> Constraint will likely not work, because how can it distinguish '1' being
> added (while it's not done processing yet) and with '1' as final result.
>
> One solution I can think of is to use a temp table (for while processing),
> and final table which only contains rows with value > 1
>
> Another option is just leave as is (so those rows with '1' will be kept,
> and
> treat them as noise). Unfortunately, from smaller dataset I have for
> testing, it has 15,785,030 rows vs. 848,601 (exclude the ones with value =
> 1), so the difference is so big to ignore.
>
>
> Thanks,
> Z
>
>
>
> --
> View this message in context:
> http://apache-accumulo.1065345.n5.nabble.com/exception-thrown-during-minor-compaction-tp15010p15034.html
> Sent from the Developers mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message