accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: exception thrown during minor compaction
Date Tue, 01 Sep 2015 04:17:13 GMT
Ah, ok. Thanks for clarifying.

If that is indeed the cause here, it's a bug in our provided Combiners. 
Z is just using the "user" iterators that we provide and invoking the 
API. Based on provided usage earlier, he's doing the right thing.

If you can verify, Z, that'd be really helpful!

Eric Newton wrote:
> Sure, but not during a compaction that does not involve all the underlying
> files. The delete keys must be propagated.
>
> I'm not completely familiar with the underlying libraries that help you
> write iterators, I just know it's a common mistake.
>
>
> On Mon, Aug 31, 2015 at 11:53 PM, Josh Elser<josh.elser@gmail.com>  wrote:
>
>> Shouldn't the delete be masked at a lower layer (DeletingIterator)? Or am
>> I forgetting that Combiners see that value somehow (and maybe
>> SummingCombiner is broken)?
>>
>>
>> Eric Newton wrote:
>>
>>> You may be seeing a delete marker.  In a compaction, you will see delete
>>> markers, which have an empty value. You will have to check the delete flag
>>> on the key before grabbing the Value.
>>>
>>> -Eric
>>>
>>> On Mon, Aug 31, 2015 at 8:28 PM, z11373<z11373@outlook.com>   wrote:
>>>
>>> Thanks Josh! I am going to do more experiments, because this is really
>>>> weird.
>>>> I'll post the update if there are any interesting stuff I found out
>>>> later.
>>>>
>>>> Thanks,
>>>> Z
>>>>
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>>
>>>> http://apache-accumulo.1065345.n5.nabble.com/exception-thrown-during-minor-compaction-tp15010p15017.html
>>>> Sent from the Developers mailing list archive at Nabble.com.
>>>>
>>>>
>

Mime
View raw message