Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D9F217548 for ; Tue, 1 Sep 2015 03:58:30 +0000 (UTC) Received: (qmail 23584 invoked by uid 500); 1 Sep 2015 03:58:30 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 23539 invoked by uid 500); 1 Sep 2015 03:58:30 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 23527 invoked by uid 99); 1 Sep 2015 03:58:29 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Sep 2015 03:58:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 7959EF035D for ; Tue, 1 Sep 2015 03:58:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.193 X-Spam-Level: **** X-Spam-Status: No, score=4.193 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id y1sZI8YzfZXl for ; Tue, 1 Sep 2015 03:58:19 +0000 (UTC) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id B7A8B42F2B for ; Tue, 1 Sep 2015 03:58:18 +0000 (UTC) Received: by obbfr1 with SMTP id fr1so110811969obb.1 for ; Mon, 31 Aug 2015 20:58:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=hBUYD13dHRkKAJnpUL1JDSNbLyc5x/ExHtzcoYay33Y=; b=U6h6jmpKlLq+D0Z0TqCAIIqxXYzxNI62/w7wSjS3g5iHMY0soOJlDxlkEXTiC4TEzI KAjSdwQ4ogtVHZfcuwi8MjwUYZZD0CGC9gkCuCIDY7iGS7eQgsi3/Nx2IHr/0RG88FK+ YqNVFvEqGexxXRHIRkKsPdxbQUXLA4zDFmKp5DArNIq9O7763z6w8pMZQ+YPb5GZLgnA zlrMgGA5aGiIgEahDSzVuNoAre/Ng3efN4Eh+WO74PSGbKFXZ1BD0fuELz8hvv976T6g dg90dTijpyg+5fAxHFiBaZS2qeWEUETQ9fYHY2PEmgCDnTM4QX3KkEALwiv4GMjutJmC fTOw== MIME-Version: 1.0 X-Received: by 10.183.3.7 with SMTP id bs7mr15313752obd.45.1441079898283; Mon, 31 Aug 2015 20:58:18 -0700 (PDT) Received: by 10.182.38.73 with HTTP; Mon, 31 Aug 2015 20:58:18 -0700 (PDT) In-Reply-To: <55E52157.2050604@gmail.com> References: <1441059216648-15010.post@n5.nabble.com> <55E4DAC7.2020601@gmail.com> <1441064150934-15013.post@n5.nabble.com> <55E4EA20.3020703@gmail.com> <1441067325983-15017.post@n5.nabble.com> <55E52157.2050604@gmail.com> Date: Mon, 31 Aug 2015 23:58:18 -0400 Message-ID: Subject: Re: exception thrown during minor compaction From: Eric Newton To: dev@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a1134beb26e30c5051ea78fb0 --001a1134beb26e30c5051ea78fb0 Content-Type: text/plain; charset=UTF-8 Sure, but not during a compaction that does not involve all the underlying files. The delete keys must be propagated. I'm not completely familiar with the underlying libraries that help you write iterators, I just know it's a common mistake. On Mon, Aug 31, 2015 at 11:53 PM, Josh Elser wrote: > Shouldn't the delete be masked at a lower layer (DeletingIterator)? Or am > I forgetting that Combiners see that value somehow (and maybe > SummingCombiner is broken)? > > > Eric Newton wrote: > >> You may be seeing a delete marker. In a compaction, you will see delete >> markers, which have an empty value. You will have to check the delete flag >> on the key before grabbing the Value. >> >> -Eric >> >> On Mon, Aug 31, 2015 at 8:28 PM, z11373 wrote: >> >> Thanks Josh! I am going to do more experiments, because this is really >>> weird. >>> I'll post the update if there are any interesting stuff I found out >>> later. >>> >>> Thanks, >>> Z >>> >>> >>> >>> -- >>> View this message in context: >>> >>> http://apache-accumulo.1065345.n5.nabble.com/exception-thrown-during-minor-compaction-tp15010p15017.html >>> Sent from the Developers mailing list archive at Nabble.com. >>> >>> >> --001a1134beb26e30c5051ea78fb0--