Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 96EB2200BB3 for ; Wed, 2 Nov 2016 21:19:01 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 95925160AFB; Wed, 2 Nov 2016 20:19:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id ED0B4160AF0 for ; Wed, 2 Nov 2016 21:19:00 +0100 (CET) Received: (qmail 23816 invoked by uid 500); 2 Nov 2016 20:18:59 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 23488 invoked by uid 99); 2 Nov 2016 20:18:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Nov 2016 20:18:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 9C1AB2C2ABC for ; Wed, 2 Nov 2016 20:18:58 +0000 (UTC) Date: Wed, 2 Nov 2016 20:18:58 +0000 (UTC) From: "Adam J Shook (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (ACCUMULO-4506) Some in-progress files for replication never replicate MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 02 Nov 2016 20:19:01 -0000 Adam J Shook created ACCUMULO-4506: -------------------------------------- Summary: Some in-progress files for replication never replicate Key: ACCUMULO-4506 URL: https://issues.apache.org/jira/browse/ACCUMULO-4506 Project: Accumulo Issue Type: Bug Components: replication Affects Versions: 1.7.2 Reporter: Adam J Shook Assignee: Josh Elser We're seeing an issue with replication where two files have been in-progress for a long time and based on the logs are not going to be replicated. The metadata from the {{accumulo.replication}} table looks a little funky, with a very large {{begin}} value. *Logs* {noformat} 2016-11-02 19:52:50,900 [replication.DistributedWorkQueueWorkAssigner] DEBUG: Not queueing work for hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 to Remote Name: peer_instance Remote identifier: 5h Source Table ID: k because [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477314365827] doesn't need replication 2016-11-02 19:53:08,900 [replication.DistributedWorkQueueWorkAssigner] DEBUG: Not queueing work for hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 to Remote Name: peer_instance Remote identifier: 5i Source Table ID: l because [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477052816174] doesn't need replication {noformat} *Replication table* {noformat} scan -r hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 -t accumulo.replication hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 repl:j [] [begin: 0 end: 0 infiniteEnd: true closed: true createdTime: 1477314369633] hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 repl:k [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477314365827] hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 repl:l [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477314365707] hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025g\x01\x00\x00\x00\x01j [] [begin: 0 end: 0 infiniteEnd: true closed: true createdTime: 1477314369633] hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025h\x01\x00\x00\x00\x01k [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477314365827] hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025i\x01\x00\x00\x00\x01l [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477314365707] scan -r hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 -t accumulo.replication hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 repl:j [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477052819752] hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 repl:k [] [begin: 0 end: 0 infiniteEnd: true closed: true createdTime: 1477052816238] hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 repl:l [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477052816174] hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025g\x01\x00\x00\x00\x01j [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477052819752] hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025h\x01\x00\x00\x00\x01k [] [begin: 0 end: 0 infiniteEnd: true closed: true createdTime: 1477052816238] hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 work:\x01\x00\x00\x00\x17peer_instance\x01\x00\x00\x00\x025i\x01\x00\x00\x00\x01l [] [begin: 9223372036854775807 end: 0 infiniteEnd: true closed: true createdTime: 1477052816174] {noformat} *HDFS* {noformat} hdfs dfs -ls hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 -rwxr-xr-x 3 ubuntu supergroup 1117650900 2016-10-24 13:09 hdfs://host:9000/accumulo/wal/host+31032/9f038f64-4252-44a0-bfd0-99d4a316b397 -rwxr-xr-x 3 ubuntu supergroup 1171968390 2016-10-21 12:31 hdfs://host:9000/accumulo/wal/host+31368/ae4b03ec-159b-44e8-9a88-ccf7fa849c19 {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)