Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5804210C31 for ; Wed, 9 Jul 2014 16:43:55 +0000 (UTC) Received: (qmail 47992 invoked by uid 500); 9 Jul 2014 16:43:55 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 47950 invoked by uid 500); 9 Jul 2014 16:43:55 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 47938 invoked by uid 99); 9 Jul 2014 16:43:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2014 16:43:54 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of david.medinets@gmail.com designates 74.125.82.49 as permitted sender) Received: from [74.125.82.49] (HELO mail-wg0-f49.google.com) (74.125.82.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2014 16:43:50 +0000 Received: by mail-wg0-f49.google.com with SMTP id a1so4345111wgh.8 for ; Wed, 09 Jul 2014 09:43:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=UEz+UUBsn/2y9Y8P89//wX4ClbZUNwDnHiJ9TxrBNf8=; b=cFo7b56w+0l3q0sle4/lK/QQZRy3XsHTFqMZ5WvKDIV+vSAH0YARqRZh9+Wl8wqmNi uQV1uqTHq2AaN/KcaiKq0fDmsYqwuJ4Cj1FfWZx6ODYcD9QLSAZNwL6lQ6OlbKoeS1PF k/XhYY4Izda/BXtKxabcs/xWNpUqJDA92cghvlnIJsFPmsox9dZTCsMfej6U/CAdNSz3 5aHUvASxCybmTywRwa/Topdudi2OPxRPzP4czEDrjhl12BfgZMOFLMB4zkJ0OAq4w313 4RosgGkx9uMG1Zqvr5fg3yiU3MvEMe9aWMoMdXU40GVq927nyBf/wsdb+rG/Lm3zi3kB QXhQ== MIME-Version: 1.0 X-Received: by 10.194.80.7 with SMTP id n7mr49082301wjx.8.1404924209668; Wed, 09 Jul 2014 09:43:29 -0700 (PDT) Received: by 10.194.2.132 with HTTP; Wed, 9 Jul 2014 09:43:29 -0700 (PDT) In-Reply-To: References: Date: Wed, 9 Jul 2014 12:43:29 -0400 Message-ID: Subject: Re: Connection Refused Reading Instance Id From HDFS From: David Medinets To: accumulo-dev Content-Type: multipart/alternative; boundary=047d7beb9c807428b404fdc568bd X-Virus-Checked: Checked by ClamAV on apache.org --047d7beb9c807428b404fdc568bd Content-Type: text/plain; charset=UTF-8 I see the same connection refused message in master, monitor, tserver, and gc logs. Maybe it's a coordination issue where one process takes a bit of time to fully start? GIST of ./make_image.sh https://gist.github.com/medined/c1677c278bd72cd2ee64 $ ./make_container.sh grail grail db73a147ef89a683435475ac9fcba7ef31219710e39759afd87b0742f6cc7490 GIST of file diff from base image https://gist.github.com/medined/fe7d04bd4aaa902a66ed Use ./enter_image.sh grail to investigate container GIST of namenode log https://gist.github.com/medined/46ce499603d75888a118 GIST of datanode log https://gist.github.com/medined/1e99bb6db3466427013d GIST of accumulo gc log https://gist.github.com/medined/c1abf7eaee876057e38f On Wed, Jul 9, 2014 at 12:29 PM, Sean Busbey wrote: > can you put your namenode, datanode, and gc logs into a gist? > > > On Wed, Jul 9, 2014 at 11:20 AM, David Medinets > wrote: > > > I updated my accumulo-env.sh so that Accumulo uses IPV4. And now the > shell > > starts, I can create tables and insert entries. I can even view the > monitor > > page. However, the logs still show the connection refused error. > > > > > > > > > > On Wed, Jul 9, 2014 at 10:38 AM, Sean Busbey > wrote: > > > > > This might be the same ipv6 issue that's causing your monitor failures. > > > > > > -- > > > Sean > > > On Jul 9, 2014 9:13 AM, "David Medinets" > > wrote: > > > > > > > I'm hoping someone has a few minutes to help debug this networking > > issue. > > > > I'm running a single-node Accumulo 1.5.1 instance (using Hadoop 2.4) > > > inside > > > > Docker. I can find the Accumulo instance id manually: > > > > > > > > -bash-4.1# hdfs dfs -ls /accumulo/instance_id > > > > Found 1 items > > > > -rw-r--r-- 1 accumulo accumulo 0 2014-07-09 08:22 > > > > /accumulo/instance_id/9421cd33-5f37-4f6d-b645-372feb431cae > > > > > > > > But when the gc tries to find the instance id, I see this message in > > the > > > > log file: > > > > > > > > -bash-4.1# cat > > > > /var/log/supervisor/accumulo-gc-stdout---supervisor-nwDCZU.log > > > > 2014-07-09 09:04:07,006 [client.ZooKeeperInstance] ERROR: Problem > > reading > > > > instance id out of hdfs at /accumulo/instance_id > > > > java.net.ConnectException: Call From grail/172.17.0.2 to grail:8020 > > > failed > > > > on connection exception: java.net.ConnectException: Connection > refused; > > > > > > > > The hostname is 'grail' which resolves to 172.17.0.2 via /etc/hosts > and > > > it > > > > can ping itself: > > > > > > > > david@zareason-verix545:~/projects/docker-builds/accumulo$ > > > > ./enter_image.sh > > > > grail > > > > -bash-4.1# ping grail > > > > PING grail (172.17.0.2) 56(84) bytes of data. > > > > 64 bytes from grail (172.17.0.2): icmp_seq=1 ttl=64 time=0.083 ms > > > > 64 bytes from grail (172.17.0.2): icmp_seq=2 ttl=64 time=0.054 ms > > > > > > > > Do I need to use IP addresses in the 'gc' and other configuration > > files? > > > > > > > > Any ideas for me to try? > > > > > > > > When the NameNode starts, the log file has no errors. It starts with: > > > > > > > > STARTUP_MSG: Starting NameNode > > > > STARTUP_MSG: host = grail/172.17.0.2 > > > > > > > > > > > > > -- > Sean > --047d7beb9c807428b404fdc568bd--