Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C82C210DE0 for ; Tue, 27 Aug 2013 19:20:33 +0000 (UTC) Received: (qmail 56666 invoked by uid 500); 27 Aug 2013 19:20:33 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 56636 invoked by uid 500); 27 Aug 2013 19:20:29 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 56618 invoked by uid 99); 27 Aug 2013 19:20:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 19:20:28 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [128.229.5.20] (HELO mclniron01-ext.bah.com) (128.229.5.20) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2013 19:20:22 +0000 x-SBRS: None X-REMOTE-IP: 10.12.10.220 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AvQFAHD7HFIKDArc/2dsb2JhbABWA4M8UcAngTltB4IkAQEFOk0EAQgRAwECAR4JIgYRFAkIAgQTh28DG68ZDYlEBASMdYE8gR8XAg+ECAOWBo4diEyCKg X-IPAS-Result: AvQFAHD7HFIKDArc/2dsb2JhbABWA4M8UcAngTltB4IkAQEFOk0EAQgRAwECAR4JIgYRFAkIAgQTh28DG68ZDYlEBASMdYE8gR8XAg+ECAOWBo4diEyCKg X-IronPort-AV: E=Sophos;i="4.89,969,1367985600"; d="scan'208";a="256419826" Received: from ashbcwsv05.usae.bah.com (HELO ASHBCSHB08.resource.ds.bah.com) ([10.12.10.220]) by mclniron01-int.bah.com with ESMTP; 27 Aug 2013 15:03:00 -0400 Received: from ASHBDAG3M2.resource.ds.bah.com ([169.254.5.167]) by ASHBCSHB08.resource.ds.bah.com ([10.12.10.220]) with mapi id 14.03.0123.003; Tue, 27 Aug 2013 15:19:50 -0400 From: "Shipper, Jay [USA]" To: "user@accumulo.apache.org" Subject: Re: [External] Re: Accumulo (1.5.0) Master Will Not Start Thread-Topic: [External] Re: Accumulo (1.5.0) Master Will Not Start Thread-Index: AQHOoq8QgJ/NYGBXXUuJRZ9fMA6GYpmoMJ2AgABOYQD//77UgIAAyEaAgACjTQD//8YHAA== Date: Tue, 27 Aug 2013 19:19:49 +0000 Message-ID: In-Reply-To: <521CF436.9050702@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.5.121010 x-originating-ip: [10.12.230.71] Content-Type: text/plain; charset="us-ascii" Content-ID: <81D34005D41F2F449BECCAA8AE10040C@exch.bah.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org No problem. I made a ticket: https://issues.apache.org/jira/browse/ACCUMULO-1670 _________________ Jay Shipper Booz | Allen | Hamilton shipper_jay@bah.com On 8/27/13 2:47 PM, "Josh Elser" wrote: >Jay, > >It would be great to see a ticket to keep us honest on making the init >scripts better. A "user's perspective" would be good. If you'd prefer >not to make one, let me know and I'll write one up. > >Christopher, > >In regards to your comment about the init scripts being rough, are they >better in 1.6? Is this something that we should try to work on >improving? I wasn't sure if you had things coming down the pipe to >address this already. > >On 8/27/13 9:02 AM, Shipper, Jay [USA] wrote: >> We figured out the issue: The JVM didn't have enough memory to start the >> process. >> *_________________* >> >> *Jay Shipper* >> >> Booz | Allen | Hamilton >> >> shipper_jay@bah.com >> >> >> From: , Merck User > > >> Reply-To: "user@accumulo.apache.org " >> > >> Date: Monday, August 26, 2013 9:06 PM >> To: "user@accumulo.apache.org " >> > >> Subject: Re: [External] Re: Accumulo (1.5.0) Master Will Not Start >> >> There's more than one? I'm checking accumulo's logs directory (in our >> installation's case, /usr/lib/accumulo/logs, which links to where we >> store our logs). >> *_________________* >> >> *Jay Shipper* >> >> Booz | Allen | Hamilton >> >> shipper_jay@bah.com >> >> >> From: John Vines > >> Reply-To: "user@accumulo.apache.org " >> >, >> "vines@apache.org " > > >> Date: Monday, August 26, 2013 8:59 PM >> To: "user@accumulo.apache.org " >> > >> Subject: Re: [External] Re: Accumulo (1.5.0) Master Will Not Start >> >> Which log directory are you checking? >> >> >> On Mon, Aug 26, 2013 at 8:18 PM, Shipper, Jay [USA] > > wrote: >> >> It's not making any .out/.err files in the log directory, nor is it >> updating the accumulo master log file. >> >> Here's the result of the command you suggested, following the point >> where the script connects to HDFS (I have substituted for >> the actual IP): >> --- >> + disown >> + SUDOPID=3D22238 >> + sleep 5 >> + sudo -u accumulo /usr/lib/accumulo/bin/accumulo master --address >> >> + '[' -z 22238 ']' >> ++ ps --ppid 22238 -o pid=3D >> + PID=3D >> + '[' -z '' ']' >> + echo Failed >> Failed >> + return 1 >> + RETVAL=3D1 >> + exit 1 >> --- >> *_________________* >> >> *Jay Shipper* >> >> Booz | Allen | Hamilton >> >> shipper_jay@bah.com >> >> >> From: John Vines > >> Reply-To: "user@accumulo.apache.org >> " > >, "vines@apache.org >> " >> >> Date: Monday, August 26, 2013 6:52 PM >> To: "user@accumulo.apache.org " >> > >> Subject: Re: [External] Re: Accumulo (1.5.0) Master Will Not Start >> >> Including the .out and .err files? Try running it as bash -x >> /etc/init.d/accumulo-master start and see if you spot anything >>there. >> >> >> On Mon, Aug 26, 2013 at 6:48 PM, Shipper, Jay [USA] >> > wrote: >> >> As I mentioned, nothing is being logged in the master's logs >> when I attempt to start the service. >> *_________________* >> >> *Jay Shipper* >> >> Booz | Allen | Hamilton >> >> 304 National Business Parkway >> >> Room 5048 >> >> Annapolis Junction, MD 20701 >> >> Phone: 301-419-5437 >> >> shipper_jay@bah.com >> >> >> From: John Vines > >> Reply-To: "user@accumulo.apache.org >> " > >, "vines@apache.org >> " > > >> Date: Monday, August 26, 2013 4:21 PM >> To: "user@accumulo.apache.org " >> > >> Subject: [External] Re: Accumulo (1.5.0) Master Will Not Start >> >> Please check the various master logs and see if anything is >> being reported there. >> >> >> On Mon, Aug 26, 2013 at 4:10 PM, Shipper, Jay [USA] >> > wrote: >> >> Here is what is being logged to the console when I try to >> start the accumulo (1.5.0) master service: >> --- >> $ sudo service accumulo-master start >> Not running >> Starting... >> 2013-08-26 19:46:41,674 [vfs.AccumuloVFSClassLoader] WARN : >> ignoring classpath entry >> file:///usr/lib/accumulo/lib/ext/[^.].*.jar >> 2013-08-26 19:46:43,342 [server.Accumulo] INFO : Attempting >> to talk to zookeeper >> 2013-08-26 19:46:43,505 [server.Accumulo] INFO : Zookeeper >> connected and initialized, attemping to talk to HDFS >> 2013-08-26 19:46:43,658 [server.Accumulo] INFO : Connected >> to HDFS >> Failed >> --- >> >> What could cause this behavior? HDFS and Zookeeper both >> appear fine, the accumulo monitor shows the zookeeper >> servers, and all the other accumulo services are still up on >> their respective nodes. Nothing is getting logged in our >> accumulo logs directory. >> >> If you need any other information to make a diagnosis, just >> ask for what you need. We have a working cluster with >> pretty much the same setup (EC2, CentOS, Hadoop 2, etc.), >> which is why we're very puzzled. >> >> Thanks, >> *_________________* >> >> *Jay Shipper* >> >> Booz | Allen | Hamilton >> >> shipper_jay@bah.com >> >> >> >>