Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C4C3C116F4 for ; Mon, 8 Sep 2014 19:54:12 +0000 (UTC) Received: (qmail 42219 invoked by uid 500); 8 Sep 2014 19:54:12 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 42173 invoked by uid 500); 8 Sep 2014 19:54:12 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 42158 invoked by uid 99); 8 Sep 2014 19:54:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Sep 2014 19:54:11 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of esteban@cloudera.com designates 209.85.217.175 as permitted sender) Received: from [209.85.217.175] (HELO mail-lb0-f175.google.com) (209.85.217.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Sep 2014 19:54:07 +0000 Received: by mail-lb0-f175.google.com with SMTP id v6so1625013lbi.6 for ; Mon, 08 Sep 2014 12:53:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=XlS+tD9vve3ko/LcfQIUs4NlxZf3bJyId45PiTEFR9M=; b=ibiQ9gJ02PFf4nTsF3sBjwrKUfhDogU9fX+meEKymzfpbhqDfUNjhow1vAwJXWaLx2 NtlmhQbNVwckYBuOAytDAibh9zfvqwoJw+LMRKq2bTPXaUrozmhX7UOeTKfRPrZSujDH y3yVhgOqEWGV46Sxg6FouU2DA+09FC5J9YDt63pEN8FIEwEKwGmJGgDJVa31UM/w5CcS ljrs8zA58Q8qbE4hpQa/eP8v7jd8sQKoYp1Fs7Hvn+uJ227Eown54G3gr2SBX9/2JOzM aOQyW8EIBOo0nFpijXE30SDe9UBwkWfS+m9GJzuSgY4Nv94tWa5sL7jsdJymJ/RoflUU 3dPg== X-Gm-Message-State: ALoCoQmB5quPStM9Ns8KriRugZpM+pUjBjamIj/o9qkXIaRaMMDVnAWzjEEWkQEgy6V2b7pCr2bE X-Received: by 10.112.1.136 with SMTP id 8mr30364715lbm.55.1410206025638; Mon, 08 Sep 2014 12:53:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.155.1 with HTTP; Mon, 8 Sep 2014 12:53:30 -0700 (PDT) In-Reply-To: References: From: Esteban Gutierrez Date: Mon, 8 Sep 2014 12:53:30 -0700 Message-ID: Subject: Re: jute.maxbuffer not working To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=14dae947382737f2530502932d13 X-Virus-Checked: Checked by ClamAV on apache.org --14dae947382737f2530502932d13 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello James, In which configuration file and environment variable are you setting -Djute.maxbuffer ? ZooKeeper can pass in many places the JVM flags that could be used to define to pass jut.maxbuffer. Ideally zookeeper-env.sh under the ZooKeeper configuration directory should be the right place where you export flags such as JVMFLAGS, SERVER_JVMFLAGS or CLIENT_JVMFLAGS. regards, esteban. -- Cloudera, Inc. On Mon, Sep 8, 2014 at 11:22 AM, James Hardwick wrote: > Hi All, > > I=E2=80=99m experiencing an issue on multiple hosts w/ Zookeeper 4.6 wher= e Apache > Solr filled the /overseer/queue node too full and can no longer read from > it, and now I=E2=80=99m trying to =E2=80=9Crmr /overseer/queue=E2=80=9D t= o get things working > again. Both systems have 200k+ child nodes of the node at fault. > > On both systems I set -Djute.maxbuffer=3D5242880 within the zkServer.sh > throughout the cluster and -Djute.maxbuffer=3D10000000 in zkCli.sh. On on= e > system I couldn=E2=80=99t get this to work until I set zkCli=E2=80=99s se= tting > substantially higher than the zkServer=E2=80=99s, but I *did* get it to w= ork and > have since cleared the queue for that given system. > > However, I=E2=80=99m beating my head against a wall for our other system.= I=E2=80=99ve set > all of the exact same settings and am having no luck rmr=E2=80=99ing the = node. I=E2=80=99ve > tried bumping the maxbuffer settings to 2-4x as high and still no luck. > Every attempt from zkCli results in "ConnectionLossException: > KeeperErrorCode =3D ConnectionLoss for /overseer/queue" > > I=E2=80=99m at my wits end here. I=E2=80=99ve checked everything over and= over and cannot > see any reason why this should not be working. It appears as a correctly > set JVM arg when I grep the zookeeper process. Any advice from anyone is > appreciated! > > -- > James Hardwick > > --14dae947382737f2530502932d13--