From solr-user-return-149502-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Tue Sep 3 09:55:39 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 0F12A180637 for ; Tue, 3 Sep 2019 11:55:38 +0200 (CEST) Received: (qmail 29345 invoked by uid 500); 3 Sep 2019 11:24:51 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 29333 invoked by uid 99); 3 Sep 2019 11:24:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Sep 2019 11:24:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 70012C1CFA for ; Tue, 3 Sep 2019 09:55:35 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.051 X-Spam-Level: ** X-Spam-Status: No, score=2.051 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id lNLH0wFBqwrG for ; Tue, 3 Sep 2019 09:55:32 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::235; helo=mail-lj1-x235.google.com; envelope-from=shankarmca88@gmail.com; receiver= Received: from mail-lj1-x235.google.com (mail-lj1-x235.google.com [IPv6:2a00:1450:4864:20::235]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 121BE7DD5B for ; Tue, 3 Sep 2019 09:55:32 +0000 (UTC) Received: by mail-lj1-x235.google.com with SMTP id j16so9213809ljg.6 for ; Tue, 03 Sep 2019 02:55:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=A0q+h2wBC0+rLsS+clT5SpZKjgwTKY4NhRIw2tWi5+M=; b=h/Ar+Yjif6tGA1fIkO8tEFjCmZJqM3XPOWY+IaE6fVKQIeHYWGh/bSvFOIzL3wvdcw th+yas0++CjfENjZgC33wvgu4DVf/4FsZXAcvAc+YkflK4dJU19xOu85ClDUVLrhFzX3 1U+oHfoE6luYhK0lT6OTM5rUEIXLCjzJPzHRIm86grWKCNBBRaCnnrKF751H161Y8tvl K4oJaEZ49Nl1kGADwYHQmSxI6XgcRc2boRcgUf/sp9nBr4t0PiJEpYG5A5rQSX7m74qR qaW7q3/rTzVDeGtwyjpu1p3++7se5vDHfpX9ta9N4D99YZQVF64H3/O8c5/X1t+h902D nmWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=A0q+h2wBC0+rLsS+clT5SpZKjgwTKY4NhRIw2tWi5+M=; b=m+CEslDhrnbe/c/i6JWoJjYXmEyKbPxmM2QcKbF9nUG8aSLRbS0VaFuz95qma4jUF8 SEU+vwLFX/mGfaeeuR/6Gdeui7zNp8LcpoE/mSaUe/qyfNtX761dhjI+snrvuU/het1w KIku/NOxllNao12MNCOk5ubIDY0i27mR0vPIKCCv1+rWh0drKuSb9A/ZAeaYa5e7UUCU tV8JCx4MysZHBRQN8gxJd9jQxSVJ8u0LQdldJmB4tBzhz9GgiLecIcAPDSNK7JJ4kRX9 FfZ7I79R4RnhnBVNRHO3c6mQCSbJNwH6U9R1CUQxy1+9gqWeskFBDti+S5G/kXFDm+yQ IN9A== X-Gm-Message-State: APjAAAUyF+9G/1/rLAMuJ73S/95qTRRD0+7NJsPluj3qu3JxRB0Zc4Vo PP16NLcsjfqSDjL6M7cQRPUZA+xRdW2W6PzRBbMaeA== X-Google-Smtp-Source: APXvYqyCtVOLRoY3inPDEFIY12OOMtj9KK+r8on5uzyAOcVuCd8hwHAqj9ZZ8+EfM54tMprhd4+SN9QfWgO2p8+0zUE= X-Received: by 2002:a2e:1b56:: with SMTP id b83mr8491165ljb.107.1567504530993; Tue, 03 Sep 2019 02:55:30 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Shankar Ramalingam Date: Tue, 3 Sep 2019 15:25:16 +0530 Message-ID: Subject: Re: Index fetch failed To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary="000000000000c0f45e0591a316f5" --000000000000c0f45e0591a316f5 Content-Type: text/plain; charset="UTF-8" Please remove my email id from this list. On Tue, 3 Sep, 2019, 11:06 AM Akreeti Agarwal, wrote: > Hello, > > Please help me with the solution for below error. > > Memory details of slave server: > total used free shared buffers cached > Mem: 15947 15460 487 62 144 6007 > -/+ buffers/cache: 9308 6639 > Swap: 0 0 0 > > > Thanks & Regards, > Akreeti Agarwal > > -----Original Message----- > From: Akreeti Agarwal > Sent: Wednesday, August 28, 2019 2:45 PM > To: solr-user@lucene.apache.org > Subject: RE: Index fetch failed > > Yes I am using solr-5.5.5. > This error is intermittent. I don't think there must be any issue with > master connection limits. This error is accompanied by this on master side: > > ERROR (qtp1450821318-60072) [ x:sitecore_web_index] > o.a.s.h.ReplicationHandler Unable to get file names for indexCommit > generation: 1558637 > java.nio.file.NoSuchFileException: > /solrm-efs/solr-m/server/solr/sitecore_web_index/data/index/_12i9p_1.liv > at > sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) > at > sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) > at > sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) > at > sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55) > at > sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144) > at > sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99) > at java.nio.file.Files.readAttributes(Files.java:1737) > at java.nio.file.Files.size(Files.java:2332) > at > org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:210) > at > org.apache.lucene.store.NRTCachingDirectory.fileLength(NRTCachingDirectory.java:124) > at > org.apache.solr.handler.ReplicationHandler.getFileList(ReplicationHandler.java:563) > at > org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:253) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:155) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2102) > at > org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654) > at > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208) > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) > at org.eclipse.jetty.server.Server.handle(Server.java:499) > at > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) > at > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) > at org.eclipse.jetty.io > .AbstractConnection$2.run(AbstractConnection.java:540) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) > at java.lang.Thread.run(Thread.java:748) > > Thanks & Regards, > Akreeti Agarwal > > -----Original Message----- > From: Atita Arora > Sent: Wednesday, August 28, 2019 2:23 PM > To: solr-user@lucene.apache.org > Subject: Re: Index fetch failed > > This looks like ample memory to get the index chunk. > Also, I looked at the IndexFetcher code, I remember you were using Solr > 5.5.5 and the only reason in my view, this would happen is when the index > chunk is not downloaded as can also be seen in the error (Downloaded > 0!=123) which clearly states that the index generations are not in sync > and this is not user aborted action too. > > Is this error intermittent? could there be a possibility that your master > has connection limits? or maybe some network hiccup? > > > > On Wed, Aug 28, 2019 at 10:40 AM Akreeti Agarwal wrote: > > > Hi, > > > > Memory details for slave1: > > > > Filesystem Size Used Avail Use% Mounted on > > /dev/xvda1 99G 40G 55G 43% / > > tmpfs 7.8G 0 7.8G 0% /dev/shm > > > > Memory details for slave2: > > > > Filesystem Size Used Avail Use% Mounted on > > /dev/xvda1 99G 45G 49G 48% / > > tmpfs 7.8G 0 7.8G 0% /dev/shm > > > > Thanks & Regards, > > Akreeti Agarwal > > > > -----Original Message----- > > From: Atita Arora > > Sent: Wednesday, August 28, 2019 11:15 AM > > To: solr-user@lucene.apache.org > > Subject: Re: Index fetch failed > > > > Hii, > > > > Do you have enough memory free for the index chunk to be > > fetched/Downloaded on the slave node? > > > > > > On Wed, Aug 28, 2019 at 6:57 AM Akreeti Agarwal > wrote: > > > > > Hello Everyone, > > > > > > I am getting this error continuously on Solr slave, can anyone tell > > > me the solution for this: > > > > > > 642141666 ERROR (indexFetcher-72-thread-1) [ x:sitecore_web_index] > > > o.a.s.h.ReplicationHandler Index fetch failed > > > :org.apache.solr.common.SolrException: Unable to download > > > _12i7v_f.liv completely. Downloaded 0!=123 > > > at > > > > > org.apache.solr.handler.IndexFetcher$FileFetcher.cleanup(IndexFetcher. > > java:1434) > > > at > > > > > org.apache.solr.handler.IndexFetcher$FileFetcher.fetchFile(IndexFetche > > r.java:1314) > > > at > > > > > org.apache.solr.handler.IndexFetcher.downloadIndexFiles(IndexFetcher.j > > ava:812) > > > at > > > org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.j > > > av > > > a:427) > > > > > > > > > Thanks & Regards, > > > Akreeti Agarwal > > > (M) +91-8318686601 > > > > > > ::DISCLAIMER:: > > > > > > -------------------------------------------------------------------- > > > -- > > > -------------------------------------------------------------------- > > > -- > > > -------------------------------------------------------------------- > > > -- > > > -------------------------------------------------------------------- > > > The contents of this e-mail and any attachment(s) are confidential > > > and intended for the named recipient(s) only. E-mail transmission is > > > not guaranteed to be secure or error-free as information could be > > > intercepted, corrupted, lost, destroyed, arrive late or incomplete, > > > or may contain viruses in transmission. The e mail and its contents > > > (with or without referred errors) shall therefore not attach any > > > liability on the originator or HCL or its affiliates. Views or > > > opinions, if any, presented in this email are solely those of the > > > author and may not necessarily reflect the views or opinions of HCL or > its affiliates. > > > Any form of reproduction, dissemination, copying, disclosure, > > > modification, distribution and / or publication of this message > > > without the prior written consent of authorized representative of > > > HCL is strictly prohibited. If you have received this email in error > > > please delete it and notify the sender immediately. Before opening > > > any email and/or attachments, please check them for viruses and > > > other > > defects. > > > > > > -------------------------------------------------------------------- > > > -- > > > > > ---------------------------------------------------------------------- > > ---------------------------------------------------------------------- > > -------------------------------------------------------------------- > > > > > > --000000000000c0f45e0591a316f5--