From solr-user-return-149069-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Thu Aug 1 22:15:56 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E817A180644 for ; Fri, 2 Aug 2019 00:15:55 +0200 (CEST) Received: (qmail 32789 invoked by uid 500); 1 Aug 2019 22:15:50 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 32752 invoked by uid 99); 1 Aug 2019 22:15:49 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Aug 2019 22:15:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 791EEC26B7 for ; Thu, 1 Aug 2019 22:15:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -2.502 X-Spam-Level: X-Spam-Status: No, score=-2.502 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=oracle.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id BzRduN7iKlTa for ; Thu, 1 Aug 2019 22:15:46 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=156.151.31.85; helo=userp2120.oracle.com; envelope-from=maria.rabelero@oracle.com; receiver= Received: from userp2120.oracle.com (userp2120.oracle.com [156.151.31.85]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id DE246BC806 for ; Thu, 1 Aug 2019 22:15:45 +0000 (UTC) Received: from pps.filterd (userp2120.oracle.com [127.0.0.1]) by userp2120.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x71MDttP135365 for ; Thu, 1 Aug 2019 22:15:38 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : content-type : content-transfer-encoding : mime-version : subject : date : references : to : in-reply-to : message-id; s=corp-2018-07-02; bh=jgg6pwQksl/4Qh6m9+qvsa7XiPRyWalpNrOZkgGhRwI=; b=yh3lAlGT4d/PO8VbQBMlpxFG2wPl5y2MJRO/fb9gnenwvlwtN3dbudNp8eDciOlj2cxN SyCkiwaxP0lb6vwuDlqzk3l/EsEIOgjqs4WbYvBTxJ6Fz5mFP91ELkyLJgZRBEds2CHg TIvMucpRvZVZvVKZaUZBbTu/RMlx+u4UH8jPPQEA00AqhjiUDAM5Q9XFxeYDbJF/8PGL p2FYIZs2qjVX6My3j4W0s2hh/CdbJt5+k03A29DdkAQOfSlQDroIsh8V7QWK3J4vqcmO NMyFQNQjilGcA0bOkFNOBHQLcRYt3Iaz8O7wUQaq6XNFx0Vw1UVNQKBN2cm2srHENKHS hw== Received: from aserp3020.oracle.com (aserp3020.oracle.com [141.146.126.70]) by userp2120.oracle.com with ESMTP id 2u0f8reg04-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Thu, 01 Aug 2019 22:15:38 +0000 Received: from pps.filterd (aserp3020.oracle.com [127.0.0.1]) by aserp3020.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x71MCeFH064472 for ; Thu, 1 Aug 2019 22:15:37 GMT Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by aserp3020.oracle.com with ESMTP id 2u2jp6mjuh-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Thu, 01 Aug 2019 22:15:37 +0000 Received: from abhmp0014.oracle.com (abhmp0014.oracle.com [141.146.116.20]) by userv0121.oracle.com (8.14.4/8.13.8) with ESMTP id x71MFaP7022966 for ; Thu, 1 Aug 2019 22:15:36 GMT Received: from dhcp-10-159-244-88.vpn.oracle.com (/10.159.244.88) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Thu, 01 Aug 2019 15:15:36 -0700 From: Angie Rabelero Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: Solr on HDFS Date: Thu, 1 Aug 2019 17:15:33 -0500 References: <30a720f1-72e6-66ef-e125-db6b577e43fe@gmail.com> To: solr-user@lucene.apache.org In-Reply-To: <30a720f1-72e6-66ef-e125-db6b577e43fe@gmail.com> Message-Id: <0AD33125-41FD-4CCD-8BA7-B9AAE1192B9E@oracle.com> X-Mailer: Apple Mail (2.3445.104.11) X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9336 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=5 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908010234 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9336 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 priorityscore=1501 malwarescore=0 suspectscore=5 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908010234 I don=E2=80=99t think you=E2=80=99re using claudera or ambari, but = ambari has an option to delete the locks. This seems more a = configuration/architecture isssue than a realibility issue. You may want = to spin up an alias while you bring down, clear locks and directories, = recreate and index the affected collection, while you work your other = isues. On Aug 1, 2019, at 16:40, Joe Obernberger = wrote: Been using Solr on HDFS for a while now, and I'm seeing an issue with = redundancy/reliability. If a server goes down, when it comes back up, = it will never recover because of the lock files in HDFS. That solr node = needs to be brought down manually, the lock files deleted, and then = brought back up. At that point, it appears to copy all the data for its = replicas. If the index is large, and new data is being indexed, in some = cases it will never recover. The replication retries over and over. How can we make a reliable Solr Cloud cluster when using HDFS that can = handle servers coming and going? Thank you! -Joe