lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Kiran <ravi.bhas...@gmail.com>
Subject Re: Http Connection is hanging while deleteByQuery
Date Tue, 01 Feb 2011 03:53:35 GMT
Hello Shan,
                 I was able to delete without hanging by making the
following changes to the solrconfig.xml in the mainIndex section and
reloading the core. BTW Iam using 1.4.1...Hope you get your deletes working
as well. Let us know if it works for you or if you find any other solution

     <!-- If true, IndexReaders will be reopened (often more efficient)
instead of closed and then opened. -->
     <reopenReaders>true</reopenReaders>

    <deletionPolicy class="solr.SolrDeletionPolicy">
        <!-- The number of commit points to be kept -->
        <str name="maxCommitsToKeep">1</str>
        <!-- The number of optimized commit points to be kept -->
        <str name="maxOptimizedCommitsToKeep">0</str>
     </deletionPolicy>


Ravi Kiran Bhaskar


On Mon, Jan 31, 2011 at 6:19 AM, shan2812 <shanmugaraja.ck@gmail.com> wrote:

>
> This is the log trace..
>
> 2011-01-31 10:07:18,837 ERROR (main)[SearchBusinessControllerImpl] Solr
> connecting to url: http://10.145.10.154:8081/solr
> 2011-01-31 10:07:18,873 DEBUG (main)[DefaultHttpParams] Set parameter
> http.useragent = Jakarta Commons-HttpClient/3.1
> 2011-01-31 10:07:18,880 DEBUG (main)[DefaultHttpParams] Set parameter
> http.protocol.version = HTTP/1.1
> 2011-01-31 10:07:18,881 DEBUG (main)[DefaultHttpParams] Set parameter
> http.connection-manager.class = class
> org.apache.commons.httpclient.SimpleHttpConnectionManager
> 2011-01-31 10:07:18,881 DEBUG (main)[DefaultHttpParams] Set parameter
> http.protocol.cookie-policy = default
> 2011-01-31 10:07:18,881 DEBUG (main)[DefaultHttpParams] Set parameter
> http.protocol.element-charset = US-ASCII
> 2011-01-31 10:07:18,881 DEBUG (main)[DefaultHttpParams] Set parameter
> http.protocol.content-charset = ISO-8859-1
> 2011-01-31 10:07:18,881 DEBUG (main)[DefaultHttpParams] Set parameter
> http.method.retry-handler =
> org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@15299647
> 2011-01-31 10:07:18,882 DEBUG (main)[DefaultHttpParams] Set parameter
> http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy
> HH:mm:ss zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE,
> dd-MMM-yyyy HH-mm-ss z, EEE, dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss
> z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy HH-mm-ss z, EEE dd-MMM-yy
> HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z,
> EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
> 2011-01-31 10:07:18,882 DEBUG (main)[DefaultHttpParams] Set parameter
> http.connection.timeout = 10000
> 2011-01-31 10:07:18,882 DEBUG (main)[DefaultHttpParams] Set parameter
> http.connection-manager.max-total = 10
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Java version: 1.5.0_22
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Java vendor: Sun
> Microsystems Inc.
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Java class path:
>
> :/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/activation-1.0.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-cell-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-clustering-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-core-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-dataimporthandler-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-dataimporthandler-extras-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/apache-solr-solrj-1.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/castor-1.0.5-xml.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-cache-0.1-dev.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-codec-1.3.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-collections-3.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-configuration-1.3.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-dbcp-1.2.1.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-dbutils-1.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-fileupload-1.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-httpclient-3.1.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-lang-2.1.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-logging-1.0.4.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/commons-pool-1.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/dom4j-1.6.1.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/google-api-translate-java-0.6.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/jakarta-oro-2.0.6.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/log4j-1.2.15.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/mail-1.3.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/mysql-connector-java-5.0.7-bin.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/netrics-likeit-4.1.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/ojdbc14-10.2.0.3.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/oro-2.0.8.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/slf4j-api-1.4.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/slf4j-log4j12-1.4.2.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/toplink-10.1.3.1.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/vrp-business-cmd-4.3.24.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/vrp-cmd-dataloader-4.2.18.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/vrp-xml-crdif-2.0.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/xerces-2.4.0.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/xmlparserv2-10.1.3.jar:/tui/cmd/test/cmdadapter/bulk-batchjob-loader/program/lib/xstream-1.3.jar
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Operating system name:
> Linux
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Operating system
> architecture: amd64
> 2011-01-31 10:07:18,883 DEBUG (main)[HttpClient] Operating system version:
> 2.6.18-194.3.1.el5
> 2011-01-31 10:07:18,884 DEBUG (main)[HttpClient] SUN 1.5: SUN (DSA
> key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom;
> X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX
> CertPathBuilder; LDAP, Collection CertStores)
> 2011-01-31 10:07:18,885 DEBUG (main)[HttpClient] SunRsaSign 1.5: Sun RSA
> signature provider
> 2011-01-31 10:07:18,885 DEBUG (main)[HttpClient] SunJSSE 1.5: Sun JSSE
> provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
> 2011-01-31 10:07:18,885 DEBUG (main)[HttpClient] SunJCE 1.5: SunJCE
> Provider
> (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2, PBE,
> Diffie-Hellman, HMAC)
> 2011-01-31 10:07:18,885 DEBUG (main)[HttpClient] SunJGSS 1.0: Sun (Kerberos
> v5)
> 2011-01-31 10:07:18,885 DEBUG (main)[HttpClient] SunSASL 1.5: Sun SASL
> provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL,
> PLAIN, CRAM-MD5; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5)
> 2011-01-31 10:07:18,949 DEBUG (main)[PostMethod] enter
> PostMethod.clearRequestBody()
> 2011-01-31 10:07:18,949 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.clearRequestBody()
> 2011-01-31 10:07:18,950 DEBUG (main)[HttpMethodBase]
> HttpMethodBase.addRequestHeader(Header)
> 2011-01-31 10:07:18,950 DEBUG (main)[HttpClient] enter
> HttpClient.executeMethod(HttpMethod)
> 2011-01-31 10:07:18,950 DEBUG (main)[HttpClient] enter
> HttpClient.executeMethod(HostConfiguration,HttpMethod,HttpState)
> 2011-01-31 10:07:18,958 DEBUG (main)[HttpMethodDirector] Attempt number 1
> to
> process request
> 2011-01-31 10:07:18,958 DEBUG (main)[HttpConnection] enter
> HttpConnection.open()
> 2011-01-31 10:07:18,958 DEBUG (main)[HttpConnection] Open connection to
> 10.145.10.154:8081
> 2011-01-31 10:07:18,975 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.execute(HttpState, HttpConnection)
> 2011-01-31 10:07:18,975 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.writeRequest(HttpState, HttpConnection)
> 2011-01-31 10:07:18,975 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
> 2011-01-31 10:07:18,975 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.generateRequestLine(HttpConnection, String, String, String,
> String)
> 2011-01-31 10:07:18,976 DEBUG (main)[header] >> "POST
> /solr/update?wt=javabin&version=1 HTTP/1.1[\r][\n]"
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.addRequestHeaders(HttpState, HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[ExpectContinueMethod] enter
> ExpectContinueMethod.addRequestHeaders(HttpState, HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addUserAgentRequestHeaders(HttpState, HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] Adding Host request
> header
> 2011-01-31 10:07:18,976 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
> 2011-01-31 10:07:18,988 DEBUG (main)[HttpState] enter
> HttpState.getCookies()
> 2011-01-31 10:07:18,988 DEBUG (main)[CookieSpec] enter
> CookieSpecBase.match(String, int, String, boolean, Cookie[])
> 2011-01-31 10:07:18,988 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.addContentLengthRequestHeader(HttpState,
> HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.getRequestContentLength()
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpMethodBase]
> HttpMethodBase.addRequestHeader(Header)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.renerateRequestBody()
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "User-Agent:
> Solr[org.apache.solr.client.solrj.impl.CommonsHttpSolrServer] 1.0[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Host:
> 10.145.10.154:8081[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Transfer-Encoding:
> chunked[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Content-Type: text/xml;
> charset=utf-8[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.writeLine()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.getRequestContentLength()
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.getRequestOutputStream()
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "58[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "<delete><query>type:"LDI"
> AND sysname:"ICAO" AND itemtypedesc:"Airport"</query></delete>"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "0"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[EntityEnclosingMethod] Request body
> sent
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
> HttpConnection.flushRequestOutputStream()
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.readResponse(HttpState, HttpConnection)
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.readStatusLine(HttpState, HttpConnection)
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
> HttpConnection.readLine()
> 2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
> HttpParser.readLine(InputStream, String)
> 2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
> HttpParser.readRawLine()
>
>
> It stays here for 2-3 hours(it still..) and no exception or any error..
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2388953.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message