manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CONNECTORS-941) Solr Connector with basic auth no longer works
Date Thu, 22 May 2014 14:39:35 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005961#comment-14005961
] 

Karl Wright commented on CONNECTORS-941:
----------------------------------------

This is the current output:

{code}
DEBUG 2014-05-22 16:22:33,104 (Thread-1290) - In doExecute; HttpRequest class is org.apache.http.client.methods.HttpPost
DEBUG 2014-05-22 16:22:33,106 (Thread-1290) - About to call execChain.execute(); wrapper class
is org.apache.http.client.methods.HttpRequestWrapper$HttpEntityEnclosingRequestWrapper
DEBUG 2014-05-22 16:22:33,111 (Thread-1290) - Expect/continue is NOT enabled in RequestExpectContinue
DEBUG 2014-05-22 16:22:33,111 (Thread-1290) -  No current EXPECT directive
DEBUG 2014-05-22 16:22:33,111 (Thread-1290) -   request is instanceof HttpEntityEnclosingRequest
DEBUG 2014-05-22 16:22:33,111 (Thread-1290) -    non-null entity and ver > 1.0
DEBUG 2014-05-22 16:22:33,111 (Thread-1290) - CookieSpec selected: best-match
DEBUG 2014-05-22 16:22:33,119 (Thread-1290) - Auth cache not set in the context
DEBUG 2014-05-22 16:22:33,119 (Thread-1290) - In MainClientExec.execute(); request class is
org.apache.http.client.methods.HttpRequestWrapper$HttpEntityEnclosingRequestWrapper
DEBUG 2014-05-22 16:22:33,124 (Thread-1290) - Connection request: [route: {s}->https://solr-test01.uio.no:443][total
kept alive: 0; route allocated: 0 of 2; total allocated: 0 of 1]
DEBUG 2014-05-22 16:22:33,125 (Thread-1290) - Connection leased: [id: 3][route: {s}->https://solr-test01.uio.no:443][total
kept alive: 0; route allocated: 1 of 2; total allocated: 1 of 1]
DEBUG 2014-05-22 16:22:33,125 (Thread-1290) - Expect/continue is NOT enabled in MainClientExec,
exec count 1
DEBUG 2014-05-22 16:22:33,125 (Thread-1290) - Opening connection {s}->https://solr-test01.uio.no:443
DEBUG 2014-05-22 16:22:33,127 (Thread-1290) - Connecting to solr-test01.uio.no/129.240.120.18:443
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - Connection established 129.240.120.19:36413<->129.240.120.18:443
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - Executing request POST /solr/uio/update?wt=xml&version=2.2
HTTP/1.1
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - Target auth state: UNCHALLENGED
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - Proxy auth state: UNCHALLENGED
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - Calling requestExecutor.execute(); request class
is org.apache.http.client.methods.HttpRequestWrapper$HttpEntityEnclosingRequestWrapper
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> POST /solr/uio/update?wt=xml&version=2.2
HTTP/1.1
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> User-Agent: Solr[org.apache.solr.client.solrj.impl.HttpSolrServer]
1.0
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> Transfer-Encoding:
chunked
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> Content-Type: application/xml;
charset=UTF-8
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> Host: solr-test01.uio.no:443
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> Connection: Keep-Alive
DEBUG 2014-05-22 16:22:33,178 (Thread-1290) - http-outgoing-3 >> Accept-Encoding: gzip,deflate
DEBUG 2014-05-22 16:22:33,179 (Thread-1290) - http-outgoing-3 >> "POST /solr/uio/update?wt=xml&version=2.2
HTTP/1.1[\r][\n]"
DEBUG 2014-05-22 16:22:33,179 (Thread-1290) - http-outgoing-3 >> "User-Agent: Solr[org.apache.solr.client.solrj.impl.HttpSolrServer]
1.0[\r][\n]"
DEBUG 2014-05-22 16:22:33,179 (Thread-1290) - http-outgoing-3 >> "Transfer-Encoding:
chunked[\r][\n]"
DEBUG 2014-05-22 16:22:33,179 (Thread-1290) - http-outgoing-3 >> "Content-Type: application/xml;
charset=UTF-8[\r][\n]"
DEBUG 2014-05-22 16:22:33,179 (Thread-1290) - http-outgoing-3 >> "Host: solr-test01.uio.no:443[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "Connection: Keep-Alive[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "Accept-Encoding: gzip,deflate[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "2c[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "<delete><id>http://app.uio.no/</id></delete>[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "0[\r][\n]"
DEBUG 2014-05-22 16:22:33,180 (Thread-1290) - http-outgoing-3 >> "[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "HTTP/1.1 401 Authorization
Required[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "Date: Thu, 22 May
2014 14:22:33 GMT[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "Server: Apache/2.2.24
(Unix)[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "WWW-Authenticate:
Basic realm="resin"[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "Content-Length: 527[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "Keep-Alive: timeout=5,
max=100[\r][\n]"
DEBUG 2014-05-22 16:22:33,183 (Thread-1290) - http-outgoing-3 << "Connection: Keep-Alive[\r][\n]"
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << "Content-Type: text/html;
charset=iso-8859-1[\r][\n]"
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << "[\r][\n]"
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << HTTP/1.1 401 Authorization
Required
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Date: Thu, 22 May 2014
14:22:33 GMT
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Server: Apache/2.2.24
(Unix)
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << WWW-Authenticate: Basic
realm="resin"
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Content-Length: 527
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Keep-Alive: timeout=5,
max=100
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Connection: Keep-Alive
DEBUG 2014-05-22 16:22:33,184 (Thread-1290) - http-outgoing-3 << Content-Type: text/html;
charset=iso-8859-1
DEBUG 2014-05-22 16:22:33,186 (Thread-1290) - Connection can be kept alive for 5000 MILLISECONDS
DEBUG 2014-05-22 16:22:33,186 (Thread-1290) - Authentication required
DEBUG 2014-05-22 16:22:33,186 (Thread-1290) - solr-test01.uio.no:443 requested authentication
DEBUG 2014-05-22 16:22:33,187 (Thread-1290) - Authentication schemes in the order of preference:
[negotiate, Kerberos, NTLM, Digest, Basic]
DEBUG 2014-05-22 16:22:33,187 (Thread-1290) - Challenge for negotiate authentication scheme
not available
DEBUG 2014-05-22 16:22:33,187 (Thread-1290) - Challenge for Kerberos authentication scheme
not available
DEBUG 2014-05-22 16:22:33,187 (Thread-1290) - Challenge for NTLM authentication scheme not
available
DEBUG 2014-05-22 16:22:33,187 (Thread-1290) - Challenge for Digest authentication scheme not
available
DEBUG 2014-05-22 16:22:33,194 (Thread-1290) - Selected authentication options: [BASIC]
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<!DOCTYPE HTML
PUBLIC "-//IETF//DTD HTML 2.0//EN">[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<html><head>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<title>401 Authorization
Required</title>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "</head><body>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<h1>Authorization
Required</h1>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<p>This server
could not verify that you[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "are authorized to
access the document[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "requested.  Either
you supplied the wrong[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "credentials (e.g.,
bad password), or your[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "browser doesn't understand
how to supply[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "the credentials required.</p>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<hr>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "<address>Apache/2.2.24
(Unix) Server at <a href="mailto:webmaster@usit.uio.no">solr-test01.uio.no</a>
Port 443</address>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - http-outgoing-3 << "</body></html>[\n]"
DEBUG 2014-05-22 16:22:33,195 (Thread-1290) - Expect/continue is NOT enabled in MainClientExec,
exec count 2
DEBUG 2014-05-22 16:22:33,196 (Thread-1290) - http-outgoing-3: Shutdown connection
DEBUG 2014-05-22 16:22:33,196 (Thread-1290) - Connection discarded
DEBUG 2014-05-22 16:22:33,196 (Thread-1290) - http-outgoing-3: Close connection
DEBUG 2014-05-22 16:22:33,196 (Thread-1290) - Connection released: [id: 3][route: {s}->https://solr-test01.uio.no:443][total
kept alive: 0; route allocated: 0 of 2; total allocated: 0 of 1]
 WARN 2014-05-22 16:22:33,200 (Worker thread '14') - IO exception during delete: null
org.apache.http.client.ClientProtocolException
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:190)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpSolrServer.request(ModifiedHttpSolrServer.java:292)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.manifoldcf.agents.output.solr.HttpPoster$DeleteThread.run(HttpPoster.java:1146)
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with
a non-repeatable request entity.
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:213)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:188)
	... 7 more
{code}

This run indicates that useExpectContinue() is *off*.  This differs from the result from earlier,
but is potentially easier to fix.

> Solr Connector with basic auth no longer works
> ----------------------------------------------
>
>                 Key: CONNECTORS-941
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-941
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Lucene/SOLR connector
>    Affects Versions: ManifoldCF 1.6
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>            Priority: Critical
>             Fix For: ManifoldCF 1.6.1, ManifoldCF 1.7
>
>
> HttpClient throws an exception when SolrConnector is configured to use Basic Auth.
> {code}
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "HTTP/1.1
401 Authorization Required[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Date: Wed,
21 May 2014 09:02:53 GMT[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Server: Apache/2.2.24
(Unix)[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "WWW-Authenticate:
Basic realm="resin"[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Content-Length:
527[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Keep-Alive:
timeout=5, max=100[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Connection:
Keep-Alive[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Content-Type:
text/html; charset=iso-8859-1[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "[\r][\n]"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << HTTP/1.1 401
Authorization Required
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Date: Wed,
21 May 2014 09:02:53 GMT
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Server: Apache/2.2.24
(Unix)
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << WWW-Authenticate:
Basic realm="resin"
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Content-Length:
527
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Keep-Alive:
timeout=5, max=100
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Connection:
Keep-Alive
> DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Content-Type:
text/html; charset=iso-8859-1
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection can be kept alive for 5000
MILLISECONDS
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Authentication required
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - solr-test01.uio.no:443 requested authentication
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Authentication schemes in the order
of preference: [negotiate, Kerberos, NTLM, Digest, Basic]
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for negotiate authentication
scheme not available
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for Kerberos authentication
scheme not available
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for NTLM authentication scheme
not available
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for Digest authentication
scheme not available
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Selected authentication options: [BASIC]
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<!DOCTYPE
HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<html><head>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<title>401
Authorization Required</title>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "</head><body>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<h1>Authorization
Required</h1>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<p>This
server could not verify that you[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "are authorized
to access the document[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "requested.
 Either you supplied the wrong[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "credentials
(e.g., bad password), or your[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "browser doesn't
understand how to supply[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "the credentials
required.</p>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<hr>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<address>Apache/2.2.24
(Unix) Server at <a 
> href="mailto:webmaster@usit.uio.no">solr-test01.uio.no</a> Port 443</address>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "</body></html>[\n]"
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17: Shutdown connection
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection discarded
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17: Close connection
> DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection released: [id: 17][route:
{s}->https://solr-test01.uio.no:443][total kept alive: 0; route allocated: 
> 0 of 2; total allocated: 0 of 1]
>  WARN 2014-05-21 11:02:53,573 (Worker thread '5') - IO exception during indexing http://foreninger.uio.no/:
null
> org.apache.http.client.ClientProtocolException
> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:188)
> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
> 	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpSolrServer.request(ModifiedHttpSolrServer.java:292)
> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
> 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
> 	at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:951)
> Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request
with a non-repeatable request entity.
> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:208)
> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186)
> 	... 7 more
>  WARN 2014-05-21 11:02:53,574 (Worker thread '5') - Service interruption reported for
job 1391414882852 connection 'Web': IO exception during indexing 
> http://foreninger.uio.no/: null
> DEBUG 2014-05-21 11:02:54,673 (Idle cleanup thread) - Closing connections idle longer
than 300000 MILLISECONDS
> DEBUG 2014-05-21 11:02:54,673 (Idle cleanup thread) - Closing expired connections
> {code}
> It does not appear that expect-continue is working in HttpClient 4.3, even though it
is explicitly enabled.  See CONNECTORS-661.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message