Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1ACB0E832 for ; Wed, 28 Nov 2012 14:02:39 +0000 (UTC) Received: (qmail 88336 invoked by uid 500); 28 Nov 2012 14:02:38 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 88279 invoked by uid 500); 28 Nov 2012 14:02:38 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 88261 invoked by uid 99); 28 Nov 2012 14:02:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Nov 2012 14:02:37 +0000 X-ASF-Spam-Status: No, hits=-1.6 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_NEUTRAL,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [195.245.230.34] (HELO mail1.bemta3.messagelabs.com) (195.245.230.34) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Nov 2012 14:02:31 +0000 Received: from [85.158.137.3:9639] by server-16.bemta-3.messagelabs.com id 7E/1A-07461-06916B05; Wed, 28 Nov 2012 14:02:08 +0000 X-Env-Sender: robert.iannetti@novartis.com X-Msg-Ref: server-11.tower-38.messagelabs.com!1354111327!18282292!1 X-Originating-IP: [160.62.7.19] X-StarScan-Received: X-StarScan-Version: 6.6.1.8; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9428 invoked from network); 28 Nov 2012 14:02:08 -0000 Received: from unknown (HELO ch1ssaenov01.novartis.com) (160.62.7.19) by server-11.tower-38.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 28 Nov 2012 14:02:08 -0000 Received: from ch3ssinov3.novartis.net ([147.167.65.236]) by ch1ssaenov01.novartis.com (8.14.4/8.14.4) with ESMTP id qASE2HS3024199 for ; Wed, 28 Nov 2012 15:02:17 +0100 Received: from webmail2.novartis.net (023-ch1mmr1-005.023d.mgd.msft.net [160.62.24.14]) by ch3ssinov3.novartis.net (8.14.4/8.14.4) with ESMTP id qASE2210022236 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT) for ; Wed, 28 Nov 2012 15:02:07 +0100 Received: from 023-CH1MPN1-042.023d.mgd.msft.net ([169.254.2.61]) by 023-CH1MMR1-005.023d.mgd.msft.net ([160.62.24.14]) with mapi id 14.02.0318.003; Wed, 28 Nov 2012 14:01:55 +0000 From: "Iannetti, Robert" To: "user@manifoldcf.apache.org" Subject: RE: Cannot connect to SharePoint 2010 instance Thread-Topic: Cannot connect to SharePoint 2010 instance Thread-Index: Ac27jH0doh9lEjT/REKUbkCJp3tSKQAM9Y6AABjx1zAADQD5AAAMXOiA//+xlQCAABnyYIAANZaAgABgq3D//6T6gIAAZBqg//+ikgCAAGQYYP//n7MAAAyHxMAADB3yAAAYI+aAABjLvJAAIksvgABRHfLwAJdsEbABIAfrgAGHz7OAACX/ZoAATMrT4ACLR6iAASKup0ACKTOnAAQ78ADwCGrM9AAQ34dNgCG+jv2gQ3z7nQCEN8yJIIhvjO+AkN8ZUAChvjDdYMN8TxyAhvibyrCN8RbzgJvhKE2w Date: Wed, 28 Nov 2012 14:01:54 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [160.62.199.190] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Karl, Here is my debug output DEBUG 2012-11-28 08:59:25,884 (Thread-479) - >> POST /_vti_bin/lists.asmx H= TTP/1 .1 DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> Content-Type: text/xml; cha= rset=3D utf-8 DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> SOAPAction: "http://schemas= .micr osoft.com/sharepoint/soap/GetListCollection" DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> User-Agent: Axis/1.4 DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> Content-Length: 335 DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> Host: searchpoc.testproject= s.nib r.novartis.intra DEBUG 2012-11-28 08:59:25,899 (Thread-479) - >> Connection: Keep-Alive DEBUG 2012-11-28 08:59:30,629 (Thread-479) - << HTTP/1.1 401 Unauthorized DEBUG 2012-11-28 08:59:30,629 (Thread-479) - << Server: Microsoft-IIS/7.5 DEBUG 2012-11-28 08:59:30,629 (Thread-479) - << SPRequestGuid: 56647ed0-9ba= c-4a2 e-b61a-2d2e76ae8db0 DEBUG 2012-11-28 08:59:30,629 (Thread-479) - << WWW-Authenticate: NTLM DEBUG 2012-11-28 08:59:30,629 (Thread-479) - << X-Powered-By: ASP.NET DEBUG 2012-11-28 08:59:30,630 (Thread-479) - << MicrosoftSharePointTeamServ= ices: 14.0.0.6123 DEBUG 2012-11-28 08:59:30,630 (Thread-479) - << X-MS-InvokeApp: 1; RequireR= eadOn ly DEBUG 2012-11-28 08:59:30,630 (Thread-479) - << Date: Wed, 28 Nov 2012 13:5= 9:30 GMT DEBUG 2012-11-28 08:59:30,630 (Thread-479) - << Content-Length: 0 DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> POST /_vti_bin/lists.asmx H= TTP/1.1 DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> Content-Type: text/xml; cha= rset=3Dutf-8 DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> SOAPAction: "http://schemas= .microsoft.com/sharepoint/soap/GetListCollection" DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> User-Agent: Axis/1.4 DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> Content-Length: 335 DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> Host: searchpoc.testproject= s.nibr.novartis.intra DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> Connection: Keep-Alive DEBUG 2012-11-28 08:59:30,663 (Thread-479) - >> Authorization: NTLM TlRMTVN= TUAABAAAANQIIIAoACgBAAAAAIAAgACAAAABJAFAALQAxADAALQAxADQANQAtADMAMgAtADEAMg= AxAE4AQQBOAEUAVAA=3D DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << HTTP/1.1 401 Unauthorized DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << Server: Microsoft-IIS/7.5 DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << SPRequestGuid: 208f5c66-7d2= 6-4761-b578-d01645f042ed DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << WWW-Authenticate: NTLM TlRM= TVNTUAACAAAADgAOADgAAAA1Aoki47BOSwwS+moAAAAAAAAAAMoAygBGAAAABgGxHQAAAA9OAEk= AQgBSAE4ARQBUAAIADgBOAEkAQgBSAE4ARQBUAAEAGABOAFIAVQBTAEMA QQAtAFMARAAwADcAOQAEACIAbgBpAGIAcgAuAG4AbwB2AGEAcgB0AGkAcwAuAG4AZQB0AAMAPAB= OAFIAVQBTAEMAQQAtAFMARAAwADcAOQAuAG4AaQBiAHIALgBuAG8AdgBhAHIAdABpAHMALgBuAG= UAdAAFACIAbgBpAGIAcgAuAG4AbwB2AGEAcgB0AGkAcwAuAG4AZQB0AAc ACADnYxaWcM3NAQAAAAA=3D DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << X-Powered-By: ASP.NET DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << MicrosoftSharePointTeamServ= ices: 14.0.0.6123 DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << X-MS-InvokeApp: 1; RequireR= eadOnly DEBUG 2012-11-28 08:59:30,680 (Thread-479) - << Date: Wed, 28 Nov 2012 13:5= 9:30 GMT DEBUG 2012-11-28 08:59:30,681 (Thread-479) - << Content-Length: 0 DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> POST /_vti_bin/lists.asmx H= TTP/1.1 DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> Content-Type: text/xml; cha= rset=3Dutf-8 DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> SOAPAction: "http://schemas= .microsoft.com/sharepoint/soap/GetListCollection" DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> User-Agent: Axis/1.4 DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> Content-Length: 335 DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> Host: searchpoc.testproject= s.nibr.novartis.intra DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> Connection: Keep-Alive DEBUG 2012-11-28 08:59:30,702 (Thread-479) - >> Authorization: NTLM TlRMTVN= TUAADAAAAGAAYAEAAAAD2APYAWAAAAAoACgBOAQAAEAAQAFgBAAAgACAAaAEAAAAAAACIAQAANQ= IIICC4NUxqA2NFhZWGUuKn6w2BUGw7gfTeNAPDyGyv9jwCyZQE0G+EjCs BAQAAAAAAAOCqZ5Zwzc0BgVBsO4H03jQAAAAAAgAOAE4ASQBCAFIATgBFAFQAAQAYAE4AUgBVAF= MAQwBBAC0AUwBEADAANwA5AAQAIgBuAGkAYgByAC4AbgBvAHYAYQByAHQAaQBzAC4AbgBlAHQAA= wA8AE4AUgBVAFMAQwBBAC0AUwBEADAANwA5AC4AbgBpAGIAcgAuAG4Abw B2AGEAcgB0AGkAcwAuAG4AZQB0AAUAIgBuAGkAYgByAC4AbgBvAHYAYQByAHQAaQBzAC4AbgBlA= HQABwAIAOdjFpZwzc0BAAAAAE4AQQBOAEUAVABpAGEAbgBuAGUAcgBvADEASQBQAC0AMQAwAC0A= MQA0ADUALQAzADIALQAxADIAMQA=3D DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << HTTP/1.1 401 Unauthorized DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << Server: Microsoft-IIS/7.5 DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << SPRequestGuid: cfac18c9-387= 0-4854-bb2d-816f3dc8c2f3 DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << WWW-Authenticate: NTLM DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << X-Powered-By: ASP.NET DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << MicrosoftSharePointTeamServ= ices: 14.0.0.6123 DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << X-MS-InvokeApp: 1; RequireR= eadOnly DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << Date: Wed, 28 Nov 2012 13:5= 9:31 GMT DEBUG 2012-11-28 08:59:31,678 (Thread-479) - << Content-Length: 0 -----Original Message----- From: Karl Wright [mailto:daddywri@gmail.com]=20 Sent: Tuesday, November 27, 2012 5:25 PM To: user@manifoldcf.apache.org Subject: Re: Cannot connect to SharePoint 2010 instance no, you need: log4j.logger.=3DDEBUG in this case: log4j.logger.org.apache.http.headers=3DDEBUG Thanks, Karl On Tue, Nov 27, 2012 at 3:30 PM, Iannetti, Robert wrote: > Karl, > > I added the parameter to the logging.ini file and I am still not=20 > seeing any data written to the log > > # Licensed to the Apache Software Foundation (ASF) under one or more #=20 > contributor license agreements. See the NOTICE file distributed with=20 > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version=20 > 2.0 # (the "License"); you may not use this file except in compliance=20 > with # the License. You may obtain a copy of the License at # > # http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software=20 > # distributed under the License is distributed on an "AS IS" BASIS, #=20 > WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and=20 > # limitations under the License. > > log4j.appender.MAIN.File=3Dlogs/manifoldcf.log > log4j.rootLogger=3DWARN, MAIN > log4j.appender.MAIN=3Dorg.apache.log4j.RollingFileAppender > log4j.appender.MAIN.layout=3Dorg.apache.log4j.PatternLayout > log4j.appender.MAIN.layout.ConversionPattern=3D%5p %d{ISO8601} (%t) -=20 > %m%n > > # add additional logging > org.apache.http.headers=3DDEBUG > > > > > -----Original Message----- > From: Karl Wright [mailto:daddywri@gmail.com] > Sent: Tuesday, November 27, 2012 3:20 PM > To: user@manifoldcf.apache.org > Subject: Re: Cannot connect to SharePoint 2010 instance > > Yes. > Karl > > On Tue, Nov 27, 2012 at 2:14 PM, Iannetti, Robert wrote: >> So would the org.apache.http.headers=3DDEBUG replace the log4j.logger.ht= tpclient.wire=3DDEBUG entry in the logging.ini file? >> >> -----Original Message----- >> From: Karl Wright [mailto:daddywri@gmail.com] >> Sent: Tuesday, November 27, 2012 2:07 PM >> To: user@manifoldcf.apache.org >> Subject: Re: Cannot connect to SharePoint 2010 instance >> >> Here we go: >> >> Header logging: org.apache.http.headers=3DDEBUG Wire logging (which we=20 >> probably don't need): org.apache.http.wire=3DDEBUG >> >> Karl >> >> On Tue, Nov 27, 2012 at 2:04 PM, Karl Wright wrote: >>> The wire debugging setup you are using will only work with=20 >>> commons-httpclient, not the new httpcomponent package. I'll have to=20 >>> do some research and see if there's a comparable logger setting for=20 >>> that package. >>> >>> Karl >>> >>> >>> On Tue, Nov 27, 2012 at 2:01 PM, Iannetti, Robert=20 >>> wrote: >>>> Karl, >>>> >>>> It's odd I added this to the properties.xml file >>> name=3D"org.apache.manifoldcf.connectors" value=3D"DEBUG"/> >>>> >>>> And this to the logging.ini file >>>> log4j.logger.httpclient.wire=3DDEBUG >>>> >>>> I restarted manifold but nothing is being written to the=20 >>>> manifoldcf.log file >>>> >>>> Any thoughts? >>>> >>>> Here is the curl data >>>> >>>> >>>> [iannero1@ip-10-145-32-121 logs]$ curl --data POST --ntlm -u >>>> nanet\\iannero1 http://searchpoc.testprojects.nibr.novartis.intra/_vti= _bin/MCPermissions.asmx -v Enter host password for user 'nanet\iannero1': >>>> * About to connect() to searchpoc.testprojects.nibr.novartis.intra por= t 80 (#0) >>>> * Trying 160.62.169.185... connected >>>> * Connected to searchpoc.testprojects.nibr.novartis.intra >>>> (160.62.169.185) port 80 (#0) >>>> * Initializing NSS with certpath: sql:/etc/pki/nssdb >>>> * Server auth using NTLM with user 'nanet\iannero1' >>>>> POST /_vti_bin/MCPermissions.asmx HTTP/1.1 >>>>> Authorization: NTLM TlRMTVNTUAABAAAABoIIAAAAAAAAAAAAAAAAAAAAAAA=3D >>>>> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 >>>>> NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2 >>>>> Host: searchpoc.testprojects.nibr.novartis.intra >>>>> Accept: */* >>>>> Content-Length: 0 >>>>> Content-Type: application/x-www-form-urlencoded >>>>> >>>> < HTTP/1.1 401 Unauthorized >>>> < Server: Microsoft-IIS/7.5 >>>> < SPRequestGuid: f7b8f5a5-1de4-43d1-9b70-7adf3b7d5987 >>>> < WWW-Authenticate: NTLM >>>> TlRMTVNTUAACAAAABwAHADgAAAAGgokClVhQpcbj++YAAAAAAAAAAMoAygA/AAAABgG >>>> TlRMTVNTUAACAAAABwAHADgAAAAGgokClVhQpcbj++x >>>> TlRMTVNTUAACAAAABwAHADgAAAAGgokClVhQpcbj++H >>>> QAAAA9OSUJSTkVUAgAOAE4ASQBCAFIATgBFAFQAAQAYAE4AUgBVAFMAQwBBAC0AUwBE >>>> A >>>> D >>>> AANwA5AAQAIgBuAGkAYgByAC4AbgBvAHYAYQByAHQAaQBzAC4AbgBlAHQAAwA8AE4AU >>>> g >>>> B >>>> VAFMAQwBBAC0AUwBEADAANwA5AC4AbgBpAGIAcgAuAG4AbwB2AGEAcgB0AGkAcwAuAG >>>> 4 >>>> A >>>> ZQB0AAUAIgBuAGkAYgByAC4AbgBvAHYAYQByAHQAaQBzAC4AbgBlAHQABwAIAA9MVPb >>>> L >>>> z >>>> M0BAAAAAA=3D=3D >>>> < X-Powered-By: ASP.NET >>>> < MicrosoftSharePointTeamServices: 14.0.0.6123 < X-MS-InvokeApp: 1;=20 >>>> RequireReadOnly < Date: Tue, 27 Nov 2012 18:21:04 GMT < >>>> Content-Length: 0 < >>>> * Connection #0 to host searchpoc.testprojects.nibr.novartis.intra >>>> left intact >>>> * Issue another request to this URL: 'http://searchpoc.testprojects.ni= br.novartis.intra/_vti_bin/MCPermissions.asmx' >>>> * Re-using existing connection! (#0) with host=20 >>>> searchpoc.testprojects.nibr.novartis.intra >>>> * Connected to searchpoc.testprojects.nibr.novartis.intra >>>> (160.62.169.185) port 80 (#0) >>>> * Server auth using NTLM with user 'nanet\iannero1' >>>>> POST /_vti_bin/MCPermissions.asmx HTTP/1.1 >>>>> Authorization: NTLM >>>>> TlRMTVNTUAADAAAAGAAYAEAAAAAYABgAWAAAAAUABQBwAAAACAAIAHUAAAAQABAAfQ >>>>> A >>>>> A >>>>> AAAAAAAAAAAABoKJApbX61a3hdN3AAAAAAAAAAAAAAAAAAAAANfyrXuxF91dkEOBT5 >>>>> G M XTvsPdHWkjT6rm5hbmV0aWFubmVybzFpcC0xMC0xNDUtMzItMTIx >>>>> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 >>>>> NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2 >>>>> Host: searchpoc.testprojects.nibr.novartis.intra >>>>> Accept: */* >>>>> Content-Length: 4 >>>>> Content-Type: application/x-www-form-urlencoded >>>>> >>>> < HTTP/1.1 500 Internal Server Error < Cache-Control: private < >>>> Content-Type: application/soap+xml; charset=3Dutf-8 < Server: >>>> Microsoft-IIS/7.5 < X-AspNet-Version: 2.0.50727 < Persistent-Auth: >>>> true < X-Powered-By: ASP.NET < MicrosoftSharePointTeamServices: >>>> 14.0.0.6123 < X-MS-InvokeApp: 1; RequireReadOnly < Date: Tue, 27=20 >>>> Nov >>>> 2012 18:21:04 GMT < Content-Length: 509 < >>>> * Connection #0 to host searchpoc.testprojects.nibr.novartis.intra >>>> left intact >>>> * Closing connection #0 >>>> >>> xmlns:soap=3D"http://www.w3.org/2003/05/soap-envelope" >>>> xmlns:xsi=3D"http://www.w3.org/2001/XMLSchema-instance" >>>> xmlns:xsd=3D"http://www.w3.org/2001/XMLSchema">>>> > >>>> < >>>> soap:Code>soap:Receiver>>> e >>>> a >>>> son>Server was unable to process request. >>>> ---> Data at the root level is invalid. Line 1, position=20 >>>> 1.>>> />[iannero1@ip-10-145-32-1 >>>> 2 >>>> 1 >>>> logs]$ >>>> >>>> >>>> >>>> >>>> -----Original Message----- >>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>> Sent: Tuesday, November 27, 2012 1:10 PM >>>> To: user@manifoldcf.apache.org >>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>> >>>> The file is usually called logging.ini, and is referenced by the main = manifoldcf properties file. >>>> >>>> Karl >>>> >>>> On Tue, Nov 27, 2012 at 1:06 PM, Iannetti, Robert wrote: >>>>> Karl, >>>>> >>>>> Where is the logging properties file where I would add the debugging = commands located ? >>>>> >>>>> Thanks >>>>> Bob >>>>> >>>>> >>>>> -----Original Message----- >>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>> Sent: Tuesday, November 27, 2012 12:52 PM >>>>> To: user@manifoldcf.apache.org >>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>> >>>>> Hi Bob, >>>>> >>>>> If the headers all check out, then maybe this is the cause: >>>>> >>>>> http://technet.microsoft.com/en-us/library/dd566199%28v=3Dws.10%29.a >>>>> s >>>>> p >>>>> x >>>>> >>>>> I will have to check the httpcomponents code to verify that it uses a= t least 128-bit encryption. I won't be able to do that until tonight or to= morrow though. >>>>> >>>>> Karl >>>>> >>>>> >>>>> On Tue, Nov 27, 2012 at 11:36 AM, Karl Wright wr= ote: >>>>>> Hi Bob, >>>>>> >>>>>> This is really beginning to sound like there is a header problem of = some kind. >>>>>> >>>>>> This is what I'd like to try. >>>>>> (1) Turn on wire debugging for SharePoint, as described here: >>>>>> https://cwiki.apache.org/confluence/display/CONNECTORS/Debugging+ >>>>>> C >>>>>> o >>>>>> nn >>>>>> e >>>>>> ctions >>>>>> (2) Using curl, try to use post and the proper credentials, using=20 >>>>>> the -vvv switch. If you successfully connect, save that output. >>>>>> Then try to EXACTLY mimic the request that ManifoldCF does, and=20 >>>>>> if that FAILS record that output and send it all to me. >>>>>> >>>>>> Thanks! >>>>>> Karl >>>>>> >>>>>> >>>>>> >>>>>> On Tue, Nov 27, 2012 at 11:22 AM, Iannetti, Robert=20 >>>>>> wrote: >>>>>>> Hi Karl, >>>>>>> >>>>>>> I have installed the dev version of the connector from below and am= having an issue connecting to my SharePoint 2010 site. >>>>>>> It actually seems similar to what is happening in your thread with = Luigi. >>>>>>> >>>>>>> I try to log in to the sharepoint site as a user with full=20 >>>>>>> control and I get this error >>>>>>> >>>>>>> Crawl user did not authenticate properly, or has insufficient=20 >>>>>>> permissions to access http://xxxx.xxxx.xxxx.xxxx: (401)HTTP/1.1 >>>>>>> 401 Unauthorized >>>>>>> >>>>>>> Thanks >>>>>>> Bob >>>>>>> >>>>>>> -----Original Message----- >>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>> Sent: Monday, November 26, 2012 6:38 PM >>>>>>> To: user@manifoldcf.apache.org >>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>> >>>>>>> Ok, you can download a dev build at: >>>>>>> >>>>>>> http://people.apache.org/~kwright/apache-manifoldcf-1.1-dev >>>>>>> >>>>>>> It takes me about an hour to put one of these together, so if you c= an possibly build ManifoldCF yourself that would be a huge help. >>>>>>> >>>>>>> Karl >>>>>>> >>>>>>> >>>>>>> On Mon, Nov 26, 2012 at 11:12 AM, Iannetti, Robert wrote: >>>>>>>> That would be great please let me know when it is available >>>>>>>> >>>>>>>> Thanks >>>>>>>> Bob >>>>>>>> >>>>>>>> >>>>>>>> -----Original Message----- >>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>> Sent: Monday, November 26, 2012 10:59 AM >>>>>>>> To: user@manifoldcf.apache.org >>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>> >>>>>>>> Hi Robert, >>>>>>>> >>>>>>>> I can build a binary version you can download, but not until tonig= ht. >>>>>>>> >>>>>>>> It may be easier to talk through getting a build environment set u= p on your Linux machine. Is this Debian or Ubuntu linux, by any chance? >>>>>>>> If so, the setup is trivial and I can help you with that. >>>>>>>> >>>>>>>> Karl >>>>>>>> >>>>>>>> On Mon, Nov 26, 2012 at 10:12 AM, Iannetti, Robert wrote: >>>>>>>>> Karl, >>>>>>>>> >>>>>>>>> Is there a binary release (pre -compiled version) of the manifold= trunk mentioned below https://svn.apache.org/repos/asf/manifoldcf/trunk th= at you can point me to I am new to Linux and don't have any experience with= ANT. >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> Bob >>>>>>>>> >>>>>>>>> >>>>>>>>> -----Original Message----- >>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>> Sent: Monday, November 26, 2012 4:32 AM >>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>>> >>>>>>>>> I've done further research on HttpComponents' support for Kerbero= s. >>>>>>>>> It turns out that HttpComponents claims they can successfully use= tickets from the local machine's ticket store. I haven't tried this here = (don't have the setup for it), but it looks like it could conceivably work = with MCF trunk at this point. Read up on it here: >>>>>>>>> >>>>>>>>> http://hc.apache.org/httpcomponents-client-ga/tutorial/html/au >>>>>>>>> t >>>>>>>>> h >>>>>>>>> en >>>>>>>>> t >>>>>>>>> ic >>>>>>>>> a >>>>>>>>> tion.html >>>>>>>>> >>>>>>>>> Ideally, of course, we'd really want to add the ability for Manif= oldCF to handle its own ticket cache, one per connection, so that each conn= ection looks like its own independent client. In order for that to happen,= connectors that support Kerberos would need to be able to kerberos authent= icate. But, for right now, this may work for people needing Kerberos. >>>>>>>>> >>>>>>>>> Karl >>>>>>>>> >>>>>>>>> On Sun, Nov 11, 2012 at 8:42 AM, Karl Wright = wrote: >>>>>>>>>> The port of the SharePoint connector to httpcomponents 4.2.2 is = complete. >>>>>>>>>> >>>>>>>>>> I don't know whether it will help you or not, but if you=20 >>>>>>>>>> check out ManifoldCF trunk (from >>>>>>>>>> https://svn.apache.org/repos/asf/manifoldcf/trunk) and run: >>>>>>>>>> >>>>>>>>>> ant make-core-deps build >>>>>>>>>> >>>>>>>>>> ... you will be running the latest code. It has been tried=20 >>>>>>>>>> against a plain-vanilla SharePoint system using standard NTLM an= d found to work. >>>>>>>>>> If you try the new code and it works for you, that would be=20 >>>>>>>>>> very interesting to know; it looks like httpcomponents has=20 >>>>>>>>>> developed some support for SPNEGO, which may be what is=20 >>>>>>>>>> missing in the current ManifoldCF release. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Karl >>>>>>>>>> >>>>>>>>>> On Wed, Nov 7, 2012 at 4:47 PM, Karl Wright = wrote: >>>>>>>>>>> MCPermissions.asmx and Lists.asmx are two different=20 >>>>>>>>>>> services, and the Lists.asmx is likely failing before the=20 >>>>>>>>>>> MCPermissions.asmx is even needed. If, for instance, you=20 >>>>>>>>>>> are just trying with the UI to see if you get back=20 >>>>>>>>>>> "Connection working", this makes sense since the Lists=20 >>>>>>>>>>> service is called first and then the MCPermissions service is c= alled after. >>>>>>>>>>> >>>>>>>>>>> FWIW, I'm starting to look into porting ManifoldCF to the=20 >>>>>>>>>>> httpcomponent libraries from the older httpclient 3.1 world. >>>>>>>>>>> This will make it easier, I think, to incorporate newer additio= ns. >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> Karl >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, Nov 7, 2012 at 3:44 PM, Iannetti, Robert=20 >>>>>>>>>>> wrote: >>>>>>>>>>>> Karl, >>>>>>>>>>>> >>>>>>>>>>>> It looks like I am failing connecting to the /_vti_bin/lists.= asmx service but I never see the MCPermissions.asmx in any of my trace logs= . >>>>>>>>>>>> >>>>>>>>>>>> Why is that? >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> Bob >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>> From: Iannetti, Robert >>>>>>>>>>>> Sent: Wednesday, November 07, 2012 10:37 AM >>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>> Subject: RE: Cannot connect to SharePoint 2010 instance >>>>>>>>>>>> >>>>>>>>>>>> Karl, >>>>>>>>>>>> >>>>>>>>>>>> The X's you see are me trying to make the log look generic the= re were valid guids present in the real log. >>>>>>>>>>>> >>>>>>>>>>>> I will try WireShark and let you know the results. >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> Bob >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>> Sent: Wednesday, November 07, 2012 10:32 AM >>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>>>>>> >>>>>>>>>>>> This in general looks like a proper NTLM authorization sequenc= e, except for the lack of confirmation at the end. The only thing I see th= at I don't recognize is this: >>>>>>>>>>>> >>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "SPRequestGuid= : xxxxxxx[\r][\n]" >>>>>>>>>>>> >>>>>>>>>>>> If SharePoint is expecting this GUID to be returned somehow th= en that would explain it, but frankly we've got a number of SP 2010 install= ations and that hasn't been an issue anywhere else. And, I don't expect cu= rl would work if that was the case. >>>>> >>>>>>>>>>>> >>>>>>>>>>>> It's worth a shot using a tool like WireShark to see if you ca= n find any difference in headers etc. between curl and ManifoldCF. We've n= oticed in the past that the exact Host header seems to be the critical issu= e, so any differences there would be of interest. >>>>>>>>>>>> >>>>>>>>>>>> Karl >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Nov 7, 2012 at 10:08 AM, Iannetti, Robert wrote: >>>>>>>>>>>>> Karl, >>>>>>>>>>>>> >>>>>>>>>>>>> We have created the NTLM SharePoint instance as instructed. >>>>>>>>>>>>> >>>>>>>>>>>>> The Curl command is now responding when before it would not. >>>>>>>>>>>>> curl --ntlm -u domain\\username=20 >>>>>>>>>>>>> http://xxx.xxx.xxx.xxx/_vti_bin/MCPermissions.asmx -v >>>>>>>>>>>>> >>>>>>>>>>>>> But we are still getting an error when issuing the=20 >>>>>>>>>>>>> connection request from the ManifoldCF GUI Crawl user did=20 >>>>>>>>>>>>> not authenticate properly, or has insufficient permissions to= access http://XXX.XXX.XXX.XXX: >>>>>>>>>>>>> (401)Unauthorized >>>>>>>>>>>>> >>>>>>>>>>>>> From the log file >>>>>>>>>>>>> >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,126 (Thread-441) - >> "POST /_vti_b= in/lists.asmx HTTP/1.1[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,151 (Thread-441) - >> "Content-Type= : text/xml; charset=3Dutf-8[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "SOAPAction: = "http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "User-Agent: = Axis/1.4[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "Host: xxxxx.= xxxx.xxxx.xxxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "Transfer-Enc= oding: chunked[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "14f[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "= " >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "0" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,170 (Thread-441) - << "HTTP/1.1 401= Unauthorized[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "Server: Micr= osoft-IIS/7.5[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "SPRequestGui= d: xxxxxxxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "WWW-Authenti= cate: NTLM[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "X-Powered-By= : ASP.NET[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "MicrosoftSha= rePointTeamServices: 14.0.0.6123[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "X-MS-InvokeA= pp: 1; RequireReadOnly[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "Date: Wed, 0= 7 Nov 2012 14:56:10 GMT[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "Content-Leng= th: 0[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,195 (Thread-441) - >> "POST /_vti_b= in/lists.asmx HTTP/1.1[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,195 (Thread-441) - >> "Content-Type= : text/xml; charset=3Dutf-8[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "SOAPAction: = "http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "User-Agent: = Axis/1.4[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Transfer-Enc= oding: chunked[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Authorizatio= n: NTLM xxxxxxxxxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Host: xxx.xx= x.xxx.xxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "14f[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "= " >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "0" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "HTTP/1.1 401= Unauthorized[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "Server: Micr= osoft-IIS/7.5[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "SPRequestGui= d: xxxxxxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "WWW-Authenti= cate: NTLM xxxxxxx [\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "X-Powered-By= : ASP.NET[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "MicrosoftSha= rePointTeamServices: 14.0.0.6123[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "X-MS-InvokeA= pp: 1; RequireReadOnly[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "Date: Wed, 0= 7 Nov 2012 14:56:10 GMT[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "Content-Leng= th: 0[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,241 (Thread-441) - >> "POST /_vti_b= in/lists.asmx HTTP/1.1[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Content-Type= : text/xml; charset=3Dutf-8[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "SOAPAction: = "http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "User-Agent: = Axis/1.4[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Transfer-Enc= oding: chunked[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Authorizatio= n: NTLM xxxxxxxx [\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Host: xxx.xx= x.xxx.xxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "14f[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "= " >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "0" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "HTTP/1.1 401= Unauthorized[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Server: Micr= osoft-IIS/7.5[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "SPRequestGui= d: xxxxxxx[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "WWW-Authenti= cate: NTLM[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "X-Powered-By= : ASP.NET[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "MicrosoftSha= rePointTeamServices: 14.0.0.6123[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "X-MS-InvokeA= pp: 1; RequireReadOnly[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Date: Wed, 0= 7 Nov 2012 14:56:11 GMT[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Content-Leng= th: 0[\r][\n]" >>>>>>>>>>>>> DEBUG 2012-11-07 09:56:11,773 (Thread-441) - << "[\r][\n]" >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks >>>>>>>>>>>>> Bob >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 4:02 PM >>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>>>>>>> >>>>>>>>>>>>> CONNECTORS-565. >>>>>>>>>>>>> >>>>>>>>>>>>> Karl >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:59 PM, Karl Wright wrote: >>>>>>>>>>>>>> If you want, we can create a ticket to cover SharePoint 2013= work. >>>>>>>>>>>>>> If you want to attempt a sanity check, if you email me=20 >>>>>>>>>>>>>> (personally, to >>>>>>>>>>>>>> daddywri@gmail.com) the Microsoft.SharePoint.dll I can=20 >>>>>>>>>>>>>> set up a >>>>>>>>>>>>>> ManifoldCF-Sharepoint-2013 plugin. If I can build that,=20 >>>>>>>>>>>>>> then the next step would be just trying it all out and seein= g where it fails. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Karl >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:49 PM, Iannetti, Robert=20 >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> That sounds reasonable. I am having my SP Admin set up the = NTML SharePoint instance described below I will let you know how it works. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> BTW SP 2013 RTM has been released so we can cross #1 off=20 >>>>>>>>>>>>>>> the list >>>>>>>>>>>>>>> :) >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 3:47 PM >>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Bob, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> That depends very strongly on whether SharePoint 2013=20 >>>>>>>>>>>>>>> continues the Microsoft tradition of breaking web=20 >>>>>>>>>>>>>>> services that used to work. :-) >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Seriously, we need three things to develop a SharePoint 201= 3 solution: >>>>>>>>>>>>>>> (1) A stable release (a beta is not sufficient because=20 >>>>>>>>>>>>>>> Microsoft is famous for changing things in a major way=20 >>>>>>>>>>>>>>> between beta and release); >>>>>>>>>>>>>>> (2) a benevolent client with sufficient patience to try thi= ngs out that we develop in their environment, and (3) enough time so that w= e're not on the bleeding edge and that other people have run into most of t= he sticky problems first. We're volunteers here and we all have day jobs, = so we mostly can't afford to be pounding away at brick walls on our own. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> It could be the case that everything just works, in which c= ase the development is trivial. We'll have to see. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:37 PM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On another topic is there a roadmap for supporting SharePo= int 2013 ? >>>>>>>>>>>>>>>> We are in the process of migrating and were wondering when= your ManifoldCF product would be available to support it. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 3:34 PM >>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Bob, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The only products I know have a similar limitations. The = only one I know is the SharePoint google appliance connector, which when I = looked last had exactly the same restriction. It also has other limitation= s, some severe, such as limiting the number of documents you can crawl to n= o more than 5000 per library. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> We are willing to do a reasonable amount of work to=20 >>>>>>>>>>>>>>>> upgrade ManifoldCF to be able to support Kerberos. >>>>>>>>>>>>>>>> Here's a link which describes the >>>>>>>>>>>>>>>> situation: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> http://old.nabble.com/Support-for-Kerberos-SPNEGO-td145 >>>>>>>>>>>>>>>> 6 >>>>>>>>>>>>>>>> 4 >>>>>>>>>>>>>>>> 85 >>>>>>>>>>>>>>>> 7 >>>>>>>>>>>>>>>> .h >>>>>>>>>>>>>>>> t >>>>>>>>>>>>>>>> m >>>>>>>>>>>>>>>> l >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> We currently use a significantly-patched version of 3.1, w= hich supplied the NTLM implementation for 4.0 that is currently in use. >>>>>>>>>>>>>>>> Our issue is similar to the commons-httpclient team's, whi= ch is we have no good way of testing all of this, and none of us are securi= ty protocol experts. If you have (or know somebody with) such expertise, w= ho would be willing/able to donate their time, this problem could be tackle= d I think without too much pain. So at least httpclient, given the right t= ickets, would be able to connect. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The other issue with Kerberos auth is that I believe it wi= ll require a significant amount of work to allow anything using it to obtai= n the tickets from the AD domain controller. This would obviously require = UI work for all connectors that would support Kerberos. But that is someth= ing I am willing to attempt if everything else is in place. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:11 PM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> If this is not possible can you recommend any other produ= cts to crawl SharePoint content and index it in Solr? >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 3:10 PM >>>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010=20 >>>>>>>>>>>>>>>>> instance >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> No, Kerberos is not supported. This is a limitation of t= he Apache commons-httpclient library that we use for communicating with Sha= rePoint. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> It is possible to set up IIS to serve a different port wi= th different authentication that goes to the same SharePoint instance but i= s NTLM protected, not Kerberos protected. Perhaps you can do this and limi= t access to that port to only the ManifoldCF machine. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:03 PM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Our SharePoint sites use Kerberos authentication is this= supported in ManifoldCF? >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 2:50 PM >>>>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010=20 >>>>>>>>>>>>>>>>>> instance >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Yes, this can be somewhat tricky. There are a lot of po= tential configurations that could affect this. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> First, you want to verify that your IIS is using NTLM au= thentication, and that all the web services directories are "executable". = This is critical. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Second, the credentials, in the form of domain\user, may= be sensitive to whether you use a fully-qualified domain name or a shortcu= t domain name, e.g. mydomain.novartis.com or just mydomain. I suggest you = try some combinations. The other thing you may want to check is whether th= e machine you are running ManifoldCF on is known by your domain controller;= you may not be able to authenticate if it is not. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> If this doesn't help, and you want to eliminate Manifold= CF's NTLM implementation from the list of possibilities, I suggest download= ing the "curl" utility, and trying to fetch a web service listing or wsdl u= sing it (specifying NTLM of course as the authentication method). If that = also doesn't work, it's a server-side configuration problem of some kind. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> You can also refer to the server-side IIS logs for some = additional info. But I've found these are not very helpful for authenticat= ion issues. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Let me know if you are still stuck after this; there are= other diagnostics available but they start to get ugly. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Kral >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 2:35 PM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> I turned on the additional debugging and was able to re= solve the 404 issue. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Now I am getting: >>>>>>>>>>>>>>>>>>> Crawl user did not authenticate properly, or has=20 >>>>>>>>>>>>>>>>>>> insufficient permissions to access http://xxxx.xxx.xxx: >>>>>>>>>>>>>>>>>>> (401)Unauthorized >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> I can log into the SharePoint site from the browser usi= ng the same credentials. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Any Thoughts? >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 10:05 AM >>>>>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010=20 >>>>>>>>>>>>>>>>>>> instance >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Well, you can turn on httpclient wire debugging, as I b= elieve is described in the article URL I sent you before, and then you can = see precisely what URL the connector is trying to reach when it accesses th= e MCPermissions service. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> There's no magic here. If the connector gets a 404 err= or back from IIS, either its URL is wrong, or IIS has decided it's not goin= g to serve that page to the client. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 8:58 AM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>>>>> Yes, The URL and what I enter in the ManifoldCF interf= ace are a match. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 8:52 AM >>>>>>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010=20 >>>>>>>>>>>>>>>>>>>> instance >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> I've seen situations where a SharePoint site is config= ured to perform a redirection, and this is messing things up internally. D= oes the your connection server name etc. match precisely the URL you see wh= en you are in the SharePoint user interface? >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 8:47 AM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> After further review it appears the MCpermissions.asm= x was installed globally in SharePoint. I am able to access it from within = my SharePoint site as well as all other valid SharePoint sub-sites. >>>>>>>>>>>>>>>>>>>>> So this connection http:////_vti_bi= n works with any valid site in including the previously mentione= d _admin site. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> That said do you have any thoughts on why I would be = getting the 404 error? >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com] >>>>>>>>>>>>>>>>>>>>> Sent: Monday, November 05, 2012 2:45 PM >>>>>>>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010=20 >>>>>>>>>>>>>>>>>>>>> instance >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> The 404 error indicates that your MCPermissions servi= ce is not properly deployed. The "_admin" in your path is a clue that some= thing might not be right. The place you want to see the MCPermissions.asmx= is in the following location: >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> http[s]:////_vti_bin >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> ... where the is your server name, and the <= sitepath> is your site path. The best way to get this is to enter the Shar= ePoint UI (NOT the admin UI, but the SharePoint end-user UI), and log into = the root site. Then make note of the URL in your browser. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> If the MCPermissions.asmx service appears under that = URL, look at your IIS settings and make sure that the MCPermissions.asmx se= rvice can be executed. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Also, this may be of some help: >>>>>>>>>>>>>>>>>>>>> https://cwiki.apache.org/confluence/display/CONNEC >>>>>>>>>>>>>>>>>>>>> T >>>>>>>>>>>>>>>>>>>>> O >>>>>>>>>>>>>>>>>>>>> RS >>>>>>>>>>>>>>>>>>>>> / >>>>>>>>>>>>>>>>>>>>> De >>>>>>>>>>>>>>>>>>>>> b >>>>>>>>>>>>>>>>>>>>> u >>>>>>>>>>>>>>>>>>>>> ggi >>>>>>>>>>>>>>>>>>>>> n >>>>>>>>>>>>>>>>>>>>> g+ >>>>>>>>>>>>>>>>>>>>> C >>>>>>>>>>>>>>>>>>>>> o >>>>>>>>>>>>>>>>>>>>> n >>>>>>>>>>>>>>>>>>>>> n >>>>>>>>>>>>>>>>>>>>> e >>>>>>>>>>>>>>>>>>>>> ctions >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> The end user documentation is also extremely helpful = in describing how to properly set up connections. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> You can uninstall the MCPermissions.asmx service usin= g the .bat files that are included with the plugin. When you re-install, p= lease make sure that you are logged in as a user with full admin privileges= , or the service will not work properly. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> On Mon, Nov 5, 2012 at 2:33 PM, Iannetti, Robert wrote: >>>>>>>>>>>>>>>>>>>>>> Hello, >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> I have installed apache-manifoldcf-1.0.1 on my=20 >>>>>>>>>>>>>>>>>>>>>> Linux server and=20 >>>>>>>>>>>>>>>>>>>>>> apache-manifoldcf-sharepoint-2010-plugin-0.1-bin >>>>>>>>>>>>>>>>>>>>>> on my SharePoint >>>>>>>>>>>>>>>>>>>>>> 2010 server. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> On my SharePoint server I can see the Permissions=20 >>>>>>>>>>>>>>>>>>>>>> Page when I enter http://xxxxx:xxxxx/_admin/_vti_bin= /MCPermissions.asmx in my browser. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> When I try to make a "SharePoint Services 4.0 (2010)= " >>>>>>>>>>>>>>>>>>>>>> connection to my SharePoint 2010 server in the Manif= oldCF interface I get this error. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Got an unknown remote exception accessing site -=20 >>>>>>>>>>>>>>>>>>>>>> axis fault =3D Client, detail =3D The request failed= with HTTP status 404: Not Found. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> I can connect using "SharePoint Services 2.0 (2003)" >>>>>>>>>>>>>>>>>>>>>> but when I try a crawl it does not work properly and= aborts. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> The "SharePoint Services 3.0 (2007)" connection=20 >>>>>>>>>>>>>>>>>>>>>> fails the same as the above >>>>>>>>>>>>>>>>>>>>>> 2010 connection. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Can you please give some direction on how best to re= solve this issue. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Bob >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Robert P. Iannetti >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Application Architect >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Novartis Institute for BioMedical Research >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> 186 Massachusetts Avenue >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Cambridge, MA 02139 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Phone: +1 (617) 871-5414 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> robert.iannetti@novartis.com >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>