manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karl Wright <daddy...@gmail.com>
Subject Re: Cannot connect to SharePoint 2010 instance
Date Tue, 27 Nov 2012 16:36:02 GMT
Hi Bob,

This is really beginning to sound like there is a header problem of some kind.

This is what I'd like to try.
(1) Turn on wire debugging for SharePoint, as described here:
https://cwiki.apache.org/confluence/display/CONNECTORS/Debugging+Connections
(2) Using curl, try to use post and the proper credentials, using the
-vvv switch.  If you successfully connect, save that output.  Then try
to EXACTLY mimic the request that ManifoldCF does, and if that FAILS
record that output and send it all to me.

Thanks!
Karl



On Tue, Nov 27, 2012 at 11:22 AM, Iannetti, Robert
<robert.iannetti@novartis.com> wrote:
> Hi Karl,
>
> I have installed the dev version of the connector from below and am having an issue connecting
to my SharePoint 2010 site.
> It actually seems similar to what is happening in your thread with Luigi.
>
> I try to log in to the sharepoint site as a user with full control and I get this error
>
> Crawl user did not authenticate properly, or has insufficient permissions to access http://xxxx.xxxx.xxxx.xxxx:
(401)HTTP/1.1 401 Unauthorized
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Karl Wright [mailto:daddywri@gmail.com]
> Sent: Monday, November 26, 2012 6:38 PM
> To: user@manifoldcf.apache.org
> Subject: Re: Cannot connect to SharePoint 2010 instance
>
> Ok, you can download a dev build at:
>
> http://people.apache.org/~kwright/apache-manifoldcf-1.1-dev
>
> It takes me about an hour to put one of these together, so if you can possibly build
ManifoldCF yourself that would be a huge help.
>
> Karl
>
>
> On Mon, Nov 26, 2012 at 11:12 AM, Iannetti, Robert <robert.iannetti@novartis.com>
wrote:
>> That would be great please let me know when it is available
>>
>> Thanks
>> Bob
>>
>>
>> -----Original Message-----
>> From: Karl Wright [mailto:daddywri@gmail.com]
>> Sent: Monday, November 26, 2012 10:59 AM
>> To: user@manifoldcf.apache.org
>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>
>> Hi Robert,
>>
>> I can build a binary version you can download, but not until tonight.
>>
>> It may be easier to talk through getting a build environment set up on your Linux
machine.  Is this Debian or Ubuntu linux, by any chance?
>> If so, the setup is trivial and I can help you with that.
>>
>> Karl
>>
>> On Mon, Nov 26, 2012 at 10:12 AM, Iannetti, Robert <robert.iannetti@novartis.com>
wrote:
>>> Karl,
>>>
>>> Is there a binary release (pre -compiled version) of the manifold trunk mentioned
below https://svn.apache.org/repos/asf/manifoldcf/trunk that you can point me to I am new
to Linux and don't have any experience with ANT.
>>>
>>>
>>> Thanks
>>> Bob
>>>
>>>
>>> -----Original Message-----
>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>> Sent: Monday, November 26, 2012 4:32 AM
>>> To: user@manifoldcf.apache.org
>>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>>
>>> I've done further research on HttpComponents' support for Kerberos.
>>> It turns out that HttpComponents claims they can successfully use tickets from
the local machine's ticket store.  I haven't tried this here (don't have the setup for it),
but it looks like it could conceivably work with MCF trunk at this point.  Read up on it here:
>>>
>>> http://hc.apache.org/httpcomponents-client-ga/tutorial/html/authentic
>>> a
>>> tion.html
>>>
>>> Ideally, of course, we'd really want to add the ability for ManifoldCF to handle
its own ticket cache, one per connection, so that each connection looks like its own independent
client.  In order for that to happen, connectors that support Kerberos would need to be able
to kerberos authenticate.  But, for right now, this may work for people needing Kerberos.
>>>
>>> Karl
>>>
>>> On Sun, Nov 11, 2012 at 8:42 AM, Karl Wright <daddywri@gmail.com> wrote:
>>>> The port of the SharePoint connector to httpcomponents 4.2.2 is complete.
>>>>
>>>> I don't know whether it will help you or not, but if you check out
>>>> ManifoldCF trunk (from
>>>> https://svn.apache.org/repos/asf/manifoldcf/trunk) and run:
>>>>
>>>> ant make-core-deps build
>>>>
>>>> ... you will be running the latest code.  It has been tried against
>>>> a plain-vanilla SharePoint system using standard NTLM and found to work.
>>>>  If you try the new code and it works for you, that would be very
>>>> interesting to know; it looks like httpcomponents has developed some
>>>> support for SPNEGO, which may be what is missing in the current
>>>> ManifoldCF release.
>>>>
>>>> Thanks,
>>>> Karl
>>>>
>>>> On Wed, Nov 7, 2012 at 4:47 PM, Karl Wright <daddywri@gmail.com> wrote:
>>>>> MCPermissions.asmx and Lists.asmx are two different services, and
>>>>> the Lists.asmx is likely failing before the MCPermissions.asmx is
>>>>> even needed.  If, for instance, you are just trying with the UI to
>>>>> see if you get back "Connection working", this makes sense since
>>>>> the Lists service is called first and then the MCPermissions
>>>>> service is called after.
>>>>>
>>>>> FWIW, I'm starting to look into porting ManifoldCF to the
>>>>> httpcomponent libraries from the older httpclient 3.1 world.  This
>>>>> will make it easier, I think, to incorporate newer additions.
>>>>>
>>>>> Thanks,
>>>>> Karl
>>>>>
>>>>>
>>>>> On Wed, Nov 7, 2012 at 3:44 PM, Iannetti, Robert
>>>>> <robert.iannetti@novartis.com> wrote:
>>>>>> Karl,
>>>>>>
>>>>>> It looks like I am failing connecting to the  /_vti_bin/lists.asmx
service but I never see the MCPermissions.asmx in any of my trace logs.
>>>>>>
>>>>>> Why is that?
>>>>>>
>>>>>> Thanks
>>>>>> Bob
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Iannetti, Robert
>>>>>> Sent: Wednesday, November 07, 2012 10:37 AM
>>>>>> To: user@manifoldcf.apache.org
>>>>>> Subject: RE: Cannot connect to SharePoint 2010 instance
>>>>>>
>>>>>> Karl,
>>>>>>
>>>>>> The X's you see are me trying to make the log look generic there
were valid guids present in the real log.
>>>>>>
>>>>>> I will try WireShark and let you know the results.
>>>>>>
>>>>>> Thanks
>>>>>> Bob
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>> Sent: Wednesday, November 07, 2012 10:32 AM
>>>>>> To: user@manifoldcf.apache.org
>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>>>>>
>>>>>> This in general looks like a proper NTLM authorization sequence,
except for the lack of confirmation at the end.  The only thing I see that I don't recognize
is this:
>>>>>>
>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "SPRequestGuid:
xxxxxxx[\r][\n]"
>>>>>>
>>>>>> If SharePoint is expecting this GUID to be returned somehow then
that would explain it, but frankly we've got a number of SP 2010 installations and that hasn't
been an issue anywhere else.  And, I don't expect curl would work if that was the case.
>>>>>>
>>>>>> It's worth a shot using a tool like WireShark to see if you can find
any difference in headers etc. between curl and ManifoldCF.  We've noticed in the past that
the exact Host header seems to be the critical issue, so any differences there would be of
interest.
>>>>>>
>>>>>> Karl
>>>>>>
>>>>>> On Wed, Nov 7, 2012 at 10:08 AM, Iannetti, Robert <robert.iannetti@novartis.com>
wrote:
>>>>>>> Karl,
>>>>>>>
>>>>>>> We have created the NTLM SharePoint instance as instructed.
>>>>>>>
>>>>>>> The Curl command is now responding when before it would not.
>>>>>>> curl --ntlm -u domain\\username
>>>>>>> http://xxx.xxx.xxx.xxx/_vti_bin/MCPermissions.asmx -v
>>>>>>>
>>>>>>> But we are still getting an error when issuing the connection
>>>>>>> request from the ManifoldCF GUI Crawl user did not authenticate
>>>>>>> properly, or has insufficient permissions to access http://XXX.XXX.XXX.XXX:
>>>>>>> (401)Unauthorized
>>>>>>>
>>>>>>> From the log file
>>>>>>>
>>>>>>> DEBUG 2012-11-07 09:56:11,126 (Thread-441) - >> "POST /_vti_bin/lists.asmx
HTTP/1.1[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,151 (Thread-441) - >> "Content-Type:
text/xml; charset=utf-8[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "SOAPAction:
"http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "User-Agent:
Axis/1.4[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "Host:
xxxxx.xxxx.xxxx.xxxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "Transfer-Encoding:
chunked[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,152 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "14f[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "<?xml
version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><GetListCollection
xmlns="http://schemas.microsoft.com/sharepoint/soap/"/></soapenv:Body></soapenv:Envelope>"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "0"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,153 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,170 (Thread-441) - << "HTTP/1.1
401 Unauthorized[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "Server:
Microsoft-IIS/7.5[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "SPRequestGuid:
xxxxxxxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "WWW-Authenticate:
NTLM[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "X-Powered-By:
ASP.NET[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,171 (Thread-441) - << "MicrosoftSharePointTeamServices:
14.0.0.6123[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "X-MS-InvokeApp:
1; RequireReadOnly[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "Date:
Wed, 07 Nov 2012 14:56:10 GMT[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "Content-Length:
0[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,172 (Thread-441) - << "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,195 (Thread-441) - >> "POST /_vti_bin/lists.asmx
HTTP/1.1[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,195 (Thread-441) - >> "Content-Type:
text/xml; charset=utf-8[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "SOAPAction:
"http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "User-Agent:
Axis/1.4[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Transfer-Encoding:
chunked[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Authorization:
NTLM xxxxxxxxxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "Host:
xxx.xxx.xxx.xxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "14f[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "<?xml
version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><GetListCollection
xmlns="http://schemas.microsoft.com/sharepoint/soap/"/></soapenv:Body></soapenv:Envelope>"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "0"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,196 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "HTTP/1.1
401 Unauthorized[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "Server:
Microsoft-IIS/7.5[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,212 (Thread-441) - << "SPRequestGuid:
xxxxxxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "WWW-Authenticate:
NTLM xxxxxxx [\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "X-Powered-By:
ASP.NET[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "MicrosoftSharePointTeamServices:
14.0.0.6123[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "X-MS-InvokeApp:
1; RequireReadOnly[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "Date:
Wed, 07 Nov 2012 14:56:10 GMT[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "Content-Length:
0[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,213 (Thread-441) - << "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,241 (Thread-441) - >> "POST /_vti_bin/lists.asmx
HTTP/1.1[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Content-Type:
text/xml; charset=utf-8[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "SOAPAction:
"http://schemas.microsoft.com/sharepoint/soap/GetListCollection"[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "User-Agent:
Axis/1.4[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Transfer-Encoding:
chunked[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Authorization:
NTLM xxxxxxxx [\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "Host:
xxx.xxx.xxx.xxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "14f[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "<?xml
version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><GetListCollection
xmlns="http://schemas.microsoft.com/sharepoint/soap/"/></soapenv:Body></soapenv:Envelope>"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "0"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,242 (Thread-441) - >> "[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "HTTP/1.1
401 Unauthorized[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Server:
Microsoft-IIS/7.5[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "SPRequestGuid:
xxxxxxx[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "WWW-Authenticate:
NTLM[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "X-Powered-By:
ASP.NET[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "MicrosoftSharePointTeamServices:
14.0.0.6123[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "X-MS-InvokeApp:
1; RequireReadOnly[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Date:
Wed, 07 Nov 2012 14:56:11 GMT[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,772 (Thread-441) - << "Content-Length:
0[\r][\n]"
>>>>>>> DEBUG 2012-11-07 09:56:11,773 (Thread-441) - << "[\r][\n]"
>>>>>>>
>>>>>>> Thanks
>>>>>>> Bob
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>> Sent: Tuesday, November 06, 2012 4:02 PM
>>>>>>> To: user@manifoldcf.apache.org
>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>>>>>>
>>>>>>> CONNECTORS-565.
>>>>>>>
>>>>>>> Karl
>>>>>>>
>>>>>>> On Tue, Nov 6, 2012 at 3:59 PM, Karl Wright <daddywri@gmail.com>
wrote:
>>>>>>>> If you want, we can create a ticket to cover SharePoint 2013
work.
>>>>>>>> If you want to attempt a sanity check, if you email me
>>>>>>>> (personally, to
>>>>>>>> daddywri@gmail.com) the Microsoft.SharePoint.dll I can set
up a
>>>>>>>> ManifoldCF-Sharepoint-2013 plugin.  If I can build that,
then
>>>>>>>> the next step would be just trying it all out and seeing
where it fails.
>>>>>>>>
>>>>>>>> Karl
>>>>>>>>
>>>>>>>> On Tue, Nov 6, 2012 at 3:49 PM, Iannetti, Robert
>>>>>>>> <robert.iannetti@novartis.com> wrote:
>>>>>>>>> Karl,
>>>>>>>>>
>>>>>>>>> That sounds reasonable. I am having my SP Admin set up
the NTML SharePoint instance described below I will let you know how it works.
>>>>>>>>>
>>>>>>>>> BTW SP 2013 RTM has been released so we can cross #1
off the
>>>>>>>>> list
>>>>>>>>> :)
>>>>>>>>>
>>>>>>>>> Thanks
>>>>>>>>> Bob
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>> Sent: Tuesday, November 06, 2012 3:47 PM
>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>>>>>>>>
>>>>>>>>> Hi Bob,
>>>>>>>>>
>>>>>>>>> That depends very strongly on whether SharePoint 2013
continues
>>>>>>>>> the Microsoft tradition of breaking web services that
used to
>>>>>>>>> work. :-)
>>>>>>>>>
>>>>>>>>> Seriously, we need three things to develop a SharePoint
2013 solution:
>>>>>>>>> (1) A stable release (a beta is not sufficient because
>>>>>>>>> Microsoft is famous for changing things in a major way
between
>>>>>>>>> beta and release);
>>>>>>>>> (2) a benevolent client with sufficient patience to try
things out that we develop in their environment, and (3) enough time so that we're not on
the bleeding edge and that other people have run into most of the sticky problems first. 
We're volunteers here and we all have day jobs, so we mostly can't afford to be pounding away
at brick walls on our own.
>>>>>>>>>
>>>>>>>>> It could be the case that everything just works, in which
case the development is trivial.  We'll have to see.
>>>>>>>>>
>>>>>>>>> Karl
>>>>>>>>>
>>>>>>>>> On Tue, Nov 6, 2012 at 3:37 PM, Iannetti, Robert <robert.iannetti@novartis.com>
wrote:
>>>>>>>>>> Karl,
>>>>>>>>>>
>>>>>>>>>> On another topic is there a roadmap for supporting
SharePoint 2013 ?
>>>>>>>>>> We are in the process of migrating and were wondering
when your ManifoldCF product would be available to support it.
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>> Bob
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -----Original Message-----
>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>> Sent: Tuesday, November 06, 2012 3:34 PM
>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010 instance
>>>>>>>>>>
>>>>>>>>>> Hi Bob,
>>>>>>>>>>
>>>>>>>>>> The only products I know have a similar limitations.
 The only one I know is the SharePoint google appliance connector, which when I looked last
had exactly the same restriction.  It also has other limitations, some severe, such as limiting
the number of documents you can crawl to no more than 5000 per library.
>>>>>>>>>>
>>>>>>>>>> We are willing to do a reasonable amount of work
to upgrade
>>>>>>>>>> ManifoldCF to be able to support Kerberos.  Here's
a link
>>>>>>>>>> which describes the
>>>>>>>>>> situation:
>>>>>>>>>>
>>>>>>>>>> http://old.nabble.com/Support-for-Kerberos-SPNEGO-td14564857.h
>>>>>>>>>> t
>>>>>>>>>> m
>>>>>>>>>> l
>>>>>>>>>>
>>>>>>>>>> We currently use a significantly-patched version
of 3.1, which supplied the NTLM implementation for 4.0 that is currently in use.
>>>>>>>>>> Our issue is similar to the commons-httpclient team's,
which is we have no good way of testing all of this, and none of us are security protocol
experts.  If you have (or know somebody with) such expertise, who would be willing/able to
donate their time, this problem could be tackled I think without too much pain.  So at least
httpclient, given the right tickets, would be able to connect.
>>>>>>>>>>
>>>>>>>>>> The other issue with Kerberos auth is that I believe
it will require a significant amount of work to allow anything using it to obtain the tickets
from the AD domain controller.  This would obviously require UI work for all connectors that
would support Kerberos.  But that is something I am willing to attempt if everything else
is in place.
>>>>>>>>>>
>>>>>>>>>> Karl
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Tue, Nov 6, 2012 at 3:11 PM, Iannetti, Robert
<robert.iannetti@novartis.com> wrote:
>>>>>>>>>>> Karl,
>>>>>>>>>>>
>>>>>>>>>>> If this is not possible can you recommend any
other products to crawl SharePoint content and index it in Solr?
>>>>>>>>>>>
>>>>>>>>>>> Thanks
>>>>>>>>>>> Bob
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>>> Sent: Tuesday, November 06, 2012 3:10 PM
>>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint 2010
instance
>>>>>>>>>>>
>>>>>>>>>>> No, Kerberos is not supported.  This is a limitation
of the Apache commons-httpclient library that we use for communicating with SharePoint.
>>>>>>>>>>>
>>>>>>>>>>> It is possible to set up IIS to serve a different
port with different authentication that goes to the same SharePoint instance but is NTLM protected,
not Kerberos protected.  Perhaps you can do this and limit access to that port to only the
ManifoldCF machine.
>>>>>>>>>>>
>>>>>>>>>>> Karl
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Nov 6, 2012 at 3:03 PM, Iannetti, Robert
<robert.iannetti@novartis.com> wrote:
>>>>>>>>>>>> Karl,
>>>>>>>>>>>>
>>>>>>>>>>>> Our SharePoint sites use Kerberos authentication
is this supported in ManifoldCF?
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks
>>>>>>>>>>>> Bob
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 2:50 PM
>>>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint
2010 instance
>>>>>>>>>>>>
>>>>>>>>>>>> Yes, this can be somewhat tricky.  There
are a lot of potential configurations that could affect this.
>>>>>>>>>>>>
>>>>>>>>>>>> First, you want to verify that your IIS is
using NTLM authentication, and that all the web services directories are "executable".  This
is critical.
>>>>>>>>>>>>
>>>>>>>>>>>> Second, the credentials, in the form of domain\user,
may be sensitive to whether you use a fully-qualified domain name or a shortcut domain name,
e.g. mydomain.novartis.com or just mydomain.  I suggest you try some combinations.  The other
thing you may want to check is whether the machine you are running ManifoldCF on is known
by your domain controller; you may not be able to authenticate if it is not.
>>>>>>>>>>>>
>>>>>>>>>>>> If this doesn't help, and you want to eliminate
ManifoldCF's NTLM implementation from the list of possibilities, I suggest downloading the
"curl" utility, and trying to fetch a web service listing or wsdl using it (specifying NTLM
of course as the authentication method).  If that also doesn't work, it's a server-side configuration
problem of some kind.
>>>>>>>>>>>>
>>>>>>>>>>>> You can also refer to the server-side IIS
logs for some additional info.  But I've found these are not very helpful for authentication
issues.
>>>>>>>>>>>>
>>>>>>>>>>>> Let me know if you are still stuck after
this; there are other diagnostics available but they start to get ugly.
>>>>>>>>>>>>
>>>>>>>>>>>> Kral
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Nov 6, 2012 at 2:35 PM, Iannetti,
Robert <robert.iannetti@novartis.com> wrote:
>>>>>>>>>>>>> Karl,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I turned on the additional debugging
and was able to resolve the 404 issue.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Now I am getting:
>>>>>>>>>>>>> Crawl user did not authenticate properly,
or has
>>>>>>>>>>>>> insufficient permissions to access http://xxxx.xxx.xxx:
>>>>>>>>>>>>> (401)Unauthorized
>>>>>>>>>>>>>
>>>>>>>>>>>>> I can log into the SharePoint site from
the browser using the same credentials.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Any Thoughts?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>> Bob
>>>>>>>>>>>>>
>>>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012 10:05
AM
>>>>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint
2010 instance
>>>>>>>>>>>>>
>>>>>>>>>>>>> Well, you can turn on httpclient wire
debugging, as I believe is described in the article URL I sent you before, and then you can
see precisely what URL the connector is trying to reach when it accesses the MCPermissions
service.
>>>>>>>>>>>>>
>>>>>>>>>>>>> There's no magic here.  If the connector
gets a 404 error back from IIS, either its URL is wrong, or IIS has decided it's not going
to serve that page to the client.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Karl
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 8:58 AM, Iannetti,
Robert <robert.iannetti@novartis.com> wrote:
>>>>>>>>>>>>>> Yes, The URL and what I enter in
the ManifoldCF interface are a match.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>>>>>> Sent: Tuesday, November 06, 2012
8:52 AM
>>>>>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>>>>>> Subject: Re: Cannot connect to SharePoint
2010 instance
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I've seen situations where a SharePoint
site is configured to perform a redirection, and this is messing things up internally.  Does
the your connection server name etc. match precisely the URL you see when you are in the SharePoint
user interface?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Karl
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Tue, Nov 6, 2012 at 8:47 AM, Iannetti,
Robert <robert.iannetti@novartis.com> wrote:
>>>>>>>>>>>>>>> Karl,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> After further review it appears
the MCpermissions.asmx was installed globally in SharePoint. I am able to access it from within
my SharePoint site as well as all other valid SharePoint sub-sites.
>>>>>>>>>>>>>>> So this connection http://<server>/<sitepath>/_vti_bin
works with any valid site in <sitepath> including the previously mentioned _admin site.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> That said do you have any thoughts
on why I would be getting the 404 error?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>> Bob
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>>>>>> From: Karl Wright [mailto:daddywri@gmail.com]
>>>>>>>>>>>>>>> Sent: Monday, November 05, 2012
2:45 PM
>>>>>>>>>>>>>>> To: user@manifoldcf.apache.org
>>>>>>>>>>>>>>> Subject: Re: Cannot connect to
SharePoint 2010 instance
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> The 404 error indicates that
your MCPermissions service is not properly deployed.  The "_admin" in your path is a clue
that something might not be right.  The place you want to see the MCPermissions.asmx is in
the following location:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> http[s]://<server>/<sitepath>/_vti_bin
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> ... where the <server>
is your server name, and the <sitepath> is your site path.  The best way to get this
is to enter the SharePoint UI (NOT the admin UI, but the SharePoint end-user UI), and log
into the root site.  Then make note of the URL in your browser.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> If the MCPermissions.asmx service
appears under that URL, look at your IIS settings and make sure that the MCPermissions.asmx
service can be executed.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Also, this may be of some help:
>>>>>>>>>>>>>>> https://cwiki.apache.org/confluence/display/CONNECTORS/De
>>>>>>>>>>>>>>> b
>>>>>>>>>>>>>>> u
>>>>>>>>>>>>>>> ggi
>>>>>>>>>>>>>>> n
>>>>>>>>>>>>>>> g+
>>>>>>>>>>>>>>> C
>>>>>>>>>>>>>>> o
>>>>>>>>>>>>>>> n
>>>>>>>>>>>>>>> n
>>>>>>>>>>>>>>> e
>>>>>>>>>>>>>>> ctions
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> The end user documentation is
also extremely helpful in describing how to properly set up connections.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> You can uninstall the MCPermissions.asmx
service using the .bat files that are included with the plugin.  When you re-install, please
make sure that you are logged in as a user with full admin privileges, or the service will
not work properly.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>> Karl
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Mon, Nov 5, 2012 at 2:33 PM,
Iannetti, Robert <robert.iannetti@novartis.com> wrote:
>>>>>>>>>>>>>>>> Hello,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I have installed apache-manifoldcf-1.0.1
on my Linux
>>>>>>>>>>>>>>>> server and
>>>>>>>>>>>>>>>> apache-manifoldcf-sharepoint-2010-plugin-0.1-bin
on my
>>>>>>>>>>>>>>>> SharePoint
>>>>>>>>>>>>>>>> 2010 server.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On my SharePoint server I
can see the Permissions Page
>>>>>>>>>>>>>>>> when I enter http://xxxxx:xxxxx/_admin/_vti_bin/MCPermissions.asmx
in my browser.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> When I try to make a "SharePoint
Services 4.0 (2010)"
>>>>>>>>>>>>>>>> connection to my SharePoint
2010 server in the ManifoldCF interface I get this error.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Got an unknown remote exception
accessing site - axis
>>>>>>>>>>>>>>>> fault = Client, detail =
The request failed with HTTP status 404: Not Found.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I can connect using "SharePoint
Services 2.0 (2003)" but
>>>>>>>>>>>>>>>> when I try a crawl it does
not work properly and aborts.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> The  "SharePoint Services
3.0 (2007)" connection fails
>>>>>>>>>>>>>>>> the same as the above
>>>>>>>>>>>>>>>> 2010 connection.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Can you please give some
direction on how best to resolve this issue.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Bob
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Robert P. Iannetti
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Application Architect
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Novartis Institute for BioMedical
Research
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> 186 Massachusetts Avenue
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Cambridge, MA 02139
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Phone: +1 (617) 871-5414
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> robert.iannetti@novartis.com
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>

Mime
View raw message