Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A419F1067A for ; Fri, 22 Nov 2013 19:27:52 +0000 (UTC) Received: (qmail 10504 invoked by uid 500); 22 Nov 2013 19:27:52 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 10410 invoked by uid 500); 22 Nov 2013 19:27:52 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 10399 invoked by uid 99); 22 Nov 2013 19:27:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Nov 2013 19:27:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of daddywri@gmail.com designates 209.85.216.179 as permitted sender) Received: from [209.85.216.179] (HELO mail-qc0-f179.google.com) (209.85.216.179) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Nov 2013 19:27:44 +0000 Received: by mail-qc0-f179.google.com with SMTP id x13so1084723qcv.10 for ; Fri, 22 Nov 2013 11:27:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=qoV9CcXMGTF8uvMNeb5dNYJBv5DSsF6f7oKxL2zf9Aw=; b=xJJEL9S6KMbSGclvnPPayn2cIl8Oj6QfOYQbt83B/xIUQQksk8RVHclB2hBdTmU1VG fkBQoaQmElz/6gu9oD8WiWmth4IDse70aXQ3OEN8bo2zWNdq6PQq+tm7neLuk7wsdxh9 0Ht1gicn+YOPSRozCZzl8Vsx/zWP0trpLc4hPhz+ZGbPfbL2UkFbvz6N3usN++/1oGMe JhMutkQqiKtpHGtKHlr9J0P5PPwzP9noCPLbS3LU5AUHpafeA2SZc0B5zvIptbxWbOs0 kz9ziWQqSmoNgXWvVgcsCrL2bt/sHq+DYItpnWEqS4WLjLnt98obqDnDktah03lBioEC QtYw== MIME-Version: 1.0 X-Received: by 10.49.35.112 with SMTP id g16mr24569020qej.13.1385148443595; Fri, 22 Nov 2013 11:27:23 -0800 (PST) Received: by 10.96.177.35 with HTTP; Fri, 22 Nov 2013 11:27:23 -0800 (PST) In-Reply-To: References: Date: Fri, 22 Nov 2013 14:27:23 -0500 Message-ID: Subject: Re: SharePoint List item URLs From: Karl Wright To: "user@manifoldcf.apache.org" Content-Type: multipart/alternative; boundary=047d7b676f7cf1531e04ebc9004e X-Virus-Checked: Checked by ClamAV on apache.org --047d7b676f7cf1531e04ebc9004e Content-Type: text/plain; charset=ISO-8859-1 Sorry - I should have been clear. First, make sure you are back to some pre-patch state: cd trunk svn revert connectors/sharepoint/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/sharepoint/SharePointRepository.java svn revert connectors/sharepoint/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/sharepoint/SPSProxyHelper.java Then, apply the FIRST patch: patch -p0 wrote: > Struggling with this...still not working for me. Maybe I'm applying the > patch incorrectly? > > I'm stuck with svn 1.6, so I can't use "svn patch", and have to use the > patch command manually. > > That being said, which of the URLs on this page should I download and > apply? > > https://issues.apache.org/jira/browse/CONNECTORS-813 > > Thanks, > > Mark > > > On Fri, Nov 22, 2013 at 9:34 AM, Karl Wright wrote: > >> Ok, patch for the ticket has been updated. >> >> Karl >> >> >> On Fri, Nov 22, 2013 at 12:31 PM, Karl Wright wrote: >> >>> Hi Mark, >>> >>> I am not surprised you are seeing the changed URLs yet, because you are >>> missing the connector code changes. I'll attach a patch to the >>> CONNECTORS-813 ticket momentarily that should do that though. >>> >>> Thanks, >>> Karl >>> >>> >>> >>> On Fri, Nov 22, 2013 at 12:28 PM, Mark Libucha wrote: >>> >>>> Hi Karl, >>>> >>>> So I'm still not seeing a change in the URLs that are coming back for >>>> SharePoint list items after reinstalling the updated plugin. >>>> >>>> Is there a way for me to check that the new plugin is correctly in >>>> place without actually logging into the SharePoint host? >>>> >>>> Thanks, >>>> >>>> Mark >>>> >>>> >>>> On Thu, Nov 21, 2013 at 12:42 PM, Mark Libucha wrote: >>>> >>>>> Hi Karl, will retry the plugin (and check the logs if it fails), but >>>>> need to wait to get it installed on the server -- out of my personal >>>>> control. >>>>> >>>>> But I'll definitely get to it and report back. >>>>> >>>>> Mark >>>>> >>>>> >>>>> On Thu, Nov 21, 2013 at 12:20 AM, Karl Wright wrote: >>>>> >>>>>> Thanks for clarifying. >>>>>> >>>>>> Like I said, the only solution I can find to produce the right URL >>>>>> involves plugin changes. I updated the plugin on the >>>>>> people.apache.org site enough times in quick succession that I think >>>>>> it may well be the case that you did not try the right one, so I hope you >>>>>> will be able to confirm that tomorrow. I've already committed what I think >>>>>> is the correct code to branches/CONNECTORS-813 but I won't supply that as a >>>>>> patch until we have a working plugin. >>>>>> >>>>>> If you try the plugin again, and it still fails, have a look at the >>>>>> SharePoint event logs; there may be an exception from the plugin in it that >>>>>> would be of help. The exceptions are all logged, but they are very hard to >>>>>> find. >>>>>> >>>>>> Thanks, >>>>>> Karl >>>>>> >>>>>> >>>>>> >>>>>> On Wed, Nov 20, 2013 at 11:22 PM, Mark Libucha wrote: >>>>>> >>>>>>> Yeah, I noticed that, too. But unfortunately the URLs sent to the >>>>>>> output connectors are no different. >>>>>>> >>>>>>> >>>>>>> On Wed, Nov 20, 2013 at 1:44 PM, Karl Wright wrote: >>>>>>> >>>>>>>> Hi Mark, >>>>>>>> >>>>>>>> I just noticed that the log output for the list item URL was >>>>>>>> incorrect in the CONNECTORS-813 patch; it was outputting the old url value >>>>>>>> into the log, even though the NEW url was being sent to the output >>>>>>>> connector. Can you confirm that you did in fact not just look at the >>>>>>>> ManifoldCF log to determine whether or not the patch worked? >>>>>>>> >>>>>>>> Karl >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Nov 20, 2013 at 4:13 PM, Karl Wright wrote: >>>>>>>> >>>>>>>>> I was trying to read the value as metadata, but clearly, then, it >>>>>>>>> is not available, and we will need to construct it ourselves, probably >>>>>>>>> according to this formula: >>>>>>>>> >>>>>>>>> // Display form full url >>>>>>>>> string.Format("{0}{1}?ID={2}", item.Web.Url, item.ParentList.Forms[PAGETYPE.PAGE_DISPLAYFORM].ServerRelativeUrl, item.ID) >>>>>>>>> >>>>>>>>> The problem is that when I included this in the plugin code, the plugin failed to work properly. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> No doubt it threw an exception of some kind, but we have no idea what that was. >>>>>>>>> >>>>>>>>> Constructing it in Java is fine except I'm missing whatever the item.ParentList.Forms[] array would have >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> contained. Can you confirm that this is the plugin you tried: >>>>>>>>> >>>>>>>>> 11832 Nov 20 17:35 MetaCarta.SharePoint.MCPermissionsService.wsp >>>>>>>>> >>>>>>>>> If the size differed it is possible you were using the wrong one - let's just rule that out first. >>>>>>>>> >>>>>>>>> Karl >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Nov 20, 2013 at 3:09 PM, Mark Libucha wrote: >>>>>>>>> >>>>>>>>>> Still getting list item URIs that look like this: >>>>>>>>>> http://myhost/test3/Lists/Greg/1_.000 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Nov 20, 2013 at 10:43 AM, Mark Libucha < >>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Excellent! I was writing up a response to tell you the 2nd >>>>>>>>>>> plugin change also did not work. I'll revert and apply the patch and report >>>>>>>>>>> back. >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> >>>>>>>>>>> Mark >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, Nov 20, 2013 at 10:41 AM, Karl Wright < >>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Mark, >>>>>>>>>>>> >>>>>>>>>>>> I found another way to do it - I think - that doesn't involve >>>>>>>>>>>> changes to the plugin. >>>>>>>>>>>> >>>>>>>>>>>> I've attached a patch to the the ticket accordingly. >>>>>>>>>>>> (CONNECTORS-813). >>>>>>>>>>>> >>>>>>>>>>>> So you should be able to revert back to the distributed plugin >>>>>>>>>>>> and that will make things tons easier. >>>>>>>>>>>> >>>>>>>>>>>> Karl >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Nov 20, 2013 at 12:19 PM, Karl Wright < >>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Ok, I've uploaded another try - this time using a different >>>>>>>>>>>>> suggestion from the same page. Can you verify that it does not fail for >>>>>>>>>>>>> both documents in libraries and for list items? >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks, >>>>>>>>>>>>> Karl >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Wed, Nov 20, 2013 at 12:06 PM, Karl Wright < >>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Well, so much for StackOverflow suggestions. It seems to be >>>>>>>>>>>>>> relying on an undocumented feature anyhow. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Let me try one other thing - will get right back to you. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Karl >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Wed, Nov 20, 2013 at 12:02 PM, Mark Libucha < >>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Karl, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> It did not work. In fact, the SharePoint crawler never sent >>>>>>>>>>>>>>> anything to my output connector, except for the Job Completed callback. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Log excerpt: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,683 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: Getting version of '/test3/Links///' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: Checking whether to include list '/test3/Links' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: List '/test3/Links' exactly matched rule path '/*' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: Including list '/test3/Links' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: Processing: '/test3/Links///' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: Document identifier is a list: '/test3/Links' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - >>>>>>>>>>>>>>> SharePoint: The page at http://myhost/test3 did not exist; >>>>>>>>>>>>>>> assuming library deleted >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - >>>>>>>>>>>>>>> SharePoint: No list found for list '/test3/Calendar' - deleting >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,958 (Worker thread '34') - >>>>>>>>>>>>>>> SharePoint: In getFieldList; site='/test3', >>>>>>>>>>>>>>> listName='{A6631841-0251-46C1-86F0-B1B049B2F659}' >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - >>>>>>>>>>>>>>> SharePoint: The page at http://myhost/test3 did not exist; >>>>>>>>>>>>>>> assuming library deleted >>>>>>>>>>>>>>> DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - >>>>>>>>>>>>>>> SharePoint: No list found for library '/test3/SitePages' - deleting >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 2:13 PM, Karl Wright < >>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> So I've created a new version of the MCPermissions.asmx >>>>>>>>>>>>>>>> plugin for SharePoint 2010. You can download the .wsp for it from: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> http://people.apache.org/~kwright/MetaCarta.SharePoint.MCPermissionsService.wsp >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Install it by replacing the file of the same name in the >>>>>>>>>>>>>>>> plugin installation package. Or, if you prefer, I can build the complete >>>>>>>>>>>>>>>> package - please let me know. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The point of doing this now is to make sure that this >>>>>>>>>>>>>>>> plugin works for both list items and for files, with getting exceptions or >>>>>>>>>>>>>>>> whatnot. If it fails, then we are back to the drawing board, but if it >>>>>>>>>>>>>>>> seems to work OK then I will make appropriate modifications to the >>>>>>>>>>>>>>>> SharePoint connector to correspond to it. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> In order to know whether it is working, you will need to >>>>>>>>>>>>>>>> crawl both lists and libraries, and make sure that MCF discovers the list >>>>>>>>>>>>>>>> items and files within without errors. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Please let me know if you are able to do this. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:59 PM, Karl Wright < >>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> This link seems helpful: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> http://social.msdn.microsoft.com/Forums/sharepoint/en-US/2be88c8b-812b-4574-8c2c-965cedd2f199/how-to-get-splistitem-item-server-relative-url-or-absolute-url-in-sharepoint-list?forum=sharepointdevelopmentlegacy >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> I'll give it a try. >>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:51 PM, Karl Wright < >>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> First - have you installed the ManifoldCF SharePoint 2010 >>>>>>>>>>>>>>>>>> plugin? Have you selected SharePoint 2010 in your connection definition? >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> If you have, then ManifoldCF is communicating with the >>>>>>>>>>>>>>>>>> MCPermissions.asmx plugin to perform this activity. Please see this page: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.splistitem_members%28v=office.14%29.aspx >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> The field the plugin is returning is the "Url" field of >>>>>>>>>>>>>>>>>> the item. There is no "ListItemURL" member that I can see. So, are >>>>>>>>>>>>>>>>>> inspecting the results from the Lists web service? I wonder how the Lists >>>>>>>>>>>>>>>>>> webservice translates the FileRef URL into a ListItemURL, in C#? >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:35 PM, Karl Wright < >>>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Ok; to fix this problem then we will need a new release >>>>>>>>>>>>>>>>>>> of the SharePoint 2010 plugin. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:32 PM, Mark Libucha < >>>>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Ah, I think it's this: LISTITEMURL >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> That works for me. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 1:25 PM, Karl Wright < >>>>>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Hmm, okay. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> The URL we use is what comes back in the "FileRef" >>>>>>>>>>>>>>>>>>>>> field of the Lists.asmx getListItems response. It is possible that there's >>>>>>>>>>>>>>>>>>>>> a better choice for list items. I'll create a ticket and look into what >>>>>>>>>>>>>>>>>>>>> the options are. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 3:46 PM, Mark Libucha < >>>>>>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> That doesn't work either. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> In the SharePoint UI, the Task List is presented as a >>>>>>>>>>>>>>>>>>>>>> table, with each of the individual items in the list presented as a URL. >>>>>>>>>>>>>>>>>>>>>> When you click on an item, it raises a pop up... >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> The links on the page look like this... >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> http://myhost/_layouts/listform.aspx?PageType=4&ListId={1BD4F07D-A210-45A7-9C91-D296B1AB73EE}&ID=2&ContentTypeID=0x010800DE3D7FC80C8CFC4BA00DFEC40120E795 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Nothing like the URIs they are handing back to MCF... >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Thanks for the info. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 12:25 PM, Karl Wright < >>>>>>>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> SharePoint indeed uses URLs of this form. The one >>>>>>>>>>>>>>>>>>>>>>> you provided describes a List in the root site called "Tasks", and >>>>>>>>>>>>>>>>>>>>>>> references the second item in that list. I'm surprised SharePoint doesn't >>>>>>>>>>>>>>>>>>>>>>> give something better than a 404 when you go to it, though. >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> Can you go to http://myhost/Lists/Tasks#2_.000without it giving a 404? because that's something the connector could >>>>>>>>>>>>>>>>>>>>>>> certainly do. >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 3:21 PM, Mark Libucha < >>>>>>>>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> When I crawl a list, I get back URLs that look like >>>>>>>>>>>>>>>>>>>>>>>> this: >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> http://myhost/Lists/Tasks/2_.000 >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> This URL returns a 404, but I think that's a >>>>>>>>>>>>>>>>>>>>>>>> SharePoint issue. I don't believe there's a way to point directly to an >>>>>>>>>>>>>>>>>>>>>>>> item in List (is there?). >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> My question then is, is SharePoint returning this >>>>>>>>>>>>>>>>>>>>>>>> URL in this form, or is MCF creating the URL based on the name of the list? >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> > --047d7b676f7cf1531e04ebc9004e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Sorry - I should have been clear.

F= irst, make sure you are back to some pre-patch state:

cd = trunk
svn revert connectors/sharepoint/connector/src/main/jav= a/org/apache/manifoldcf/crawler/connectors/sharepoint/SharePointRepository.= java
svn revert connectors/sharepoint/connector/src/main/java/org/apa= che/manifoldcf/crawler/connectors/sharepoint/SPSProxyHelper.java

Then, apply the FIRST patch:

patch -p0 <CONNEC= TORS-813.patch

Then, apply the SECOND patch:

patch -p0 <CONNECTOR= S-813-2.patch

Then you should be good to go.

I am assuming that with the new plugin you were able to crawl and eve= rything without errors, but the URL just remained incorrect?=A0 If so, thes= e patches SHOULD mean you see the right URL.=A0 If they don't, please r= emember I haven't tried them out anywhere, so I could have coded someth= ing incorrectly.=A0 Let me know and we can debug.

Thanks,
Karl



<= div class=3D"gmail_quote">On Fri, Nov 22, 2013 at 2:22 PM, Mark Libucha <= mlibucha@gmail.com> wrote:
Struggling with this..= .still not working for me. Maybe I'm applying the patch incorrectly?
I'm stuck with svn 1.6, so I can't use "svn patch", and h= ave to use the patch command manually.

That being said, which of the URLs on this page should I download and a= pply?

https://issues.apache.org/jira/browse/CONNECTORS-813

Thanks,

Mark


On Fri, Nov 22, 201= 3 at 9:34 AM, Karl Wright <daddywri@gmail.com> wrote:
Ok, patch for the tick= et has been updated.

 Karl


On Fri, Nov 22, 2013= at 12:31 PM, Karl Wright <daddywri@gmail.com> wrote:
Hi Mark,

<= /div>I am not surprised you are seeing the changed URLs yet, because you ar= e missing the connector code changes.=A0 I'll attach a patch to the CON= NECTORS-813 ticket momentarily that should do that though.

Thanks,
Karl



On Fri, Nov 22, 2013 at 12:28 PM, Mark = Libucha <mlibucha@gmail.com> wrote:
Hi Karl,

S= o I'm still not seeing a change in the URLs that are coming back for Sh= arePoint list items after reinstalling the updated plugin.

Is there a way for me to check that the new plugin is correctly i= n place without actually logging into the SharePoint host?

Thanks,

Mark


On Thu, Nov 21, 2013 at 12:42 PM, Mark = Libucha <mlibucha@gmail.com> wrote:
Hi Karl, will retry th= e plugin (and check the logs if it fails), but need to wait to get it insta= lled on the server -- out of my personal control.

But I'll definitely get to it and report back.

Mark


On Thu, Nov 21, 2013 at 12:20 AM, Karl Wright <daddywri@gmail.com= > wrote:
Thanks for clarif= ying.

Like I said, the only solution I can find to produce the= right URL involves plugin changes.=A0 I updated the plugin on the people.apache.org site = enough times in quick succession that I think it may well be the case that = you did not try the right one, so I hope you will be able to confirm that t= omorrow.=A0 I've already committed what I think is the correct code to = branches/CONNECTORS-813 but I won't supply that as a patch until we hav= e a working plugin.

If you try the plugin again, and it still fails, have a look= at the SharePoint event logs; there may be an exception from the plugin in= it that would be of help.=A0 The exceptions are all logged, but they are v= ery hard to find.

Thanks,
Karl



On Wed, Nov 20, 2013 at 11:22 PM, Mark = Libucha <mlibucha@gmail.com> wrote:
Yeah, I noticed that, too. = But unfortunately the URLs sent to the output connectors are no different.<= br>


On Wed, Nov 20, 2013 at 1:44 PM, Karl Wright <daddywri@gmail.com&g= t; wrote:
Hi Mark,

I just noti= ced that the log output for the list item URL was incorrect in the CONNECTO= RS-813 patch; it was outputting the old url value into the log, even though= the NEW url was being sent to the output connector.=A0 Can you confirm tha= t you did in fact not just look at the ManifoldCF log to determine whether = or not the patch worked?

Karl


On Wed, Nov 20, 2013 at 4:13 PM, Karl Wrig= ht <daddywri@gmail.com> wrote:
I was trying to read the va= lue as metadata, but clearly, then, it is not available, and we will need t= o construct it ourselves, probably according to this formula:
// Display form full url
string.Format("{0}{1}?ID=3D{2}", item.Web.Url, item.ParentList.Fo=
rms[PAGETYPE.PAGE_DISPLAYFORM].ServerRelativeUrl, item.ID)

The problem i= s that when I included this in the plugin code, the plugin failed to work p= roperly.
No doubt it threw an exception of some kind, but we have no idea what th=
at was.
Constructing it in Java is fine except I'm missing whatev=
er the item.ParentList.Forms[] array would have












contained.  Can you confirm that this is the plugin you tried:

11=
832 Nov 20 17:35 MetaCarta.SharePoint.MCPermissionsService.wsp

If the siz=
e differed it is possible you were using the wrong one - let's just rul=
e that out first.

Karl



On Wed, Nov 20, 2013 a= t 3:09 PM, Mark Libucha <mlibucha@gmail.com> wrote:
Still ge= tting list item URIs that look like this: http://myhost/test3/Lists/Greg/1_.000


On Wed, Nov 20, 2013 at 10:43 AM, Mark Libucha <mlibucha@gmail.com>= ; wrote:
Excellent! I was writing up a response to tell you the 2nd= plugin change also did not work. I'll revert and apply the patch and r= eport back.

Thanks,

Mark


On Wed, Nov 20, 2013 at 10:41 AM, Karl Wrigh= t <daddywri@gmail.com> wrote:
Hi Mark,

I found another way to do i= t - I think - that doesn't involve changes to the plugin.

= I've attached a patch to the the ticket accordingly.=A0 (CONNECTORS-813= ).

So you should be able to revert back to the distributed plugin an= d that will make things tons easier.

<= /font>
Karl



On Wed, Nov 20, 2013 at 12:19 PM, Karl Wright <daddy= wri@gmail.com> wrote:
Ok, I= 9;ve uploaded another try - this time using a different suggestion from the= same page.=A0 Can you verify that it does not fail for both documents in l= ibraries and for list items?

Thanks,
Karl



On Wed, Nov 20, 2013 at 12:06 PM, Karl Wright <= daddywri@gmail.com<= /a>> wrote:
Well, so= much for StackOverflow suggestions.=A0 It seems to be relying on an undocu= mented feature anyhow.

Let me try one other thing - will get right back to you.

Karl




On Wed, Nov 20, 2013 at 12:02 PM, Mark L= ibucha <mlibucha@gmail.com> wrote:
Karl,

It did not work. In fact, the= SharePoint crawler never sent anything to my output connector, except for = the Job Completed callback.

Log excerpt:

DEBUG 201= 3-11-20 11:56:26,683 (Worker thread '34') - SharePoint: Getting ver= sion of '/test3/Links///'
DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - SharePoint: Ch= ecking whether to include list '/test3/Links'
DEBUG 2013-11-20 1= 1:56:26,684 (Worker thread '34') - SharePoint: List '/test3/Lin= ks' exactly matched rule path '/*'
DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - SharePoint: In= cluding list '/test3/Links'
DEBUG 2013-11-20 11:56:26,685 (Worke= r thread '34') - SharePoint: Processing: '/test3/Links///'<= br> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - SharePoint: Do= cument identifier is a list: '/test3/Links'
DEBUG 2013-11-20 11:= 56:26,768 (Worker thread '26') - SharePoint: The page at http://myhost/test3 did not exi= st; assuming library deleted
DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - SharePoint: No= list found for list '/test3/Calendar' - deleting
DEBUG 2013-11-= 20 11:56:26,958 (Worker thread '34') - SharePoint: In getFieldList;= site=3D'/test3', listName=3D'{A6631841-0251-46C1-86F0-B1B049B2= F659}'
DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - SharePoint: Th= e page at http://myhost/t= est3 did not exist; assuming library deleted
DEBUG 2013-11-20 11:56:= 27,360 (Worker thread '35') - SharePoint: No list found for library= '/test3/SitePages' - deleting

Mark


On Tue, Nov 19, 2013 at 2:13 PM, Karl Wright <daddywri@g= mail.com> wrote:
Hi Mark,

So I've created a new version of the = MCPermissions.asmx plugin for SharePoint 2010.=A0 You can download the .wsp= for it from:

http://people.apache.org/~kwri= ght/MetaCarta.SharePoint.MCPermissionsService.wsp

Install it by replacing the file of the same name in the plugin install= ation package.=A0 Or, if you prefer, I can build the complete package - ple= ase let me know.

The point of doing this now is to make sure t= hat this plugin works for both list items and for files, with getting excep= tions or whatnot.=A0 If it fails, then we are back to the drawing board, bu= t if it seems to work OK then I will make appropriate modifications to the = SharePoint connector to correspond to it.

In order to know whether it is working, you will need to crawl both lis= ts and libraries, and make sure that MCF discovers the list items and files= within without errors.

Please let me know if you are able to do thi= s.

Thanks,
Karl



<= div>


On Tue, N= ov 19, 2013 at 4:59 PM, Karl Wright <daddywri@gmail.com> wr= ote:


On Tue, Nov 19, 2013 at 4:51 PM, Karl Wright <daddywri@g= mail.com> wrote:
Hi Mark,

First - have you installed the ManifoldCF Shar= ePoint 2010 plugin?=A0 Have you selected SharePoint 2010 in your connection= definition?

If you have, then ManifoldCF is communicating with the MCPermissions.as= mx plugin to perform this activity.=A0 Please see this page:

http://msdn.= microsoft.com/en-us/library/microsoft.sharepoint.splistitem_members%28v=3Do= ffice.14%29.aspx

The field the plugin is returning is the "Url" field of= the item.=A0 There is no "ListItemURL" member that I can see.=A0= So, are inspecting the results from the Lists web service?=A0 I wonder how= the Lists webservice translates the FileRef URL into a ListItemURL, in C#?=

Karl



On Tue, Nov 19, 2013 at 4:35 PM, Karl Wright <= daddywri@gmail.com<= /a>> wrote:
Ok;= to fix this problem then we will need a new release of the SharePoint 2010= plugin.

Karl



On Tue, Nov 19, 2013 at 4:32 PM, Mark Libucha <= ;mlibucha@gmail.com= > wrote:
Ah,= I think it's this: LISTITEMURL

That works for me.

Mark

On Tue, Nov 19, 2013 at 1:25 PM, Karl Wright <= span dir=3D"ltr"><daddywri@gmail.com> wrote:
Hmm= , okay.

The URL we use is what comes back in the "FileRef= " field of the Lists.asmx getListItems response.=A0 It is possible tha= t there's a better choice for list items.=A0 I'll create a ticket a= nd look into what the options are.

Karl


On Tue, Nov 19, 2013 at 3:46 PM, Mark Libu= cha <mlibucha@gmail.com> wrote:
That doesn't work either.

In the SharePoint UI, the Task= List is presented as a table, with each of the individual items in the lis= t presented as a URL. When you click on an item, it raises a pop up...

The links on the page look like this...

http://myhost/_layouts/listform.aspx?Page= Type=3D4&ListId=3D{1BD4F07D-A210-45A7-9C91-D296B1AB73EE}&ID=3D2&= ;ContentTypeID=3D0x010800DE3D7FC80C8CFC4BA00DFEC40120E795

Nothing like the URIs they are handing back to MCF...

Than= ks for the info.

Mark



On Tue, Nov 19, 2013 at 12:25 PM, Karl W= right <daddywri@gmail.com> wrote:
Hi Mark,

SharePoint indeed uses URLs of this form.= =A0 The one you provided describes a List in the root site called "Tas= ks", and references the second item in that list.=A0 I'm surprised= SharePoint doesn't give something better than a 404 when you go to it,= though.

Can you go to http://myhost/Lists/Tasks#2_.000 without it giving a 404?= =A0 because that's something the connector could certainly do.

Karl



On Tue, Nov 19, 2013 at 3:21 PM, Mark Li= bucha <mlibucha@gmail.com> wrote:
When I crawl a list, I get back URLs that look like this:

http://myhost/Lists= /Tasks/2_.000

This URL returns a 404, but I think that's a SharePoint issue= . I don't believe there's a way to point directly to an item in Lis= t (is there?).

My question then is, is SharePoint returning this URL in this form, or = is MCF creating the URL based on the name of the list?

Thanks,=

Mark
























--047d7b676f7cf1531e04ebc9004e--