Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 63AF110125 for ; Fri, 22 Nov 2013 17:35:06 +0000 (UTC) Received: (qmail 491 invoked by uid 500); 22 Nov 2013 17:35:06 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 431 invoked by uid 500); 22 Nov 2013 17:35:05 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 423 invoked by uid 99); 22 Nov 2013 17:35:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Nov 2013 17:35:05 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of daddywri@gmail.com designates 209.85.128.43 as permitted sender) Received: from [209.85.128.43] (HELO mail-qe0-f43.google.com) (209.85.128.43) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Nov 2013 17:35:00 +0000 Received: by mail-qe0-f43.google.com with SMTP id 2so1173348qeb.2 for ; Fri, 22 Nov 2013 09:34:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=K5JHcF0OYVOd59VhC0yj/F70NduVi0tr22BXZFHbOxk=; b=D2pO0qqT20e3iplfAhQnVrGU0DCEGNvKVzccQaGYjZwIpoClbfnv7qtkWp1gsB+O78 MvoThHdIvMHATVQQXJG3lWiDmP3nxne5hDaQvyF8iDmRg9e5itoUYpPe30+2gpcahTba MYHIfzRn+9xH8d9FSn2FHvY+acEaYUhBYhHrwn9V4Dwe3zA6qboUooksNAj0xa4X6P5i KDiKuhYBuukIvnksRWJqVLvuOIe/xOrqPIWpr8/6aMIEzgCb1ofVchbMZ7cEJIc8UdGT btEDIYEeR/MUjpASfezuJuMnMI1T9fsCA5vd45l/WKnMC/yG/5B6wKU5CETUe6f3EbGd eojg== MIME-Version: 1.0 X-Received: by 10.229.13.69 with SMTP id b5mr23757203qca.13.1385141679335; Fri, 22 Nov 2013 09:34:39 -0800 (PST) Received: by 10.96.177.35 with HTTP; Fri, 22 Nov 2013 09:34:39 -0800 (PST) In-Reply-To: References: Date: Fri, 22 Nov 2013 12:34:39 -0500 Message-ID: Subject: Re: SharePoint List item URLs From: Karl Wright To: "user@manifoldcf.apache.org" Content-Type: multipart/alternative; boundary=001a11331562c2be8904ebc76d08 X-Virus-Checked: Checked by ClamAV on apache.org --001a11331562c2be8904ebc76d08 Content-Type: text/plain; charset=ISO-8859-1 Ok, patch for the ticket has been updated. Karl On Fri, Nov 22, 2013 at 12:31 PM, Karl Wright wrote: > Hi Mark, > > I am not surprised you are seeing the changed URLs yet, because you are > missing the connector code changes. I'll attach a patch to the > CONNECTORS-813 ticket momentarily that should do that though. > > Thanks, > Karl > > > > On Fri, Nov 22, 2013 at 12:28 PM, Mark Libucha wrote: > >> Hi Karl, >> >> So I'm still not seeing a change in the URLs that are coming back for >> SharePoint list items after reinstalling the updated plugin. >> >> Is there a way for me to check that the new plugin is correctly in place >> without actually logging into the SharePoint host? >> >> Thanks, >> >> Mark >> >> >> On Thu, Nov 21, 2013 at 12:42 PM, Mark Libucha wrote: >> >>> Hi Karl, will retry the plugin (and check the logs if it fails), but >>> need to wait to get it installed on the server -- out of my personal >>> control. >>> >>> But I'll definitely get to it and report back. >>> >>> Mark >>> >>> >>> On Thu, Nov 21, 2013 at 12:20 AM, Karl Wright wrote: >>> >>>> Thanks for clarifying. >>>> >>>> Like I said, the only solution I can find to produce the right URL >>>> involves plugin changes. I updated the plugin on the people.apache.orgsite enough times in quick succession that I think it may well be the case >>>> that you did not try the right one, so I hope you will be able to confirm >>>> that tomorrow. I've already committed what I think is the correct code to >>>> branches/CONNECTORS-813 but I won't supply that as a patch until we have a >>>> working plugin. >>>> >>>> If you try the plugin again, and it still fails, have a look at the >>>> SharePoint event logs; there may be an exception from the plugin in it that >>>> would be of help. The exceptions are all logged, but they are very hard to >>>> find. >>>> >>>> Thanks, >>>> Karl >>>> >>>> >>>> >>>> On Wed, Nov 20, 2013 at 11:22 PM, Mark Libucha wrote: >>>> >>>>> Yeah, I noticed that, too. But unfortunately the URLs sent to the >>>>> output connectors are no different. >>>>> >>>>> >>>>> On Wed, Nov 20, 2013 at 1:44 PM, Karl Wright wrote: >>>>> >>>>>> Hi Mark, >>>>>> >>>>>> I just noticed that the log output for the list item URL was >>>>>> incorrect in the CONNECTORS-813 patch; it was outputting the old url value >>>>>> into the log, even though the NEW url was being sent to the output >>>>>> connector. Can you confirm that you did in fact not just look at the >>>>>> ManifoldCF log to determine whether or not the patch worked? >>>>>> >>>>>> Karl >>>>>> >>>>>> >>>>>> >>>>>> On Wed, Nov 20, 2013 at 4:13 PM, Karl Wright wrote: >>>>>> >>>>>>> I was trying to read the value as metadata, but clearly, then, it is >>>>>>> not available, and we will need to construct it ourselves, probably >>>>>>> according to this formula: >>>>>>> >>>>>>> // Display form full url >>>>>>> string.Format("{0}{1}?ID={2}", item.Web.Url, item.ParentList.Forms[PAGETYPE.PAGE_DISPLAYFORM].ServerRelativeUrl, item.ID) >>>>>>> >>>>>>> The problem is that when I included this in the plugin code, the plugin failed to work properly. >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> No doubt it threw an exception of some kind, but we have no idea what that was. >>>>>>> >>>>>>> Constructing it in Java is fine except I'm missing whatever the item.ParentList.Forms[] array would have >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> contained. Can you confirm that this is the plugin you tried: >>>>>>> >>>>>>> 11832 Nov 20 17:35 MetaCarta.SharePoint.MCPermissionsService.wsp >>>>>>> >>>>>>> If the size differed it is possible you were using the wrong one - let's just rule that out first. >>>>>>> >>>>>>> Karl >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Wed, Nov 20, 2013 at 3:09 PM, Mark Libucha wrote: >>>>>>> >>>>>>>> Still getting list item URIs that look like this: >>>>>>>> http://myhost/test3/Lists/Greg/1_.000 >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Nov 20, 2013 at 10:43 AM, Mark Libucha wrote: >>>>>>>> >>>>>>>>> Excellent! I was writing up a response to tell you the 2nd plugin >>>>>>>>> change also did not work. I'll revert and apply the patch and report back. >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> >>>>>>>>> Mark >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Nov 20, 2013 at 10:41 AM, Karl Wright wrote: >>>>>>>>> >>>>>>>>>> Hi Mark, >>>>>>>>>> >>>>>>>>>> I found another way to do it - I think - that doesn't involve >>>>>>>>>> changes to the plugin. >>>>>>>>>> >>>>>>>>>> I've attached a patch to the the ticket accordingly. >>>>>>>>>> (CONNECTORS-813). >>>>>>>>>> >>>>>>>>>> So you should be able to revert back to the distributed plugin >>>>>>>>>> and that will make things tons easier. >>>>>>>>>> >>>>>>>>>> Karl >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Nov 20, 2013 at 12:19 PM, Karl Wright >>>>>>>>> > wrote: >>>>>>>>>> >>>>>>>>>>> Ok, I've uploaded another try - this time using a different >>>>>>>>>>> suggestion from the same page. Can you verify that it does not fail for >>>>>>>>>>> both documents in libraries and for list items? >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> Karl >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, Nov 20, 2013 at 12:06 PM, Karl Wright < >>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Well, so much for StackOverflow suggestions. It seems to be >>>>>>>>>>>> relying on an undocumented feature anyhow. >>>>>>>>>>>> >>>>>>>>>>>> Let me try one other thing - will get right back to you. >>>>>>>>>>>> >>>>>>>>>>>> Karl >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Nov 20, 2013 at 12:02 PM, Mark Libucha < >>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Karl, >>>>>>>>>>>>> >>>>>>>>>>>>> It did not work. In fact, the SharePoint crawler never sent >>>>>>>>>>>>> anything to my output connector, except for the Job Completed callback. >>>>>>>>>>>>> >>>>>>>>>>>>> Log excerpt: >>>>>>>>>>>>> >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,683 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: Getting version of '/test3/Links///' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: Checking whether to include list '/test3/Links' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: List '/test3/Links' exactly matched rule path '/*' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: Including list '/test3/Links' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: Processing: '/test3/Links///' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: Document identifier is a list: '/test3/Links' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - >>>>>>>>>>>>> SharePoint: The page at http://myhost/test3 did not exist; >>>>>>>>>>>>> assuming library deleted >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - >>>>>>>>>>>>> SharePoint: No list found for list '/test3/Calendar' - deleting >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:26,958 (Worker thread '34') - >>>>>>>>>>>>> SharePoint: In getFieldList; site='/test3', >>>>>>>>>>>>> listName='{A6631841-0251-46C1-86F0-B1B049B2F659}' >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - >>>>>>>>>>>>> SharePoint: The page at http://myhost/test3 did not exist; >>>>>>>>>>>>> assuming library deleted >>>>>>>>>>>>> DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - >>>>>>>>>>>>> SharePoint: No list found for library '/test3/SitePages' - deleting >>>>>>>>>>>>> >>>>>>>>>>>>> Mark >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, Nov 19, 2013 at 2:13 PM, Karl Wright < >>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>> >>>>>>>>>>>>>> So I've created a new version of the MCPermissions.asmx >>>>>>>>>>>>>> plugin for SharePoint 2010. You can download the .wsp for it from: >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> http://people.apache.org/~kwright/MetaCarta.SharePoint.MCPermissionsService.wsp >>>>>>>>>>>>>> >>>>>>>>>>>>>> Install it by replacing the file of the same name in the >>>>>>>>>>>>>> plugin installation package. Or, if you prefer, I can build the complete >>>>>>>>>>>>>> package - please let me know. >>>>>>>>>>>>>> >>>>>>>>>>>>>> The point of doing this now is to make sure that this plugin >>>>>>>>>>>>>> works for both list items and for files, with getting exceptions or >>>>>>>>>>>>>> whatnot. If it fails, then we are back to the drawing board, but if it >>>>>>>>>>>>>> seems to work OK then I will make appropriate modifications to the >>>>>>>>>>>>>> SharePoint connector to correspond to it. >>>>>>>>>>>>>> >>>>>>>>>>>>>> In order to know whether it is working, you will need to >>>>>>>>>>>>>> crawl both lists and libraries, and make sure that MCF discovers the list >>>>>>>>>>>>>> items and files within without errors. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Please let me know if you are able to do this. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>> Karl >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:59 PM, Karl Wright < >>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> This link seems helpful: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> http://social.msdn.microsoft.com/Forums/sharepoint/en-US/2be88c8b-812b-4574-8c2c-965cedd2f199/how-to-get-splistitem-item-server-relative-url-or-absolute-url-in-sharepoint-list?forum=sharepointdevelopmentlegacy >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I'll give it a try. >>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:51 PM, Karl Wright < >>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> First - have you installed the ManifoldCF SharePoint 2010 >>>>>>>>>>>>>>>> plugin? Have you selected SharePoint 2010 in your connection definition? >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> If you have, then ManifoldCF is communicating with the >>>>>>>>>>>>>>>> MCPermissions.asmx plugin to perform this activity. Please see this page: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.splistitem_members%28v=office.14%29.aspx >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The field the plugin is returning is the "Url" field of the >>>>>>>>>>>>>>>> item. There is no "ListItemURL" member that I can see. So, are inspecting >>>>>>>>>>>>>>>> the results from the Lists web service? I wonder how the Lists webservice >>>>>>>>>>>>>>>> translates the FileRef URL into a ListItemURL, in C#? >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:35 PM, Karl Wright < >>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Ok; to fix this problem then we will need a new release of >>>>>>>>>>>>>>>>> the SharePoint 2010 plugin. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 4:32 PM, Mark Libucha < >>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Ah, I think it's this: LISTITEMURL >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> That works for me. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 1:25 PM, Karl Wright < >>>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Hmm, okay. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> The URL we use is what comes back in the "FileRef" field >>>>>>>>>>>>>>>>>>> of the Lists.asmx getListItems response. It is possible that there's a >>>>>>>>>>>>>>>>>>> better choice for list items. I'll create a ticket and look into what the >>>>>>>>>>>>>>>>>>> options are. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 3:46 PM, Mark Libucha < >>>>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> That doesn't work either. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> In the SharePoint UI, the Task List is presented as a >>>>>>>>>>>>>>>>>>>> table, with each of the individual items in the list presented as a URL. >>>>>>>>>>>>>>>>>>>> When you click on an item, it raises a pop up... >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> The links on the page look like this... >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> http://myhost/_layouts/listform.aspx?PageType=4&ListId={1BD4F07D-A210-45A7-9C91-D296B1AB73EE}&ID=2&ContentTypeID=0x010800DE3D7FC80C8CFC4BA00DFEC40120E795 >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Nothing like the URIs they are handing back to MCF... >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Thanks for the info. >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 12:25 PM, Karl Wright < >>>>>>>>>>>>>>>>>>>> daddywri@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Hi Mark, >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> SharePoint indeed uses URLs of this form. The one you >>>>>>>>>>>>>>>>>>>>> provided describes a List in the root site called "Tasks", and references >>>>>>>>>>>>>>>>>>>>> the second item in that list. I'm surprised SharePoint doesn't give >>>>>>>>>>>>>>>>>>>>> something better than a 404 when you go to it, though. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Can you go to http://myhost/Lists/Tasks#2_.000without it giving a 404? because that's something the connector could >>>>>>>>>>>>>>>>>>>>> certainly do. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> On Tue, Nov 19, 2013 at 3:21 PM, Mark Libucha < >>>>>>>>>>>>>>>>>>>>> mlibucha@gmail.com> wrote: >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> When I crawl a list, I get back URLs that look like >>>>>>>>>>>>>>>>>>>>>> this: >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> http://myhost/Lists/Tasks/2_.000 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> This URL returns a 404, but I think that's a >>>>>>>>>>>>>>>>>>>>>> SharePoint issue. I don't believe there's a way to point directly to an >>>>>>>>>>>>>>>>>>>>>> item in List (is there?). >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> My question then is, is SharePoint returning this URL >>>>>>>>>>>>>>>>>>>>>> in this form, or is MCF creating the URL based on the name of the list? >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Mark >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> > --001a11331562c2be8904ebc76d08 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Ok, patch for the ticket has been updated.

Karl


On Fri, Nov 22, 2013 at 12:31 PM, Karl Wright <daddywri@gmail.com= > wrote:
Hi Mark,

<= /div>I am not surprised you are seeing the changed URLs yet, because you ar= e missing the connector code changes.=A0 I'll attach a patch to the CON= NECTORS-813 ticket momentarily that should do that though.

Thanks,
Karl



On Fri, N= ov 22, 2013 at 12:28 PM, Mark Libucha <mlibucha@gmail.com> = wrote:
Hi Karl,

S= o I'm still not seeing a change in the URLs that are coming back for Sh= arePoint list items after reinstalling the updated plugin.

Is there a way for me to check that the new plugin is correctly i= n place without actually logging into the SharePoint host?

Thanks,

Mark


On Thu, Nov 21, 2013 at 12:42 PM, Mark = Libucha <mlibucha@gmail.com> wrote:
Hi Karl, will retry th= e plugin (and check the logs if it fails), but need to wait to get it insta= lled on the server -- out of my personal control.

But I'll definitely get to it and report back.

Mark


On Thu, Nov 21, 2013 at 12:20 AM, Karl Wright <daddywri@gmail.com= > wrote:
Thanks for clarif= ying.

Like I said, the only solution I can find to produce the= right URL involves plugin changes.=A0 I updated the plugin on the people.apache.org site = enough times in quick succession that I think it may well be the case that = you did not try the right one, so I hope you will be able to confirm that t= omorrow.=A0 I've already committed what I think is the correct code to = branches/CONNECTORS-813 but I won't supply that as a patch until we hav= e a working plugin.

If you try the plugin again, and it still fails, have a look= at the SharePoint event logs; there may be an exception from the plugin in= it that would be of help.=A0 The exceptions are all logged, but they are v= ery hard to find.

Thanks,
Karl



On Wed, Nov 20, 2013 at 11:22 PM, Mark = Libucha <mlibucha@gmail.com> wrote:
Yeah, I noticed that, too. = But unfortunately the URLs sent to the output connectors are no different.<= br>


On Wed, Nov 20, 2013 at 1:44 PM, Karl Wright <daddywri@gmail.com&g= t; wrote:
Hi Mark,

I just noti= ced that the log output for the list item URL was incorrect in the CONNECTO= RS-813 patch; it was outputting the old url value into the log, even though= the NEW url was being sent to the output connector.=A0 Can you confirm tha= t you did in fact not just look at the ManifoldCF log to determine whether = or not the patch worked?

Karl


On Wed, Nov 20, 2013 at 4:13 PM, Karl Wrig= ht <daddywri@gmail.com> wrote:
I was trying to read the va= lue as metadata, but clearly, then, it is not available, and we will need t= o construct it ourselves, probably according to this formula:
// Display form full url
string.Format("{0}{1}?ID=3D{2}", item.Web.Url, item.ParentList.Fo=
rms[PAGETYPE.PAGE_DISPLAYFORM].ServerRelativeUrl, item.ID)

The problem i= s that when I included this in the plugin code, the plugin failed to work p= roperly.
No doubt it threw an exception of some kind, but we have no idea what th=
at was.
Constructing it in Java is fine except I'm missing whatev=
er the item.ParentList.Forms[] array would have
contained.  Can you confirm that this is the plugin you tried:

11= 832 Nov 20 17:35 MetaCarta.SharePoint.MCPermissionsService.wsp

If the siz=
e differed it is possible you were using the wrong one - let's just rul=
e that out first.

Karl



On Wed, Nov 20, 2013 a= t 3:09 PM, Mark Libucha <mlibucha@gmail.com> wrote:
Still ge= tting list item URIs that look like this: http://myhost/test3/Lists/Greg/1_.000


On Wed, Nov 20, 2013 at 10:43 AM, Mark Libucha <mlibucha@gmail.com>= ; wrote:
Excellent! I was writing up a response to tell you the 2nd= plugin change also did not work. I'll revert and apply the patch and r= eport back.

Thanks,

Mark


On Wed, Nov 20, 2013 at 10:41 AM, Karl Wrigh= t <daddywri@gmail.com> wrote:
Hi Mark,

I found another way to do i= t - I think - that doesn't involve changes to the plugin.

= I've attached a patch to the the ticket accordingly.=A0 (CONNECTORS-813= ).

So you should be able to revert back to the distributed plugin an= d that will make things tons easier.

<= /font>
Karl



On Wed, Nov 20, 2013 at 12:19 PM, Karl Wright <daddy= wri@gmail.com> wrote:
Ok, I= 9;ve uploaded another try - this time using a different suggestion from the= same page.=A0 Can you verify that it does not fail for both documents in l= ibraries and for list items?

Thanks,
Karl



On Wed, Nov 20, 2013 at 12:06 PM, Karl Wright <= daddywri@gmail.com<= /a>> wrote:
Well, so= much for StackOverflow suggestions.=A0 It seems to be relying on an undocu= mented feature anyhow.

Let me try one other thing - will get right back to you.

Karl




On Wed, Nov 20, 2013 at 12:02 PM, Mark L= ibucha <mlibucha@gmail.com> wrote:
Karl,

It did not work. In fact, the= SharePoint crawler never sent anything to my output connector, except for = the Job Completed callback.

Log excerpt:

DEBUG 201= 3-11-20 11:56:26,683 (Worker thread '34') - SharePoint: Getting ver= sion of '/test3/Links///'
DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - SharePoint: Ch= ecking whether to include list '/test3/Links'
DEBUG 2013-11-20 1= 1:56:26,684 (Worker thread '34') - SharePoint: List '/test3/Lin= ks' exactly matched rule path '/*'
DEBUG 2013-11-20 11:56:26,684 (Worker thread '34') - SharePoint: In= cluding list '/test3/Links'
DEBUG 2013-11-20 11:56:26,685 (Worke= r thread '34') - SharePoint: Processing: '/test3/Links///'<= br> DEBUG 2013-11-20 11:56:26,685 (Worker thread '34') - SharePoint: Do= cument identifier is a list: '/test3/Links'
DEBUG 2013-11-20 11:= 56:26,768 (Worker thread '26') - SharePoint: The page at http://myhost/test3 did not exi= st; assuming library deleted
DEBUG 2013-11-20 11:56:26,768 (Worker thread '26') - SharePoint: No= list found for list '/test3/Calendar' - deleting
DEBUG 2013-11-= 20 11:56:26,958 (Worker thread '34') - SharePoint: In getFieldList;= site=3D'/test3', listName=3D'{A6631841-0251-46C1-86F0-B1B049B2= F659}'
DEBUG 2013-11-20 11:56:27,360 (Worker thread '35') - SharePoint: Th= e page at http://myhost/t= est3 did not exist; assuming library deleted
DEBUG 2013-11-20 11:56:= 27,360 (Worker thread '35') - SharePoint: No list found for library= '/test3/SitePages' - deleting

Mark


On Tue, Nov 19, 2013 at 2:13 PM, Karl Wright <daddywri@g= mail.com> wrote:
Hi Mark,

So I've created a new version of the = MCPermissions.asmx plugin for SharePoint 2010.=A0 You can download the .wsp= for it from:

http://people.apache.org/~kwri= ght/MetaCarta.SharePoint.MCPermissionsService.wsp

Install it by replacing the file of the same name in the plugin install= ation package.=A0 Or, if you prefer, I can build the complete package - ple= ase let me know.

The point of doing this now is to make sure t= hat this plugin works for both list items and for files, with getting excep= tions or whatnot.=A0 If it fails, then we are back to the drawing board, bu= t if it seems to work OK then I will make appropriate modifications to the = SharePoint connector to correspond to it.

In order to know whether it is working, you will need to crawl both lis= ts and libraries, and make sure that MCF discovers the list items and files= within without errors.

Please let me know if you are able to do thi= s.

Thanks,
Karl



<= div>


On Tue, N= ov 19, 2013 at 4:59 PM, Karl Wright <daddywri@gmail.com> wr= ote:


On Tue, Nov 19, 2013 at 4:51 PM, Karl Wright <daddywri@g= mail.com> wrote:
Hi Mark,

First - have you installed the ManifoldCF Shar= ePoint 2010 plugin?=A0 Have you selected SharePoint 2010 in your connection= definition?

If you have, then ManifoldCF is communicating with the MCPermissions.as= mx plugin to perform this activity.=A0 Please see this page:

http://msdn.= microsoft.com/en-us/library/microsoft.sharepoint.splistitem_members%28v=3Do= ffice.14%29.aspx

The field the plugin is returning is the "Url" field of= the item.=A0 There is no "ListItemURL" member that I can see.=A0= So, are inspecting the results from the Lists web service?=A0 I wonder how= the Lists webservice translates the FileRef URL into a ListItemURL, in C#?=

Karl



On Tue, Nov 19, 2013 at 4:35 PM, Karl Wright <= daddywri@gmail.com<= /a>> wrote:
Ok;= to fix this problem then we will need a new release of the SharePoint 2010= plugin.

Karl



On Tue, Nov 19, 2013 at 4:32 PM, Mark Libucha <= ;mlibucha@gmail.com= > wrote:
Ah,= I think it's this: LISTITEMURL

That works for me.

Mark

On Tue, Nov 19, 2013 at 1:25 PM, Karl Wright <= span dir=3D"ltr"><daddywri@gmail.com> wrote:
Hmm= , okay.

The URL we use is what comes back in the "FileRef= " field of the Lists.asmx getListItems response.=A0 It is possible tha= t there's a better choice for list items.=A0 I'll create a ticket a= nd look into what the options are.

Karl


On Tue, Nov 19, 2013 at 3:46 PM, Mark Libu= cha <mlibucha@gmail.com> wrote:
That doesn't work either.

In the SharePoint UI, the Task= List is presented as a table, with each of the individual items in the lis= t presented as a URL. When you click on an item, it raises a pop up...

The links on the page look like this...

http://myhost/_layouts/listform.aspx?Page= Type=3D4&ListId=3D{1BD4F07D-A210-45A7-9C91-D296B1AB73EE}&ID=3D2&= ;ContentTypeID=3D0x010800DE3D7FC80C8CFC4BA00DFEC40120E795

Nothing like the URIs they are handing back to MCF...

Than= ks for the info.

Mark



On Tue, Nov 19, 2013 at 12:25 PM, Karl W= right <daddywri@gmail.com> wrote:
Hi Mark,

SharePoint indeed uses URLs of this form.= =A0 The one you provided describes a List in the root site called "Tas= ks", and references the second item in that list.=A0 I'm surprised= SharePoint doesn't give something better than a 404 when you go to it,= though.

Can you go to http://myhost/Lists/Tasks#2_.000 without it giving a 404?= =A0 because that's something the connector could certainly do.

Karl



On Tue, Nov 19, 2013 at 3:21 PM, Mark Li= bucha <mlibucha@gmail.com> wrote:
When I crawl a list, I get back URLs that look like this:

http://myhost/Lists= /Tasks/2_.000

This URL returns a 404, but I think that's a SharePoint issue= . I don't believe there's a way to point directly to an item in Lis= t (is there?).

My question then is, is SharePoint returning this URL in this form, or = is MCF creating the URL based on the name of the list?

Thanks,=

Mark






















--001a11331562c2be8904ebc76d08--