Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E978D10137 for ; Tue, 5 Aug 2014 03:53:51 +0000 (UTC) Received: (qmail 49372 invoked by uid 500); 5 Aug 2014 03:53:51 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 49321 invoked by uid 500); 5 Aug 2014 03:53:51 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 49311 invoked by uid 99); 5 Aug 2014 03:53:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Aug 2014 03:53:51 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lalit.j.jangra@gmail.com designates 209.85.213.50 as permitted sender) Received: from [209.85.213.50] (HELO mail-yh0-f50.google.com) (209.85.213.50) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Aug 2014 03:53:48 +0000 Received: by mail-yh0-f50.google.com with SMTP id v1so266710yhn.23 for ; Mon, 04 Aug 2014 20:53:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=RmM71exi43XABwGHrO48sPVA3p6uGR5mWJIiioEI+rY=; b=TXjS9ZK2A9UlFI3XfxoryOOJdKRbJfg6hflQ+duNW06wFHKRgY8V1JHfj09WPMobOb 1orThyk8UfIg9ZQCBz4zQ6Jh+w+mavRJ4bEFYCRJjyecoz6lYCbtsbwgWrYWw/wAm5Lf uaF4BHaIu+FLvpPilvrCnQOFQvjJhjB+fj5BFVDf6RS2Unq3UjR9MT3QWeSFwiCBZA35 0/w4oRTBl/8t4m0kpKPnoAPgVF6XtjNcXEk/CpA940R51otmMOmDdJh58aRWehM+oIbZ SN+SUXVZSVusNSbUpy02v0dhh9yc2fLDSH51WPcXdblWLZalVEkOhGpFYIfFzIKdoo4n GDbg== MIME-Version: 1.0 X-Received: by 10.236.14.34 with SMTP id c22mr1535909yhc.97.1407210803036; Mon, 04 Aug 2014 20:53:23 -0700 (PDT) Received: by 10.170.150.193 with HTTP; Mon, 4 Aug 2014 20:53:22 -0700 (PDT) In-Reply-To: References: <4303123724806417374@unknownmsgid> Date: Tue, 5 Aug 2014 09:23:22 +0530 Message-ID: Subject: Re: FW: What all items MCF crawls in Sharepoint Lists From: lalit jangra To: "user@manifoldcf.apache.org" Content-Type: multipart/alternative; boundary=089e013a29da0a07d704ffd9cc26 X-Virus-Checked: Checked by ClamAV on apache.org --089e013a29da0a07d704ffd9cc26 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Karl, I only posted URLs last time. Please find full logs below for some of contents. I hope this is what required here. 1101376 [http-bio-8080-exec-36] INFO org.apache.solr.update.processor.LogUpdateProcessor =E2=80=93 [collection1= ] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D0&literal.deny_token_document=3DSharepointAuth= Group:DEAD_AUTHORITY&literal.Attachments=3D0&literal.Data=3D&literal.DocIco= n=3D& resource.name =3Ddocname&literal.allow_token_document=3DSharepointAuthGroup:GApprovers&li= teral.allow_token_document=3DSharepointAuthGroup:GControlled%2BDocuments%2B= Members&literal.allow_token_document=3DSharepointAuthGroup:GControlled%2BDo= cuments%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GContro= lled%2BDocuments%2BVisitors&literal.allow_token_document=3DSharepointAuthGr= oup:GDesigners&literal.allow_token_document=3DSharepointAuthGroup:GHierarch= y%2BManagers&literal.allow_token_document=3DSharepointAuthGroup:GRestricted= %2BReaders&literal.allow_token_document=3DSharepointAuthGroup:GThe%2BWell%2= BPortal%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GThe%2B= Well%2BVisitors&literal.allow_token_document=3DSharepointAuthGroup:GViewers= &literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctru= e&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-= 1-5-21-2630432783-15384281-2988178474-1619&literal.allow_token_document=3DS= harepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178= 474-6296&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w= %257Cs-1-5-21-2630432783-15384281-2988178474-6297&literal.WorkflowTemplate= =3D{8ad4d8f0-93a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&vers= ion=3D2.2&literal.ItemChildCount=3D0&literal.GUID=3D{0146F19F-3703-4989-B5C= 4-AB2A0D149D2A}&literal.LinkTitleNoMenu=3D&literal.Item=3D12&literal.Descri= ption=3DTask+assigned+to+Geraldine+Davis+was+approved+by+Geraldine+Davis.+C= omments:+Approved+Prior+to+publishing+in+The+Well&literal.List=3D{3c662220-= 9577-406b-867a-a7bda053842d}&literal.Edit=3D&literal.WorkflowInstance=3D{83= 7462c8-a1db-4dbf-9ac1-51f8c001b6d6}& literal.id=3D http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?I= D%3D613&literal.Created=3D2014-01-03+11:03:57&literal._UIVersionString=3D1.= 0&literal.Outcome=3DApproved+by+Geraldine+Davis&wt=3Dxml&literal.Group=3D0&= literal.Modified=3D2014-01-03+11:03:57&literal.Author=3DSystem+Account&lite= ral.User=3DGeraldine+Davis&literal.WorkflowAssociation=3D{919e1558-a8f3-44a= f-9803-b95a16876236}&literal.lcf_metadata_id=3D613&literal.Occurred=3D2014-= 01-03+11:03:56&literal.Event=3D6&literal.Editor=3DSystem+Account&literal.Co= ntentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow History/DispForm.aspx?ID=3D613 (1475502859537612800)]} 0 1 1101397 [http-bio-8080-exec-36] INFO org.apache.solr.update.processor.LogUpdateProcessor =E2=80=93 [collection1= ] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D0&literal.deny_token_document=3DSharepointAuth= Group:DEAD_AUTHORITY&literal.Attachments=3D0&literal.Data=3D&literal.DocIco= n=3D& resource.name =3Ddocname&literal.allow_token_document=3DSharepointAuthGroup:GApprovers&li= teral.allow_token_document=3DSharepointAuthGroup:GControlled%2BDocuments%2B= Members&literal.allow_token_document=3DSharepointAuthGroup:GControlled%2BDo= cuments%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GContro= lled%2BDocuments%2BVisitors&literal.allow_token_document=3DSharepointAuthGr= oup:GDesigners&literal.allow_token_document=3DSharepointAuthGroup:GHierarch= y%2BManagers&literal.allow_token_document=3DSharepointAuthGroup:GRestricted= %2BReaders&literal.allow_token_document=3DSharepointAuthGroup:GThe%2BWell%2= BPortal%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GThe%2B= Well%2BVisitors&literal.allow_token_document=3DSharepointAuthGroup:GViewers= &literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctru= e&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-= 1-5-21-2630432783-15384281-2988178474-1619&literal.allow_token_document=3DS= harepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178= 474-6296&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w= %257Cs-1-5-21-2630432783-15384281-2988178474-6297&literal.WorkflowTemplate= =3D{8ad4d8f0-93a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&vers= ion=3D2.2&literal.ItemChildCount=3D0&literal.GUID=3D{4F51B03D-1D2D-44C9-BC8= E-0552F5BC1640}&literal.LinkTitleNoMenu=3D&literal.Item=3D36&literal.Descri= ption=3DApproval+was+completed.&literal.List=3D{33ae8f1c-a4f9-49d4-9bd0-ad2= bdea6fc4d}&literal.Edit=3D&literal.WorkflowInstance=3D{bee13e22-4880-49e7-a= 9b8-50e22f0453a1}& literal.id=3D http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?I= D%3D940&literal.Created=3D2014-01-10+12:09:27&literal._UIVersionString=3D1.= 0&literal.Outcome=3DApproval+on+IW-HSQE-SOP-024+has+successfully+completed.= +All+participants+have+completed+their+tasks.&wt=3Dxml&literal.Group=3D0&li= teral.Modified=3D2014-01-10+12:09:27&literal.Author=3DSystem+Account&litera= l.User=3DJulie+Curtin&literal.WorkflowAssociation=3D{1e02d877-6a8d-4d9f-8a3= c-7d46b771becb}&literal.lcf_metadata_id=3D940&literal.Occurred=3D2014-01-10= +12:09:26&literal.Event=3D2&literal.Editor=3DSystem+Account&literal.Content= Type=3DWorkflow+History} {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow History/DispForm.aspx?ID=3D940 (1475502859560681472)]} 0 0 1101401 [http-bio-8080-exec-15] INFO org.apache.solr.update.processor.LogUpdateProcessor =E2=80=93 [collection1= ] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D806027384.000000&literal.deny_token_document= =3DSharepointAuthGroup:DEAD_AUTHORITY&literal.Attachments=3D0&literal.Data= =3D&literal.DocIcon=3D& resource.name =3Ddocname&literal.allow_token_document=3DSharepointAuthGroup:GApprovers&li= teral.allow_token_document=3DSharepointAuthGroup:GControlled%2BDocuments%2B= Members&literal.allow_token_document=3DSharepointAuthGroup:GControlled%2BDo= cuments%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GContro= lled%2BDocuments%2BVisitors&literal.allow_token_document=3DSharepointAuthGr= oup:GDesigners&literal.allow_token_document=3DSharepointAuthGroup:GHierarch= y%2BManagers&literal.allow_token_document=3DSharepointAuthGroup:GRestricted= %2BReaders&literal.allow_token_document=3DSharepointAuthGroup:GThe%2BWell%2= BPortal%2BOwners&literal.allow_token_document=3DSharepointAuthGroup:GThe%2B= Well%2BVisitors&literal.allow_token_document=3DSharepointAuthGroup:GViewers= &literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctru= e&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-= 1-5-21-2630432783-15384281-2988178474-1619&literal.allow_token_document=3DS= harepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178= 474-6296&literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w= %257Cs-1-5-21-2630432783-15384281-2988178474-6297&literal.WorkflowTemplate= =3D{8ad4d8f0-93a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&vers= ion=3D2.2&literal.ItemChildCount=3D0&literal.GUID=3D{A749C6D8-A176-4DA4-8DF= F-5927046DDC2E}&literal.LinkTitleNoMenu=3D&literal.Item=3D198&literal.Descr= iption=3DWorkflow+Approve+Template+Document+was+canceled+by+System+Account.= &literal.List=3D{4cd670da-118d-4611-887a-11de0bb6baa9}&literal.Edit=3D&lite= ral.WorkflowInstance=3D{f3c924db-6289-425d-978d-4bc14d616c3d}& literal.id=3D http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?I= D%3D3365&literal.Created=3D2014-05-19+14:19:49&literal._UIVersionString=3D1= .0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modified=3D2014-05= -19+14:19:49&literal.Author=3DSystem+Account&literal.User=3DSystem+Account&= literal.WorkflowAssociation=3D{7791ab09-0117-4a78-a14e-e5aee9b40d78}&litera= l.lcf_metadata_id=3D3365&literal.Occurred=3D2014-05-19+14:19:48&literal.Eve= nt=3D3&literal.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+Histo= ry} {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow History/DispForm.aspx?ID=3D3365 (1475502859564875776)]} 0 0 @ @ On Mon, Aug 4, 2014 at 6:22 PM, Karl Wright wrote: > Hi Lalit, > > Solr is clearly indexing your list items. But I don't see any ACLs. Wha= t > is your allowAttributeName and denyAttributeName set to for the Solr > connection? The default is allow_token_XXX and deny_token_XXX. > > Karl > > > On Mon, Aug 4, 2014 at 8:40 AM, lalit jangra > wrote: > >> Thanks Karl, >> >> Please find below some of URLs from solr logs. >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D792&literal.Created=3D2014-01-06+14:00:45&literal._UIVersionString= =3D1.0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modified=3D201= 4-01-06+14:00:45&literal.Author=3DSystem+Account&literal.User=3DGeraldine+D= avis&literal.WorkflowAssociation=3D{7791ab09-0117-4a78-a14e-e5aee9b40d78}&l= iteral.lcf_metadata_id=3D792&literal.Occurred=3D2014-01-06+14:00:44&literal= .Event=3D1&literal.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+H= istory} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D792 >> >> (1475502859497766912)]} 0 0 >> >> >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D561&literal.Created=3D2014-01-02+17:15:58&literal._UIVersionString= =3D1.0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modified=3D201= 4-01-02+17:15:58&literal.Author=3DSystem+Account&literal.User=3DGeraldine+D= avis&literal.WorkflowAssociation=3D{7791ab09-0117-4a78-a14e-e5aee9b40d78}&l= iteral.lcf_metadata_id=3D561&literal.Occurred=3D2014-01-02+17:15:57&literal= .Event=3D1&literal.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+H= istory} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D561 >> >> (1475502859497766913)]} 0 0 >> >> >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D3270&literal.Created=3D2014-05-08+17:34:58&literal._UIVersionString= =3D1.0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modified=3D201= 4-05-08+17:34:58&literal.Author=3DSystem+Account&literal.User=3DSystem+Acco= unt&literal.WorkflowAssociation=3D{0c553c29-0e6a-4411-b834-8bf1cc02eb2e}&li= teral.lcf_metadata_id=3D3270&literal.Occurred=3D2014-05-08+17:34:57&literal= .Event=3D10&literal.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+= History} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D3270 >> >> (1475502859521884160)]} 0 1 >> >> >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D613&literal.Created=3D2014-01-03+11:03:57&literal._UIVersionString= =3D1.0&literal.Outcome=3DApproved+by+Geraldine+Davis&wt=3Dxml&literal.Group= =3D0&literal.Modified=3D2014-01-03+11:03:57&literal.Author=3DSystem+Account= &literal.User=3DGeraldine+Davis&literal.WorkflowAssociation=3D{919e1558-a8f= 3-44af-9803-b95a16876236}&literal.lcf_metadata_id=3D613&literal.Occurred=3D= 2014-01-03+11:03:56&literal.Event=3D6&literal.Editor=3DSystem+Account&liter= al.ContentType=3DWorkflow+History} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D613 >> >> (1475502859537612800)]} 0 1 >> >> >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D940&literal.Created=3D2014-01-10+12:09:27&literal._UIVersionString= =3D1.0&literal.Outcome=3DApproval+on+IW-HSQE-SOP-024+has+successfully+compl= eted.+All+participants+have+completed+their+tasks.&wt=3Dxml&literal.Group= =3D0&literal.Modified=3D2014-01-10+12:09:27&literal.Author=3DSystem+Account= &literal.User=3DJulie+Curtin&literal.WorkflowAssociation=3D{1e02d877-6a8d-4= d9f-8a3c-7d46b771becb}&literal.lcf_metadata_id=3D940&literal.Occurred=3D201= 4-01-10+12:09:26&literal.Event=3D2&literal.Editor=3DSystem+Account&literal.= ContentType=3DWorkflow+History} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D940 >> >> (1475502859560681472)]} 0 0 >> >> >> >> >> http://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.asp= x?ID%3D3365&literal.Created=3D2014-05-19+14:19:49&literal._UIVersionString= =3D1.0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modified=3D201= 4-05-19+14:19:49&literal.Author=3DSystem+Account&literal.User=3DSystem+Acco= unt&literal.WorkflowAssociation=3D{7791ab09-0117-4a78-a14e-e5aee9b40d78}&li= teral.lcf_metadata_id=3D3365&literal.Occurred=3D2014-05-19+14:19:48&literal= .Event=3D3&literal.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+H= istory} >> >> {add=3D[http://testirishwaterportal/kbase/cd/Lists/Workflow >> History/DispForm.aspx?ID=3D3365 >> >> (1475502859564875776)]} 0 0 >> >> >> >> On Mon, Aug 4, 2014 at 6:02 PM, Karl Wright wrote: >> >>> Hi Lalit, >>> >>> You do not need to try the null output connection; the report indicates >>> that your list items are in fact being sent to Solr. So the next step = is >>> to look at the Solr log. There should be an INFO statement in the log = for >>> every list item, which includes a URL. The URL should have the metadat= a >>> for the list item in it. Can you send a couple of those to us please. >>> >>> Karl >>> >>> >>> >>> On Mon, Aug 4, 2014 at 8:22 AM, lalit jangra >>> wrote: >>> >>>> Hi Karl, >>>> >>>> I can see list items getting rendered in simple history report, please >>>> see attached screenshot. >>>> >>>> I have not tried null connection till but planning to do it very soon. >>>> >>>> >>>> On Mon, Aug 4, 2014 at 5:47 PM, Karl Wright wrote= : >>>> >>>>> Hi Lalit, >>>>> >>>>> From your response it is not clear to me whether you see any list >>>>> items appearing in the simple history report. Nor is it clear whethe= r you >>>>> see list items in a simple history report going against a null output >>>>> connection. Can you clarify this please? If you don't know what a l= ist >>>>> item would look like in the history, please just include a screen sho= t. >>>>> >>>>> Thanks, >>>>> Karl >>>>> >>>>> >>>>> >>>>> On Mon, Aug 4, 2014 at 8:13 AM, lalit jangra >>>> > wrote: >>>>> >>>>>> Thanks Karl, >>>>>> >>>>>> I checked simple history to see number of different documents as wel= l >>>>>> as content types getting indexed from lists. >>>>>> >>>>>> Also I have customized SharePointRepository.java to add couple of >>>>>> custom metadata such as content url, modifier etc. but i assume thes= e >>>>>> metadata will be available for all items including lists. Also i can= see >>>>>> some items in solr index which do not have all metadata fields attac= hed to >>>>>> them. But i am not filtering on basis of extensions & crawling all = items >>>>>> needed. >>>>>> >>>>>> Since start, i could see any content items such as pdf or doc or xls >>>>>> attached to any list item getting indexed well but that item itself = is >>>>>> missing. >>>>>> >>>>>> Regards. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> On Mon, Aug 4, 2014 at 5:07 PM, Karl Wright >>>>>> wrote: >>>>>> >>>>>>> Hi Lalit, >>>>>>> >>>>>>> Can you have a look at the Simple History Report? Do you see >>>>>>> indexing attempts for list items in there? >>>>>>> >>>>>>> It may be that you've filtered list items out by some other means >>>>>>> you aren't expecting, such as extensions. It might also be worth t= rying to >>>>>>> index to a null output connection to verify that the filtering hasn= 't been >>>>>>> done by your output connection configuration. >>>>>>> >>>>>>> Karl >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Mon, Aug 4, 2014 at 7:31 AM, lalit jangra < >>>>>>> lalit.j.jangra@gmail.com> wrote: >>>>>>> >>>>>>>> Thanks Karl, >>>>>>>> >>>>>>>> I am adding all metadata available in any list item by checking >>>>>>>> "Include All Metadata" checkbox with include as selected option. >>>>>>>> >>>>>>>> I assume this way i should get all metadata & content for a list >>>>>>>> item but i am not getting content for any list item? For some cont= ent i am >>>>>>>> not getting metadata such as modified date etc? >>>>>>>> >>>>>>>> Regards. >>>>>>>> >>>>>>>> >>>>>>>> On Sun, Aug 3, 2014 at 6:34 AM, Karl Wright >>>>>>>> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Sent from my Windows Phone >>>>>>>>> ------------------------------ >>>>>>>>> From: Wright, Karl >>>>>>>>> Sent: 8/2/2014 8:42 PM >>>>>>>>> To: Dad >>>>>>>>> Subject: FW: What all items MCF crawls in Sharepoint Lists >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Sent from my Windows Phone >>>>>>>>> ------------------------------ >>>>>>>>> From: Wright, Karl >>>>>>>>> Sent: 8/2/2014 1:31 PM >>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>> Subject: RE: What all items MCF crawls in Sharepoint Lists >>>>>>>>> >>>>>>>>> Hi Lalit, >>>>>>>>> >>>>>>>>> List items have no content except metadata, so you will need to >>>>>>>>> properly configure your metadata in order for it to be indexed. >>>>>>>>> >>>>>>>>> Most of what you describe as missing is implemented in SharePoint >>>>>>>>> as a list, so the same issue applies. >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> Karl >>>>>>>>> >>>>>>>>> Sent from my Windows Phone >>>>>>>>> ------------------------------ >>>>>>>>> From: lalit jangra >>>>>>>>> Sent: 8/2/2014 11:51 AM >>>>>>>>> To: user@manifoldcf.apache.org >>>>>>>>> Subject: What all items MCF crawls in Sharepoint Lists >>>>>>>>> >>>>>>>>> >>>>>>>>> Hello, >>>>>>>>> >>>>>>>>> I am using MCF 1.5.1 and i have configured a Sharepoint Job to >>>>>>>>> crawl all lists included in a sharepoint site. >>>>>>>>> >>>>>>>>> >>>>>>>>> I can see that job crawls all attachments such as pdf or doc >>>>>>>>> attached to items in lists but i am not able to see the list item= s to which >>>>>>>>> these documents attached. Also i could not see items such as FAQs= etc. >>>>>>>>> which do not have any documents attached to them. >>>>>>>>> >>>>>>>>> Is it normal behavior or am i missing anything? By default what >>>>>>>>> all items got indexed in lists? >>>>>>>>> >>>>>>>>> Also to get all such items such as news items, announcements >>>>>>>>> without attachments, FAQs without any attachments etc., what step= s should i >>>>>>>>> take? >>>>>>>>> >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Lalit. >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Regards, >>>>>>>> Lalit. >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> Lalit. >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Regards, >>>> Lalit. >>>> >>> >>> >> >> >> -- >> Regards, >> Lalit. >> > > --=20 Regards, Lalit. --089e013a29da0a07d704ffd9cc26 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Karl,

I only posted URLs last time. P= lease find full logs below for some of contents. I hope this is what requir= ed here.

1101376 [http-bio-8080-exec-36] INFO=C2=A0 org.apache.solr.update.processor.LogUpdateProcessor=C2=A0 =E2=80=93 [collec= tion1] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D0&literal.deny_token_document=3DSharepoint= AuthGroup:DEAD_AUTHORITY&literal.Attachments=3D0&literal.Data=3D&am= p;literal.DocIcon=3D&resource.name= =3Ddocname&literal.allow_token_document=3DSharepointAuthGroup:GApprover= s&literal.allow_token_document=3DSharepointAuthGroup:GControlled%2BDocu= ments%2BMembers&literal.allow_token_document=3DSharepointAuthGroup:GCon= trolled%2BDocuments%2BOwners&literal.allow_token_document=3DSharepointA= uthGroup:GControlled%2BDocuments%2BVisitors&literal.allow_token_documen= t=3DSharepointAuthGroup:GDesigners&literal.allow_token_document=3DShare= pointAuthGroup:GHierarchy%2BManagers&literal.allow_token_document=3DSha= repointAuthGroup:GRestricted%2BReaders&literal.allow_token_document=3DS= harepointAuthGroup:GThe%2BWell%2BPortal%2BOwners&literal.allow_token_do= cument=3DSharepointAuthGroup:GThe%2BWell%2BVisitors&literal.allow_token= _document=3DSharepointAuthGroup:GViewers&literal.allow_token_document= =3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctrue&literal.allow_token_doc= ument=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-1538428= 1-2988178474-1619&literal.allow_token_document=3DSharepointAuthGroup:Uc= %253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178474-6296&literal.= allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-263= 0432783-15384281-2988178474-6297&literal.WorkflowTemplate=3D{8ad4d8f0-9= 3a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&version=3D= 2.2&literal.ItemChildCount=3D0&literal.GUID=3D{0146F19F-3703-4989-B= 5C4-AB2A0D149D2A}&literal.LinkTitleNoMenu=3D&literal.Item=3D12&= literal.Description=3DTask+assigned+to+Geraldine+Davis+was+approved+by+Gera= ldine+Davis.+Comments:+Approved+Prior+to+publishing+in+The+Well&literal= .List=3D{3c662220-9577-406b-867a-a7bda053842d}&literal.Edit=3D&lite= ral.WorkflowInstance=3D{837462c8-a1db-4dbf-9ac1-51f8c001b6d6}&literal.id=3Dhttp://testir= ishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID%3D613&l= iteral.Created=3D2014-01-03+11:03:57&literal._UIVersionString=3D1.0&= ;literal.Outcome=3DApproved+by+Geraldine+Davis&wt=3Dxml&literal.Gro= up=3D0&literal.Modified=3D2014-01-03+11:03:57&literal.Author=3DSyst= em+Account&literal.User=3DGeraldine+Davis&literal.WorkflowAssociati= on=3D{919e1558-a8f3-44af-9803-b95a16876236}&literal.lcf_metadata_id=3D6= 13&literal.Occurred=3D2014-01-03+11:03:56&literal.Event=3D6&lit= eral.Editor=3DSystem+Account&literal.ContentType=3DWorkflow+History= } {add=3D[htt= p://testirishwaterportal/kbase/cd/Lists/Workflow History/DispForm.aspx?= ID=3D613 (1475502859537612800)]} 0 1

1101397 [http-bio-8080-exec-36] INFO=C2=A0 org.apache.solr.update.processor.LogUpdateProcessor=C2=A0 =E2=80=93 [collec= tion1] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D0&literal.deny_token_document=3DSharepoint= AuthGroup:DEAD_AUTHORITY&literal.Attachments=3D0&literal.Data=3D&am= p;literal.DocIcon=3D&resource.name= =3Ddocname&literal.allow_token_document=3DSharepointAuthGroup:GApprover= s&literal.allow_token_document=3DSharepointAuthGroup:GControlled%2BDocu= ments%2BMembers&literal.allow_token_document=3DSharepointAuthGroup:GCon= trolled%2BDocuments%2BOwners&literal.allow_token_document=3DSharepointA= uthGroup:GControlled%2BDocuments%2BVisitors&literal.allow_token_documen= t=3DSharepointAuthGroup:GDesigners&literal.allow_token_document=3DShare= pointAuthGroup:GHierarchy%2BManagers&literal.allow_token_document=3DSha= repointAuthGroup:GRestricted%2BReaders&literal.allow_token_document=3DS= harepointAuthGroup:GThe%2BWell%2BPortal%2BOwners&literal.allow_token_do= cument=3DSharepointAuthGroup:GThe%2BWell%2BVisitors&literal.allow_token= _document=3DSharepointAuthGroup:GViewers&literal.allow_token_document= =3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctrue&literal.allow_token_doc= ument=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-1538428= 1-2988178474-1619&literal.allow_token_document=3DSharepointAuthGroup:Uc= %253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178474-6296&literal.= allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-263= 0432783-15384281-2988178474-6297&literal.WorkflowTemplate=3D{8ad4d8f0-9= 3a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&version=3D= 2.2&literal.ItemChildCount=3D0&literal.GUID=3D{4F51B03D-1D2D-44C9-B= C8E-0552F5BC1640}&literal.LinkTitleNoMenu=3D&literal.Item=3D36&= literal.Description=3DApproval+was+completed.&literal.List=3D{33ae8f1c-= a4f9-49d4-9bd0-ad2bdea6fc4d}&literal.Edit=3D&literal.WorkflowInstan= ce=3D{bee13e22-4880-49e7-a9b8-50e22f0453a1}&literal.id=3Dhttp://testirishwaterportal/kbase/cd/L= ists/Workflow+History/DispForm.aspx?ID%3D940&literal.Created=3D2014-01-= 10+12:09:27&literal._UIVersionString=3D1.0&literal.Outcome=3DApprov= al+on+IW-HSQE-SOP-024+has+successfully+completed.+All+participants+have+com= pleted+their+tasks.&wt=3Dxml&literal.Group=3D0&literal.Modified= =3D2014-01-10+12:09:27&literal.Author=3DSystem+Account&literal.User= =3DJulie+Curtin&literal.WorkflowAssociation=3D{1e02d877-6a8d-4d9f-8a3c-= 7d46b771becb}&literal.lcf_metadata_id=3D940&literal.Occurred=3D2014= -01-10+12:09:26&literal.Event=3D2&literal.Editor=3DSystem+Account&a= mp;literal.ContentType=3DWorkflow+History} {add=3D[htt= p://testirishwaterportal/kbase/cd/Lists/Workflow History/DispForm.aspx?= ID=3D940 (1475502859560681472)]} 0 0

=C2=A0

1101401 [http-bio-8080-exec-15] INFO=C2=A0 org.apache.solr.update.processor.LogUpdateProcessor=C2=A0 =E2=80=93 [collec= tion1] webapp=3D/solr path=3D/update/extract params=3D{literal.Duration=3D806027384.000000&literal.deny_token_docume= nt=3DSharepointAuthGroup:DEAD_AUTHORITY&literal.Attachments=3D0&lit= eral.Data=3D&literal.DocIcon=3D&re= source.name=3Ddocname&literal.allow_token_document=3DSharepointAuth= Group:GApprovers&literal.allow_token_document=3DSharepointAuthGroup:GCo= ntrolled%2BDocuments%2BMembers&literal.allow_token_document=3DSharepoin= tAuthGroup:GControlled%2BDocuments%2BOwners&literal.allow_token_documen= t=3DSharepointAuthGroup:GControlled%2BDocuments%2BVisitors&literal.allo= w_token_document=3DSharepointAuthGroup:GDesigners&literal.allow_token_d= ocument=3DSharepointAuthGroup:GHierarchy%2BManagers&literal.allow_token= _document=3DSharepointAuthGroup:GRestricted%2BReaders&literal.allow_tok= en_document=3DSharepointAuthGroup:GThe%2BWell%2BPortal%2BOwners&literal= .allow_token_document=3DSharepointAuthGroup:GThe%2BWell%2BVisitors&lite= ral.allow_token_document=3DSharepointAuthGroup:GViewers&literal.allow_t= oken_document=3DSharepointAuthGroup:Uc%253A0%2528.s%257Ctrue&literal.al= low_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-26304= 32783-15384281-2988178474-1619&literal.allow_token_document=3DSharepoin= tAuthGroup:Uc%253A0%252B.w%257Cs-1-5-21-2630432783-15384281-2988178474-6296= &literal.allow_token_document=3DSharepointAuthGroup:Uc%253A0%252B.w%257= Cs-1-5-21-2630432783-15384281-2988178474-6297&literal.WorkflowTemplate= =3D{8ad4d8f0-93a7-4941-9657-cf3706f00409}&literal.FolderChildCount=3D0&= amp;version=3D2.2&literal.ItemChildCount=3D0&literal.GUID=3D{A749C6= D8-A176-4DA4-8DFF-5927046DDC2E}&literal.LinkTitleNoMenu=3D&literal.= Item=3D198&literal.Description=3DWorkflow+Approve+Template+Document+was= +canceled+by+System+Account.&literal.List=3D{4cd670da-118d-4611-887a-11= de0bb6baa9}&literal.Edit=3D&literal.WorkflowInstance=3D{f3c924db-62= 89-425d-978d-4bc14d616c3d}&literal.id= =3Dh= ttp://testirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID= %3D3365&literal.Created=3D2014-05-19+14:19:49&literal._UIVersionStr= ing=3D1.0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&lit= eral.Modified=3D2014-05-19+14:19:49&literal.Author=3DSystem+Account&= ;literal.User=3DSystem+Account&literal.WorkflowAssociation=3D{7791ab09-= 0117-4a78-a14e-e5aee9b40d78}&literal.lcf_metadata_id=3D3365&literal= .Occurred=3D2014-05-19+14:19:48&literal.Event=3D3&literal.Editor=3D= System+Account&literal.ContentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/kbase/cd/Lists= /Workflow History/DispForm.aspx?ID=3D3365 (1475502859564875776)]} 0 0

@=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0@=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0




On = Mon, Aug 4, 2014 at 6:22 PM, Karl Wright <daddywri@gmail.com> wrote:
Hi Lalit,

=
Solr is clearly indexing your list items.=C2=A0 But I don't see a= ny ACLs.=C2=A0 What is your allowAttributeName and denyAttributeName set to= for the Solr connection?=C2=A0 The default is allow_token_XXX and deny_tok= en_XXX.

Karl=


On Mon, Aug 4, 2014 at = 8:40 AM, lalit jangra <lalit.j.jangra@gmail.com> wrot= e:
Thanks Karl,

Please find below some of URLs from solr logs.

http://test= irishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID%3D792&= ;literal.Created=3D2014-01-06+14:00:45&literal._UIVersionString=3D1.0&a= mp;literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modifi= ed=3D2014-01-06+14:00:45&literal.Author=3DSystem+Account&literal.Us= er=3DGeraldine+Davis&literal.WorkflowAssociation=3D{7791ab09-0117-4a78-= a14e-e5aee9b40d78}&literal.lcf_metadata_id=3D792&literal.Occurred= =3D2014-01-06+14:00:44&literal.Event=3D1&literal.Editor=3DSystem+Ac= count&literal.ContentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/kb= ase/cd/Lists/Workflow History/DispForm.aspx?ID=3D792 (1475502859497766912)]} 0 0

=C2=A0

http://test= irishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID%3D561&= ;literal.Created=3D2014-01-02+17:15:58&literal._UIVersionString=3D1.0&a= mp;literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modifi= ed=3D2014-01-02+17:15:58&literal.Author=3DSystem+Account&literal.Us= er=3DGeraldine+Davis&literal.WorkflowAssociation=3D{7791ab09-0117-4a78-= a14e-e5aee9b40d78}&literal.lcf_metadata_id=3D561&literal.Occurred= =3D2014-01-02+17:15:57&literal.Event=3D1&literal.Editor=3DSystem+Ac= count&literal.ContentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/kb= ase/cd/Lists/Workflow History/DispForm.aspx?ID=3D561 (1475502859497766913)]} 0 0

=C2=A0

http://te= stirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID%3D3270&= amp;literal.Created=3D2014-05-08+17:34:58&literal._UIVersionString=3D1.= 0&literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Mod= ified=3D2014-05-08+17:34:58&literal.Author=3DSystem+Account&literal= .User=3DSystem+Account&literal.WorkflowAssociation=3D{0c553c29-0e6a-441= 1-b834-8bf1cc02eb2e}&literal.lcf_metadata_id=3D3270&literal.Occurre= d=3D2014-05-08+17:34:57&literal.Event=3D10&literal.Editor=3DSystem+= Account&literal.ContentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/k= base/cd/Lists/Workflow History/DispForm.aspx?ID=3D3270 (1475502859521884160)]} 0 1

=C2=A0

http://testirishwaterportal/kbase/cd/Lists/Workflow+History= /DispForm.aspx?ID%3D613&literal.Created=3D2014-01-03+11:03:57&liter= al._UIVersionString=3D1.0&literal.Outcome=3DApproved+by+Geraldine+Davis= &wt=3Dxml&literal.Group=3D0&literal.Modified=3D2014-01-03+11:03= :57&literal.Author=3DSystem+Account&literal.User=3DGeraldine+Davis&= amp;literal.WorkflowAssociation=3D{919e1558-a8f3-44af-9803-b95a16876236}&am= p;literal.lcf_metadata_id=3D613&literal.Occurred=3D2014-01-03+11:03:56&= amp;literal.Event=3D6&literal.Editor=3DSystem+Account&literal.Conte= ntType=3DWorkflow+History} {add=3D[http://testirishwaterportal/kb= ase/cd/Lists/Workflow History/DispForm.aspx?ID=3D613 (1475502859537612800)]} 0 1

=C2=A0

http://testirishwaterportal/kbase/cd/Lists/Workflow+History/Dis= pForm.aspx?ID%3D940&literal.Created=3D2014-01-10+12:09:27&literal._= UIVersionString=3D1.0&literal.Outcome=3DApproval+on+IW-HSQE-SOP-024+has= +successfully+completed.+All+participants+have+completed+their+tasks.&w= t=3Dxml&literal.Group=3D0&literal.Modified=3D2014-01-10+12:09:27&am= p;literal.Author=3DSystem+Account&literal.User=3DJulie+Curtin&liter= al.WorkflowAssociation=3D{1e02d877-6a8d-4d9f-8a3c-7d46b771becb}&literal= .lcf_metadata_id=3D940&literal.Occurred=3D2014-01-10+12:09:26&liter= al.Event=3D2&literal.Editor=3DSystem+Account&literal.ContentType=3D= Workflow+History} {add=3D[http://testirishwaterportal/kb= ase/cd/Lists/Workflow History/DispForm.aspx?ID=3D940 (1475502859560681472)]} 0 0

=C2=A0

http://tes= tirishwaterportal/kbase/cd/Lists/Workflow+History/DispForm.aspx?ID%3D3365&a= mp;literal.Created=3D2014-05-19+14:19:49&literal._UIVersionString=3D1.0= &literal.Outcome=3D&wt=3Dxml&literal.Group=3D0&literal.Modi= fied=3D2014-05-19+14:19:49&literal.Author=3DSystem+Account&literal.= User=3DSystem+Account&literal.WorkflowAssociation=3D{7791ab09-0117-4a78= -a14e-e5aee9b40d78}&literal.lcf_metadata_id=3D3365&literal.Occurred= =3D2014-05-19+14:19:48&literal.Event=3D3&literal.Editor=3DSystem+Ac= count&literal.ContentType=3DWorkflow+History} {add=3D[http://testirishwaterportal/k= base/cd/Lists/Workflow History/DispForm.aspx?ID=3D3365 (1475502859564875776)]} 0 0




On Mon, Aug 4, 2014 at 6:02 PM, Karl Wright <daddywri@gmail.com> wrote:
Hi Lalit,

You do not need to try the null output connection; the report indicates th= at your list items are in fact being sent to Solr.=C2=A0 So the next step i= s to look at the Solr log.=C2=A0 There should be an INFO statement in the l= og for every list item, which includes a URL.=C2=A0 The URL should have the= metadata for the list item in it.=C2=A0 Can you send a couple of those to = us please.

Karl


On Mon, Aug 4, 2014 at 8:22 AM, lalit jang= ra <lalit.j.jangra@gmail.com> wrote:
Hi Karl,

<= /div>I can see list items getting rendered in simple history report, please= see attached screenshot.

I have not tried null connection till but planning to do it very = soon.


On Mon, Aug 4, 2014 at 5:47 PM, Karl Wright <daddywri@gmail.com>= ; wrote:
Hi Lalit,

From your response it is not clear to me whether you see any list items ap= pearing in the simple history report.=C2=A0 Nor is it clear whether you see= list items in a simple history report going against a null output connecti= on.=C2=A0 Can you clarify this please?=C2=A0 If you don't know what a l= ist item would look like in the history, please just include a screen shot.=

Thanks,
Karl


<= br>
On Mon, Aug 4, 2014 at 8:13 AM, lalit jangra = <lalit.j.jangra@gmail.com> wrote:
Thanks Karl,
<= br>I checked simple history to see number of different documents as well as= content types getting indexed from lists.

Also I have customized SharePointRepository.java to add couple of= custom metadata such as content url, modifier etc. but i assume these meta= data will be available for all items including lists. Also i can see some i= tems in solr index which do not have all metadata fields attached to them. = But i am not filtering on basis of extensions &=C2=A0 crawling all item= s needed.

Since start, i could see any content items such as pdf or doc or = xls attached to any list item getting indexed well but that item itself is = missing.

Regards.




On Mon, Aug 4, 2014 at 5:07 PM, Karl Wri= ght <daddywri@gmail.com> wrote:
Hi Lalit,

Can you have a look at the Sim= ple History Report?=C2=A0 Do=C2=A0 you see indexing attempts for list items= in there?

It may be that you've filtered list items out by some= other means you aren't expecting, such as extensions.=C2=A0 It might a= lso be worth trying to index to a null output connection to verify that the= filtering hasn't been done by your output connection configuration.

Karl


On Mon, Aug 4, 2014 at 7:31 AM, lalit jang= ra <lalit.j.jangra@gmail.com> wrote:
Thanks Karl,

I = am adding all metadata available in any list item by checking "Include= All Metadata" checkbox with include as selected option.

I assume this way i should get all metadata & content for a list it= em but i am not getting content for any list item? For some content i am no= t getting metadata such as modified date etc?

Regards.


On Sun, Aug 3, 2014 at 6:34 AM, Karl Wright <dad= dywri@gmail.com> wrote:


Sent from my Windows Phone
From: Wright, Karl
Sent: 8/2/2014 8:42 PM
To: Dad
Subject: FW: What all items MCF crawls in Sharepoint Lists



Sent from my Windows Phone
From: Wright,= Karl
Sent: 8/2/201= 4 1:31 PM
To: user@manifoldcf.ap= ache.org
Subject: RE: Wha= t all items MCF crawls in Sharepoint Lists

Hi Lalit,

List items have no content except metadata, so you will need to properly co= nfigure your metadata in order for it to be indexed.

Most of what you describe as missing is implemented in SharePoint as a list= , so the same issue applies.

Thanks
Karl

Sent from my Windows Phone
From: lalit j= angra
Sent: 8/2/201= 4 11:51 AM
To: user@manifoldcf.ap= ache.org
Subject: What al= l items MCF crawls in Sharepoint Lists


Hello,

I am using MCF 1.5.1 and i have configured a Sharepoint Job to crawl all li= sts included in a sharepoint site.


I can see that job crawls all attachments such as pdf or doc attached to it= ems in lists but i am not able to see the list items to which these documen= ts attached. Also i could not see items such as FAQs etc. which do not have= any documents attached to them.

Is it normal behavior or am i missing anything? By default what all items g= ot indexed in lists?

Also to get all such items such as news items, announcements without attach= ments, FAQs without any attachments etc., what steps should i take?
=C2=A0
=C2=A0
Regards,
Lalit.



--
Regards,
Lalit.




= --
Regards,
Lalit.




= --
Regards,
Lalit.




= --
Regards,
Lalit.



--
Regards,
Lalit.
--089e013a29da0a07d704ffd9cc26--