Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 061A611042 for ; Tue, 23 Sep 2014 19:12:24 +0000 (UTC) Received: (qmail 19416 invoked by uid 500); 23 Sep 2014 19:12:23 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 19364 invoked by uid 500); 23 Sep 2014 19:12:23 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 19354 invoked by uid 99); 23 Sep 2014 19:12:23 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Sep 2014 19:12:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of daddywri@gmail.com designates 209.85.213.44 as permitted sender) Received: from [209.85.213.44] (HELO mail-yh0-f44.google.com) (209.85.213.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Sep 2014 19:11:57 +0000 Received: by mail-yh0-f44.google.com with SMTP id i57so1307461yha.17 for ; Tue, 23 Sep 2014 12:11:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=r/YCURE1Pp3UIfNfssheriwHBIj2KmoW3+e0nCEwZzo=; b=MOj3TdOyDtdmVbA954iwPfj9TNwqU6CPH18hFgiUjOUVPZIYgC50It9xA5+dFd49a/ p17eeyxHZ5QNQEz/9ePnMmigZ50leLjTEaAhZ09ViYsFXt5eeRtV4Wpv64CBN9jfjubO dXjc1FKzakB6JIguA9DuPCCvKR/J+vJR6K02Yx6uAQ0eVCLgjIUUBALKp0FRTyFT7KSf 4RgarEFizCLo8SEm/amylRrHpkFSAR0fU0pok6xUHOactcGOezaxU3d+pxqNwvR7Nqqr T/m1vFR8RJNBBy0D7GrrZ0cTNYacFXRXE0b/e6nZ4YkOXqH2YHmM6nRTd8IUtf0pQH0d AquA== MIME-Version: 1.0 X-Received: by 10.236.2.164 with SMTP id 24mr1744949yhf.126.1411499515579; Tue, 23 Sep 2014 12:11:55 -0700 (PDT) Received: by 10.170.61.149 with HTTP; Tue, 23 Sep 2014 12:11:55 -0700 (PDT) In-Reply-To: <1411499375.2875.YahooMailNeo@web141502.mail.bf1.yahoo.com> References: <1411485513.44895.YahooMailNeo@web141502.mail.bf1.yahoo.com> <1411499375.2875.YahooMailNeo@web141502.mail.bf1.yahoo.com> Date: Tue, 23 Sep 2014 15:11:55 -0400 Message-ID: Subject: Re: JCIFS error while crawling DFS share From: Karl Wright To: "user@manifoldcf.apache.org" , Kambiz Niktabar Content-Type: multipart/alternative; boundary=089e011823aa3a165d0503c0574e X-Virus-Checked: Checked by ClamAV on apache.org --089e011823aa3a165d0503c0574e Content-Type: text/plain; charset=UTF-8 Hi Kambiz, I don't know what particular MSFT permission controls this access. If I were you, I'd start with "full control" and work backwards. You don't need write permission for the connector, but you *do* need the ability to query for acls for documents, folders, and shares. Karl On Tue, Sep 23, 2014 at 3:09 PM, Kambiz Niktabar wrote: > Hi Karl, > > Thanks for the info. What kind of permission is required to get share > security? I tried with an account which has modify access to the folder but > got the same error. Is Full Control access required? Please advise. > > Regards > Kambiz > > ------------------------------ > *From:* Karl Wright > *To:* "user@manifoldcf.apache.org" ; Kambiz > Niktabar > *Sent:* Tuesday, September 23, 2014 5:54 PM > *Subject:* Re: JCIFS error while crawling DFS share > > Hi Kambiz, > > The problem is that your user doesn't have permissions to obtain the share > security for the documents in question. The ability to obtain ACLs for a > document is critical in order to be able to enforce document security at > search time. > > Thanks, > Karl > > > > > On Tue, Sep 23, 2014 at 11:18 AM, Kambiz Niktabar > wrote: > > Hi, > > After the attempt for crawling content on DFS share was unsuccessful, I > tried crawling it through the actual server name but I got "Access is > denied" message although the user has access to the shared folder and > document. > Here is the debug log for the connector. Any idea what the problem is ? > > Regards > Kambiz Niktabar > > > DEBUG 2014-09-23 11:59:03,449 (Startup thread) - Connecting to: smb:// > domain.net;user:@server1/ > DEBUG 2014-09-23 11:59:03,480 (Startup thread) - Seed = > 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,683 (Worker thread '1') - JCIFS: getVersions(): > documentIdentifiers[0] is: smb://server1/folder1/folder2/FT_Test/ > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: In checkInclude > for 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Matching > startpoint 'smb://server1/folder1/folder2/FT_Test/' against actual > 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Startpoint > found! > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Startpoint: > always included > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Leaving > checkInclude for 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Processing > 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: > 'smb://server1/folder1/folder2/FT_Test/' is a directory > DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: In checkInclude > for 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc' > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Matching > startpoint 'smb://server1/folder1/folder2/FT_Test/' against actual > 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Startpoint > found! > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Checking '*' > against '/Test1_Shared.doc' > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Match found. > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Leaving > checkInclude for 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc' > DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: Recorded path > is 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc' and is included. > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: getVersions(): > documentIdentifiers[0] is: > smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: In checkInclude > for 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc' > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: Matching > startpoint 'smb://server1/folder1/folder2/FT_Test/' against actual > 'smb://server1/folder1/folder2/FT_Test/' > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: Startpoint > found! > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: Checking '*' > against '/Test1_Shared.doc' > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: Match found. > DEBUG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: Leaving > checkInclude for 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc' > WARN 2014-09-23 11:59:07,527 (Worker thread '7') - JCIFS: Possibly > transient exception detected on attempt 1 while getting share security: > Access is denied. > jcifs.smb.SmbException: Access is denied. > at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2945) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDriveConnector.java:2552) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.describeDocumentSecurity(SharedDriveConnector.java:1070) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getDocumentVersions(SharedDriveConnector.java:560) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:469) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:435) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:358) > at > org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:380) > WARN 2014-09-23 11:59:07,527 (Worker thread '7') - JCIFS: Possibly > transient exception detected on attempt 2 while getting share security: > Access is denied. > jcifs.smb.SmbException: Access is denied. > at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2945) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDriveConnector.java:2552) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.describeDocumentSecurity(SharedDriveConnector.java:1070) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getDocumentVersions(SharedDriveConnector.java:560) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:469) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:435) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:358) > at > org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:380) > WARN 2014-09-23 11:59:07,527 (Worker thread '7') - JCIFS: Possibly > transient exception detected on attempt 3 while getting share security: > Access is denied. > jcifs.smb.SmbException: Access is denied. > at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2945) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDriveConnector.java:2552) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.describeDocumentSecurity(SharedDriveConnector.java:1070) > at > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.getDocumentVersions(SharedDriveConnector.java:560) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:469) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(BaseRepositoryConnector.java:435) > at > org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:358) > at > org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:380) > WARN 2014-09-23 11:59:07,527 (Worker thread '7') - JCIFS: Access > exception when getting document version for > smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc - skipping > > > > > > --089e011823aa3a165d0503c0574e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Kambiz,

I don't know what particu= lar MSFT permission controls this access.=C2=A0 If I were you, I'd star= t with "full control" and work backwards.=C2=A0 You don't nee= d write permission for the connector, but you *do* need the ability to quer= y for acls for documents, folders, and shares.

Karl


On Tue, Sep 23, 2014= at 3:09 PM, Kambiz Niktabar <niktabar@yahoo.com> wrote:
Hi Karl,

=
Thanks fo= r the info. What kind of permission is required to get share security? I tr= ied with an account which has modify access to the folder but got the same = error. Is Full Control access required? Please advise.

Regards
Kambiz

From:= Karl Wright <daddywri@gmail.com>
To: "user@manifoldcf.apache.org" <user@manifoldcf.apache.org>; Kambi= z Niktabar <nikt= abar@yahoo.com>
Sent: Tuesday, September 23, 2014 5:54 PM
Subject: Re: JCIFS error while crawling DFS share

<= div dir=3D"ltr">Hi Kambiz,

The problem= is that your user doesn't have permissions to obtain the share securit= y for the documents in question.=C2=A0 The ability to obtain ACLs for a doc= ument is critical in order to be able to enforce document security at searc= h time.

Thanks,
Karl=



On Tue, Sep 23, 2014 at 11:18 AM, Kambiz Niktabar <niktabar@yahoo.com> wrote:
Hi,

After the attempt for crawling content on D= FS share was unsuccessful, I tried crawling it through the actual server na= me but I got "Access is denied" message although the user has acc= ess to the shared folder and document.
Here is the debug log for the connector. Any i= dea what the problem is ?

Regards
Kambiz Niktabar


DEBUG 2014-09-23 11:59:03,449 (Startup th= read) - Connecting to: smb://domain.net;user:<password>@server1/
DEBUG 2014-09-23 11:59:03,480 (Startup th= read) - Seed =3D 'smb://server1/folder1/folder2/FT_Test/'
DEBUG 2014-09-23 11:59:05,683 (Work= er thread '1') - JCIFS: getVersions(): documentIdentifiers[0] is: s= mb://server1/folder1/folder2/FT_Test/
DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') - JCI= FS: In checkInclude for 'smb://server1/folder1/folder2/FT_Test/'
DEBUG 2014-09-23 11:59:05,76= 1 (Worker thread '1') - JCIFS: Matching startpoint 'smb://serve= r1/folder1/folder2/FT_Test/' against actual 'smb://server1/folder1/= folder2/FT_Test/'
DEBU= G 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: Startpoint found!
DEBUG 2014-09-23 1= 1:59:05,761 (Worker thread '1') - JCIFS: Startpoint: always include= d
DEBUG 2014-09-23 11:59:0= 5,761 (Worker thread '1') - JCIFS: Leaving checkInclude for 'sm= b://server1/folder1/folder2/FT_Test/'
DEBUG 2014-09-23 11:59:05,761 (Worker thread '1') -= JCIFS: Processing 'smb://server1/folder1/folder2/FT_Test/'
DEBUG 2014-09-23 11:59:05,761 (Wo= rker thread '1') - JCIFS: 'smb://server1/folder1/folder2/FT_Tes= t/' is a directory
DEB= UG 2014-09-23 11:59:05,761 (Worker thread '1') - JCIFS: In checkInc= lude for 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc'
DEBUG 2014-09-23 11:59:05,7= 77 (Worker thread '1') - JCIFS: Matching startpoint 'smb://server1/folder1/folder2/FT_Test/'= ; against actual 'smb://server1/folder1/folder2/FT_Test/'
DEBUG 2014-09-23 11:59:05,777 (Work= er thread '1') - JCIFS: Startpoint found!
DEBUG 2014-09-23 11:59:05,777 (Worker thread '1= ') - JCIFS: Checking '*' against '/Test1_Shared.doc'
DEBUG 2014-09-23 11:59:05,77= 7 (Worker thread '1') - JCIFS: Match found.
DEBUG 2014-09-23 11:59:05,777 (Worker thread '= ;1') - JCIFS: Leaving checkInclude for 'smb://server1/folder1/folde= r2/FT_Test/Test1_Shared.doc'
DEBUG 2014-09-23 11:59:05,777 (Worker thread '1') - JCIFS: R= ecorded path is 'smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc= ' and is included.
DEB= UG 2014-09-23 11:59:07,495 (Worker thread '7') - JCIFS: getVersions()= : documentIdentifiers[0] is: smb://server1/folder1/folder2/FT_Test/Test1_Sh= ared.doc
DEBUG 2014-09-23 = 11:59:07,495 (Worker thread '7') - JCIFS: In checkInclude for '= smb://server1/folder1/folder2/FT_Test/Test1_Shared.doc'
DEBUG 2014-09-23 11:59:07,495 (Worker thr= ead '7') - JCIFS: Matching startpoint 'smb://server1/folder1/fo= lder2/FT_Test/' against actual 'smb://server1/folder1/folder2/FT_Te= st/'
DEBUG 2014-09-23 = 11:59:07,495 (Worker thread '7') - JCIFS: Startpoint found!
DEBUG 2014-09-23 11:59:07,495 (Wo= rker thread '7') - JCIFS: Checking '*' against '/Test1_= Shared.doc'
DEBUG 2014= -09-23 11:59:07,495 (Worker thread '7') - JCIFS: Match found.
=
DEBUG 2014-09-23 11:59:07,495 (= Worker thread '7') - JCIFS: Leaving checkInclude for 'smb://ser= ver1/folder1/folder2/FT_Test/Test1_Shared.doc'
=C2=A0WARN 2014-09-23 11:59:07,527 (Worker thread = '7') - JCIFS: Possibly transient exception detected on attempt 1 wh= ile getting share security: Access is denied.
jcifs.smb.SmbException: Access is denied.
<= /span>at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2945)
= at org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.g= etFileShareSecurity(SharedDriveConnector.java:2552)
at o= rg.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.des= cribeDocumentSecurity(SharedDriveConnector.java:1070)
at= org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.g= etDocumentVersions(SharedDriveConnector.java:560)
at org= .apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVe= rsions(BaseRepositoryConnector.java:469)
at org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocume= ntVersions(BaseRepositoryConnector.java:435)
at org.apac= he.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(B= aseRepositoryConnector.java:358)
at org.apache.manifoldc= f.crawler.system.WorkerThread.run(WorkerThread.java:380)
=C2=A0WARN 2014-09-23 11:59:07,527 (Worker t= hread '7') - JCIFS: Possibly transient exception detected on attemp= t 2 while getting share security: Access is denied.
jcifs.smb.SmbException: Access is denied.
at jcifs.smb.SmbFile.getShareSecurity(SmbFile.java:2945)
a= t org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.= getFileShareSecurity(SharedDriveConnector.java:2552)
at = org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.de= scribeDocumentSecurity(SharedDriveConnector.java:1070)
a= t org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.= getDocumentVersions(SharedDriveConnector.java:560)
at org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocume= ntVersions(BaseRepositoryConnector.java:469)
at org.apac= he.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersion= s(BaseRepositoryConnector.java:435)
at org.apache.manifo= ldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseReposi= toryConnector.java:358)
at org.apache.manifoldcf.crawler= .system.WorkerThread.run(WorkerThread.java:380)
=C2=A0WARN 2014-09-23 11:59:07,527 (Worker thread = 9;7') - JCIFS: Possibly transient exception detected on attempt 3 while= getting share security: Access is denied.
jcifs.smb.SmbExce= ption: Access is denied.
<= span style=3D"white-space:pre-wrap"> at jcifs.smb.SmbFile.getShareSe= curity(SmbFile.java:2945)
= at org.apache.manifoldcf.crawl= er.connectors.sharedrive.SharedDriveConnector.getFileShareSecurity(SharedDr= iveConnector.java:2552)
at org.apache.manifoldcf.crawler= .connectors.sharedrive.SharedDriveConnector.describeDocumentSecurity(Shared= DriveConnector.java:1070)
= at org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.g= etDocumentVersions(SharedDriveConnector.java:560)
at org= .apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVe= rsions(BaseRepositoryConnector.java:469)
at org.apache.m= anifoldcf.crawler.connectors.BaseRepositoryConnector.getDocumentVersions(Ba= seRepositoryConnector.java:435)
at org.apache.manifoldcf= .crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepository= Connector.java:358)
at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:38= 0)
=C2=A0WARN 2014-09-23 1= 1:59:07,527 (Worker thread '7') - JCIFS: Access exception when gett= ing document version for smb://server1/folder1/folder2/FT_Test/Test1_Shared= .doc - skipping





=

--089e011823aa3a165d0503c0574e--