manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Thomas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CONNECTORS-1512) Documentum Connector throws NPE when a job is run after a document is deleted from the repository
Date Sun, 01 Jul 2018 10:48:00 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529047#comment-16529047
] 

James Thomas commented on CONNECTORS-1512:
------------------------------------------

I have followed your steps (without patching) and apparently successfully built - I got a
bunch of jars in the dist directory.

These are the tarballs I used:

{code:java}
$ wget http://apache.mirror.anlx.net/manifoldcf/apache-manifoldcf-2.10/apache-manifoldcf-2.10-src.tar.gz
$  wget http://mirrors.ukfast.co.uk/sites/ftp.apache.org/manifoldcf/apache-manifoldcf-2.10/apache-manifoldcf-2.10-lib.tar.gz
{code}

I then tried to patch, but it's not applying:

{code:java}
$  wget https://issues.apache.org/jira/secure/attachment/12929706/CONNECTORS-1512.patch
--2018-07-01 11:36:34--  https://issues.apache.org/jira/secure/attachment/12929706/CONNECTORS-1512.patch
Resolving issues.apache.org... 207.244.88.139
Connecting to issues.apache.org|207.244.88.139|:443... connected.
HTTP request sent, awaiting response... 200 200
Length: 2562 (2.5K) [text/plain]
Saving to: “CONNECTORS-1512.patch”

100%[====================================================================================================================================================>]
2,562       --.-K/s   in 0s

2018-07-01 11:36:34 (36.0 MB/s) - “CONNECTORS-1512.patch” saved [2562/2562]

$  patch -p0 < CONNECTORS-1512.patch
(Stripping trailing CRs from patch.)
patching file connectors/documentum/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/DCTM/DCTM.java
Hunk #1 FAILED at 1396.
Hunk #2 FAILED at 1463.
2 out of 2 hunks FAILED -- saving rejects to file connectors/documentum/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/DCTM/DCTM.java.rej
(Stripping trailing CRs from patch.)
patching file connectors/documentum/implementation/src/main/java/org/apache/manifoldcf/crawler/common/DCTM/DocumentumImpl.java
Hunk #1 FAILED at 331.
1 out of 1 hunk FAILED -- saving rejects to file connectors/documentum/implementation/src/main/java/org/apache/manifoldcf/crawler/common/DCTM/DocumentumImpl.java.rej

$  md5sum connectors/documentum/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/DCTM/DCTM.java
a8669dbba38ee038353b1ed0b0bb4302  connectors/documentum/connector/src/main/java/org/apache/manifoldcf/crawler/connectors/DCTM/DCTM.java

$  md5sum connectors/documentum/implementation/src/main/java/org/apache/manifoldcf/crawler/common/DCTM/DocumentumImpl.java
303bee1eaf32ddb871c8fa4c4db636a7  connectors/documentum/implementation/src/main/java/org/apache/manifoldcf/crawler/common/DCTM/DocumentumImpl.java
{code}

I wonder whether you're working from a revision that isn't quite the 2.10 distro? Or am I
doing something obviously wrong?

I tried -a few things with patch: -merge, -fuzz etc but I'm reluctant to monkey around with
your patch too much.

P.S. I found some inconsistency in README between the src and lib distros. Where should I
report that?




> Documentum Connector throws NPE when a job is run after a document is deleted from the
repository
> -------------------------------------------------------------------------------------------------
>
>                 Key: CONNECTORS-1512
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1512
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Documentum connector
>    Affects Versions: ManifoldCF 2.8.1, ManifoldCF 2.10
>         Environment: Documentum 16.4
> Manifold 2.10, using dfc jars 16.4
> Manifold server machine details (although also seen on a Windows-based MF 2.8.1):
> {code:java}
> $ hostnamectl
>  ...
> Chassis: vm
> Virtualization: kvm
> Operating System: CentOS Linux 7 (Core)
> CPE OS Name: cpe:/o:centos:centos:7
> Kernel: Linux 3.10.0-862.2.3.el7.x86_64
>  Architecture: x86-64
> $ java -version
> openjdk version "1.8.0_171"
> OpenJDK Runtime Environment (build 1.8.0_171-b10)
> OpenJDK 64-Bit Server VM (build 25.171-b10, mixed mode)
> {code}
> I have the following entry in properties.xml for verbose logging from connectors:
> {code:java}
> <property name="org.apache.manifoldcf.connectors" value="DEBUG"/>
> {code}
>            Reporter: James Thomas
>            Assignee: Karl Wright
>            Priority: Major
>             Fix For: ManifoldCF 2.11
>
>         Attachments: CONNECTORS-1512.patch, repro_delete.log
>
>
> I see an NPE from the Documentum Connector when I re-run a job after deleting a file
from the Documentum repository using the Documentum Administrator:
> {code:java}
> FATAL 2018-06-29T08:36:54,847 (Worker thread '5') - Error tossed: null
> java.lang.NullPointerException
>         at org.apache.manifoldcf.crawler.common.DCTM.DocumentumObjectImpl.getContentSize(DocumentumObjectImpl.java:181)
~[?:?]
>     ...
>   at org.apache.manifoldcf.crawler.connectors.DCTM.DCTM$ProcessDocumentThread.run(DCTM.java:1399)
~[?:?]
> {code}
> The job then appears not to terminate in the Manifold UI.  If the job is not aborted,
the NPE will show again after restarting the Manifold server and Documentum Connectors.
> I expect the connectors to handle deletion of source in the repository, passing the appropriate
status to the output connector, and not failing like this.
> Reproduce:
> * Configure Manifold to use Documentum Connectors to talk to a Documentum instance
> * Sanity check your configuration by 
> ** create a directory in Documentum, D, with two files F, G
> ** create a job in Manifold to take from D and write to the file system in directory
L
> ** run the job and observe that F, G appear in L
> * delete G from D in Documentum 
> ** in Documentum Administrator, right click on G and choose Delete, then OK
> * re-run your job
> * observe that the job doesn't end
> * inspect L 
> * observe that F and G are both still present
> * inspect the Manifold logs
> * observe NPE in the logs
>  
> In the log file I'll attach,  F and G are Book1.xlsx and Book1.xls



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message