Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@manifoldcf.apache.org
MIME-Version: 1.0
In-Reply-To: <CAOEToivUwH9YmT6+EwHOUkdt=pheFBZ33jp1SQkgfkN96Ag4Bw@mail.gmail.com>
References: <CAOEToivUwH9YmT6+EwHOUkdt=pheFBZ33jp1SQkgfkN96Ag4Bw@mail.gmail.com>
Date: Fri, 6 May 2016 06:55:55 -0400
Message-ID: <CALUFAGDVuXcUa05d1h3MpXHnuCDVAbNuOPK9dBMdMVZLUuTC_w@mail.gmail.com>
Subject: Re: Job with Generic Connector stop to work
From: Karl Wright <daddywri@gmail.com>
To: "user@manifoldcf.apache.org" <user@manifoldcf.apache.org>
Content-Type: multipart/alternative; boundary=94eb2c076a62995a1d05322a4d40
archived-at: Fri, 06 May 2016 10:56:00 -0000

--94eb2c076a62995a1d05322a4d40
Content-Type: text/plain; charset=UTF-8

Hi Luca,

Do you have multiple independent MCF clusters running at the same time?  It
sounds like you do: you have SP on one, and Generic on another.  If so, you
will need to be sure that the synchronization you are using (either
zookeeper or file-based) does not overlap.  Each cluster needs its own
synchronization.  If there is overlap, then doing things with one cluster
may cause the other cluster to hang.  This also means you have to have
different properties files for the two clusters, of course.

Thanks,
Karl


On Fri, May 6, 2016 at 4:32 AM, Luca Alicata <alicataluca@gmail.com> wrote:

> Hi,
> i'm using Manifold 2.2 with multi-process configuration in Jboss instance
> inside a Windows Server 2012 and i've a set of job that work with
> Sharepoint (SP) or Generic Connector (GC), that get file from a db.
> With SP i've no problem, while with GC with a lot of document (one with
> 47k and another with 60k), the Seed taking process, sometimes, not finish,
> because the agents seem to stop (although java process is still alive).
> After this, if i try to start any other job, that not start, like the
> agents are stopped.
>
> Other times, this jobs work correctly and one time together work
> correctly, running in the same moment.
>
> For information:
>
>    - On Jboss there are only Manifold and Generic Repository application.
>
>
>    - On the same Virtual Server, there is another Jboss istance, with
>    solr istance and a web application.
>
>
>    - I've check if it was a type of memory problem, but it's not the case.
>
>
>    - GC with almost 23k seed work always, at least in test that i've done.
>
>
>    - In local instance of Jboss with Manifold and Generic Rpository
>    Application, i've not keep this problem.
>
> This is the only recurrent information that i've seen on manifold.log:
> ---------------
> Connection 0.0.0.0:62755<-><ip-address>:<port> shut down
> Releasing connection
> org.apache.http.impl.conn.ManagedClientConnectionImpl@6c98c1bd
>
> ---------------
>
> Thanks,
> L. Alicata
>

--94eb2c076a62995a1d05322a4d40
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Luca,<div><br></div><div>Do you have multiple independe=
nt MCF clusters running at the same time?=C2=A0 It sounds like you do: you =
have SP on one, and Generic on another.=C2=A0 If so, you will need to be su=
re that the synchronization you are using (either zookeeper or file-based) =
does not overlap.=C2=A0 Each cluster needs its own synchronization.=C2=A0 I=
f there is overlap, then doing things with one cluster may cause the other =
cluster to hang.=C2=A0 This also means you have to have different propertie=
s files for the two clusters, of course.</div><div><br></div><div>Thanks,</=
div><div>Karl</div><div><br></div><div><br></div><div><br></div></div><div =
class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Fri, May 6, 2016 at=
 4:32 AM, Luca Alicata <span dir=3D"ltr">&lt;<a href=3D"mailto:alicataluca@=
gmail.com" target=3D"_blank">alicataluca@gmail.com</a>&gt;</span> wrote:<br=
><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1=
px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div>i&#39;m using Mani=
fold 2.2 with multi-process configuration in Jboss instance inside a Window=
s Server 2012 and i&#39;ve a set of job that work with Sharepoint (SP) or G=
eneric Connector (GC), that get file from a db.</div><div>With SP i&#39;ve =
no problem, while with GC with a lot of document (one with 47k and another =
with 60k), the Seed taking process, sometimes, not finish, because the agen=
ts seem to stop (although java process is still alive).</div><div>After thi=
s, if i try to start any other job, that not start, like the agents are sto=
pped.</div><div><br></div><div>Other times, this jobs work correctly and on=
e time together work correctly, running in the same moment.</div><div><br><=
/div><div>For information:</div><div><ul><li>On Jboss there are only Manifo=
ld and Generic Repository application.</li></ul><ul><li>On the same Virtual=
 Server, there is another Jboss istance, with solr istance and a web applic=
ation.</li></ul><ul><li>I&#39;ve check if it was a type of memory problem, =
but it&#39;s not the case.</li></ul><ul><li>GC with almost 23k seed work al=
ways, at least in test that i&#39;ve done.</li></ul><ul><li>In local instan=
ce of Jboss with Manifold and Generic Rpository Application, i&#39;ve not k=
eep this problem.</li></ul><div>This is the only recurrent information that=
 i&#39;ve seen on manifold.log:</div><div>---------------</div><div><div>Co=
nnection <a href=3D"http://0.0.0.0:62755" target=3D"_blank">0.0.0.0:62755</=
a>&lt;-&gt;&lt;ip-address&gt;:&lt;port&gt; shut down</div><div>Releasing co=
nnection org.apache.http.impl.conn.ManagedClientConnectionImpl@6c98c1bd</di=
v></div><div><br></div><div>---------------</div><div><br></div><div>Thanks=
,</div></div><div>L. Alicata</div></div>
</blockquote></div><br></div>

--94eb2c076a62995a1d05322a4d40--