incubator-connectors-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From conflue...@apache.org
Subject [CONF] Apache Connectors Framework > How to Write an Output Connector
Date Sat, 23 Oct 2010 07:30:00 GMT
Space: Apache Connectors Framework (https://cwiki.apache.org/confluence/display/CONNECTORS)
Page: How to Write an Output Connector (https://cwiki.apache.org/confluence/display/CONNECTORS/How+to+Write+an+Output+Connector)
Comment: https://cwiki.apache.org/confluence/display/CONNECTORS/How+to+Write+an+Output+Connector?focusedCommentId=24184099#comment-24184099

Comment added by Karl Wright:
---------------------------------------------------------------------

It sounds like you are performing transactions within your connector and not structuring them
properly.  All transactions MUST be structured using the following paradigm, which
you should see in the web connector classes I pointed you towards earlier:

begin transaction

try

{

...

}

catch (any exceptions)

{

  signalrollback

  rethrow exception

}

finally

{

  endtransaction

}

In reply to a comment by Farzad:
This one also pops up for some reason too and then the crawl really gets slow, or in this
case MCF just got locked up.  Had to stop and restart the service to even terminate the job.

{noformat}
Worker thread aborting and restarting due to database connection reset: Database exception:
Exception doing query: ERROR: 
current transaction is aborted, commands ignored until end of transaction block
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database exception: Exception doing
query: ERROR: current 
transaction is aborted, commands ignored until end of transaction block
 at org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:421)
 at org.apache.manifoldcf.core.database.Database.executeUncachedQuery(Database.java:449)
 at org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1091)
 at org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
 at org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:167)
 at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.performModification(DBInterfacePostgreSQL.java:586)
 at org.apache.manifoldcf.core.database.DBInterfacePostgreSQL.performInsert(DBInterfacePostgreSQL.java:133)
 at org.apache.manifoldcf.core.database.BaseTable.performInsert(BaseTable.java:76)
 at org.apache.manifoldcf.agents.output.dupfinder.DataManager.insertData(DataManager.java:121)
 at org.apache.manifoldcf.agents.output.dupfinder.DupFinderConnector.addOrReplaceDocument(DupFinderConnector.java:78)
 at org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.addOrReplaceDocument(IncrementalIngester.java:1424)
 at org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.performIngestion(IncrementalIngester.java:409)
 at org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:304)
 at org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocument(WorkerThread.java:1586)
 at org.apache.manifoldcf.crawler.connectors.filesystem.FileConnector.processDocuments(FileConnector.java:275)
 at org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:423)
 at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:585)
Caused by: org.postgresql.util.PSQLException: ERROR: current transaction is aborted, commands
ignored until end of transaction block
 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1548)
 at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1316)
 at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:191)
 at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:452)
 at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:351)
 at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:305)
 at org.apache.manifoldcf.core.database.Database.execute(Database.java:566)
 at org.apache.manifoldcf.core.database.Database$ExecuteQueryThread.run(Database.java:381)
{noformat}

Change your notification preferences: https://cwiki.apache.org/confluence/users/viewnotifications.action

Mime
View raw message