db-derby-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Semih ARAL (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DERBY-3698) Bulk SQL INSERT, SELECT, UPDATE operations creates OutOfMemoryError after first Cleanup action on serverside
Date Sat, 31 May 2008 15:29:45 GMT

    [ https://issues.apache.org/jira/browse/DERBY-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12601396#action_12601396
] 

Semih ARAL commented on DERBY-3698:
-----------------------------------

I will try for heap dump, but it wil not be very different than the followng  I think : 
http://mail-archives.apache.org/mod_mbox/db-derby-dev/200702.mbox/%3C7632076.1171898345554.JavaMail.jira@brutus%3E

I tried to execute our program with derby.language.logStatementText=false, nothing changed:

Apache Derby Network Server - 10.4.1.3 - (648739) started and ready to accept connections
on port 1527 at 2008-05-31 14:27:31.514 GMT 
----------------------------------------------------------------
2008-05-31 14:27:36.639 GMT:
 Booting Derby version The Apache Software Foundation - Apache Derby - 10.4.1.3 - (648739):
instance c013800d-011a-3f60-45fb-0000760c8b63
on database directory C:\home\semih\project\mask\euProjects\data\openOfficeDb\derby\euProj02
 

Database Class Loader started - derby.database.classpath=''
2008-05-31 14:39:48.217 GMT Thread[DRDAConnThread_3,5,main] (XID = 3393258), (SESSIONID =
2), (DATABASE = euProj02), (DRDAID = NF000001.H172-580400189733304267{3}), Cleanup action
starting
2008-05-31 14:39:48.217 GMT Thread[DRDAConnThread_3,5,main] (XID = 3393258), (SESSIONID =
2), (DATABASE = euProj02), (DRDAID = NF000001.H172-580400189733304267{3}), Failed Statement
is: SELECT PK_SEQ, NAME, URL FROM EUPROJ.FIRM WHERE NAME ='Universite Libre de Bruxeels (BE)'
java.lang.OutOfMemoryError
Cleanup action completed


As you see I got this exception after almost 10 minutes of execution and claculate that the
migration/restructuring will take approximately 16 hours, after that point I will not try
any proposition concerning less memory usage. 

I think that if cleanup creates OutOfMemoryError, instead of releasing the memory, the problem
is there.




> Bulk SQL INSERT, SELECT, UPDATE operations creates OutOfMemoryError after first Cleanup
action on serverside
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: DERBY-3698
>                 URL: https://issues.apache.org/jira/browse/DERBY-3698
>             Project: Derby
>          Issue Type: Bug
>          Components: Network Server
>    Affects Versions: 10.4.1.3
>         Environment: Windows XP, JDK 1.4
>            Reporter: Semih ARAL
>
> In the migration of an DB, 
> By using JDBC (connection is open one time in the begining)
> after many INSERT, SELECT,UPDATE statement executions (more than 3500)
> I got the following Exception on the client side:
> SELECT PK_SEQ, NAME, URL FROM EUPROJ.FIRM WHERE NAME ='INSTITUTE OF EDUCATION University
OF LONDON'
> com.javaDevHome.ladyBeetle.exception.MicroJDBCException: java.sql.SQLException: DERBY
SQL error: SQLCODE: -1, SQLSTATE: XJ001, SQLERRMC: java.lang.OutOfMemoryErrorXJ001.U
> 	at com.javaDevHome.ladyBeetle.MicroJDBCConnection.executeQuery(MicroJDBCConnection.java:251)
> 	at com.javaDevHome.ladyBeetle.MicroJDBCDBase.selectRowSilent(MicroJDBCDBase.java:133)
> 	at euProj.transfer.Transfer.procFirmNew(Transfer.java:259)
> 	at euProj.transfer.Transfer.procshortListNew(Transfer.java:200)
> 	at euProj.transfer.Transfer.readConsortiums(Transfer.java:524)
> 	at euProj.transfer.Transfer.procContract(Transfer.java:107)
> 	at euProj.transfer.Transfer.readLine(Transfer.java:554)
> 	at euProj.transfer.Transfer.main(Transfer.java:594)
> Caused by: java.sql.SQLException: DERBY SQL error: SQLCODE: -1, SQLSTATE: XJ001, SQLERRMC:
java.lang.OutOfMemoryErrorXJ001.U
> 	at org.apache.derby.client.am.SQLExceptionFactory40.getSQLException(Unknown Source)
> 	at org.apache.derby.client.am.SqlException.getSQLException(Unknown Source)
> 	at org.apache.derby.client.am.Statement.executeQuery(Unknown Source)
> 	at com.javaDevHome.ladyBeetle.MicroJDBCConnection.executeQuery(MicroJDBCConnection.java:247)
> 	... 7 more
> Caused by: org.apache.derby.client.am.SqlException: DERBY SQL error: SQLCODE: -1, SQLSTATE:
XJ001, SQLERRMC: java.lang.OutOfMemoryErrorXJ001.U
> 	at org.apache.derby.client.am.Statement.completeSqlca(Unknown Source)
> 	at org.apache.derby.client.net.NetStatementReply.parsePrepareError(Unknown Source)
> 	at org.apache.derby.client.net.NetStatementReply.parsePRPSQLSTTreply(Unknown Source)
> 	at org.apache.derby.client.net.NetStatementReply.readPrepareDescribeOutput(Unknown Source)
> 	at org.apache.derby.client.net.StatementReply.readPrepareDescribeOutput(Unknown Source)
> 	at org.apache.derby.client.net.NetStatement.readPrepareDescribeOutput_(Unknown Source)
> 	at org.apache.derby.client.am.Statement.readPrepareDescribeOutput(Unknown Source)
> 	at org.apache.derby.client.am.Statement.flowExecute(Unknown Source)
> 	at org.apache.derby.client.am.Statement.executeQueryX(Unknown Source)
> 	... 9 more
> in derby.log on the server side :
> 2008-05-29 20:33:04.578 GMT Thread[DRDAConnThread_5,5,main] (XID = 171959), (SESSIONID
= 4), (DATABASE = euProj03), (DRDAID = NF000001.H1CF-4339779978832484505{5}), Begin compiling
prepared statement: SELECT PK_SEQ, NAME, URL FROM EUPROJ.FIRM WHERE NAME ='INSTITUTE OF EDUCATION
University OF LONDON' :End prepared statement
> 2008-05-29 20:33:04.609 GMT Thread[DRDAConnThread_5,5,main] (XID = 171959), (SESSIONID
= 4), (DATABASE = euProj03), (DRDAID = NF000001.H1CF-4339779978832484505{5}), End compiling
prepared statement: SELECT PK_SEQ, NAME, URL FROM EUPROJ.FIRM WHERE NAME ='INSTITUTE OF EDUCATION
University OF LONDON' :End prepared statement
> 2008-05-29 20:33:07.499 GMT Thread[DRDAConnThread_5,5,main] (XID = 171959), (SESSIONID
= 4), (DATABASE = euProj03), (DRDAID = NF000001.H1CF-4339779978832484505{5}), Cleanup action
starting
> 2008-05-29 20:33:07.499 GMT Thread[DRDAConnThread_5,5,main] (XID = 171959), (SESSIONID
= 4), (DATABASE = euProj03), (DRDAID = NF000001.H1CF-4339779978832484505{5}), Failed Statement
is: SELECT PK_SEQ, NAME, URL FROM EUPROJ.FIRM WHERE NAME ='INSTITUTE OF EDUCATION University
OF LONDON'
> java.lang.OutOfMemoryError
> Cleanup action completed
> 2008-05-29 20:33:37.359 GMT Thread[DRDAConnThread_6,5,main] (XID = 169430), (SESSIONID
= 6), (DATABASE = euProj03), (DRDAID = NF000001.H1D1-4255618960795994455{7}), Rolling back
> 2008-05-29 20:33:37.359 GMT Thread[DRDAConnThread_6,5,main] (XID = 169430), (SESSIONID
= 6), (DATABASE = euProj03), (DRDAID = NF000001.H1D1-4255618960795994455{7}), Rolling back
> 2008-05-29 20:33:37.359 GMT Thread[DRDAConnThread_4,5,main] (XID = 143043), (SESSIONID
= 5), (DATABASE = euProj03), (DRDAID = NF000001.H1D0-4255900435772705908{6}), Rolling back
> 2008-05-29 20:33:37.359 GMT Thread[DRDAConnThread_4,5,main] (XID = 143043), (SESSIONID
= 5), (DATABASE = euProj03), (DRDAID = NF000001.H1D0-4255900435772705908{6}), Rolling back
> in the derby.log there is no other Cleanup action, this is the first and the only one.
> I have started the server by default heap memory options:
> java -Dderby.system.home=C:\derby -jar %DERBY_HOME%\lib\derbyrun.jar server start

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message