db-derby-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "martin stanik (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DERBY-6836) syscs_import_data_lobs_from_extfile can not read data past 2GB
Date Wed, 23 Sep 2015 06:04:06 GMT

    [ https://issues.apache.org/jira/browse/DERBY-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904017#comment-14904017
] 

martin stanik commented on DERBY-6836:
--------------------------------------

as far i can say, this is not the case.
i used exactly SYSCS_UTIL.SYSCS_EXPORT_TABLE_LOBS_TO_EXTFILE to create csv + bin.
both files looked fine (ie, offsets in csv were larger than 2GB).
what failed, was the import procedure.
from quick look, org.apache.derby.impl.load.ImportReadData suffers from the problem.
however, it's collaborators use long for file offsets.


> syscs_import_data_lobs_from_extfile can not read data past 2GB
> --------------------------------------------------------------
>
>                 Key: DERBY-6836
>                 URL: https://issues.apache.org/jira/browse/DERBY-6836
>             Project: Derby
>          Issue Type: Bug
>          Components: Store
>            Reporter: martin stanik
>
> syscs_util.syscs_import_data_lobs_from_extfile() imports data from .csv file.
> For binary data, in csv is expected a reference, where should be data read from.
> The reference is in form:
> <filename>.<offset>.<length>
> The offset and length are implemented as int.
> Hence, it is not possible to read binary data which are stored after 2GB.
> The stack trace is like:
> Caused by: java.lang.NumberFormatException: For input string: "2147563021"
> 	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> 	at java.lang.Integer.parseInt(Integer.java:495)
> 	at java.lang.Integer.parseInt(Integer.java:527)
> 	at org.apache.derby.impl.load.ImportReadData.initExternalLobFile(Unknown Source)
> 	at org.apache.derby.impl.load.ImportReadData.getBlobColumnFromExtFile(Unknown Source)
> 	at org.apache.derby.impl.load.ImportAbstract.getBlob(Unknown Source)
> 	at org.apache.derby.iapi.types.SQLBlob.setValueFromResultSet(Unknown Source)
> 	at org.apache.derby.impl.sql.execute.VTIResultSet.populateFromResultSet(Unknown Source)
> 	at org.apache.derby.impl.sql.execute.VTIResultSet.getNextRowCore(Unknown Source)
> 	at org.apache.derby.impl.sql.execute.ProjectRestrictResultSet.getNextRowCore(Unknown
Source)
> 	at org.apache.derby.impl.sql.execute.NormalizeResultSet.getNextRowCore(Unknown Source)
> 	at org.apache.derby.impl.sql.execute.NoPutResultSetImpl.getNextRowFromRowSource(Unknown
Source)
> 	at org.apache.derby.impl.store.access.heap.HeapController.load(Unknown Source)
> 	at org.apache.derby.impl.store.access.heap.Heap.load(Unknown Source)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message