oodt-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Ramirez (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (OODT-216) Improve speed of pagination in DataSourceCatalog by using lastIDs rather than scrollable cursors
Date Thu, 30 Aug 2012 15:31:08 GMT

    [ https://issues.apache.org/jira/browse/OODT-216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445016#comment-13445016
] 

Paul Ramirez commented on OODT-216:
-----------------------------------

Actually recording new information is not needed for current implementation to update their
get next page methods as they already pass in the previous page. From this the implementation
can grab the last product and use information from it. To support get previous page the previousLastReference
would need to be added.
                
> Improve speed of pagination in DataSourceCatalog by using lastIDs rather than scrollable
cursors
> ------------------------------------------------------------------------------------------------
>
>                 Key: OODT-216
>                 URL: https://issues.apache.org/jira/browse/OODT-216
>             Project: OODT
>          Issue Type: Improvement
>          Components: file manager
>         Environment: from JPL's internal JIRA
>            Reporter: Chris A. Mattmann
>            Assignee: Chris A. Mattmann
>             Fix For: 0.5
>
>
> Currently, the filemgr's DataSourceCatalog leverages scrollable record cursor result
sets to page over the returned results from an underlying JDBC database. With many records
to page over (on the orders of 100s of 1000s), this operation is somewhat slow. I think that
the speed of the operation could be improved using a filter criteria of e.g., taking the last
ID of an ordered product list, and then using that as a filter criteria to define the starting
point for paging, not bothering with scrollable cursors.
> This patch will provide such a capability as a configurable option for the DataSourceCatalog.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message