lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luke Forehand (JIRA)" <j...@apache.org>
Subject [jira] Updated: (SOLR-1406) Refactor FileDataSource and FileListEntityProcessor to be more extendable
Date Sat, 05 Sep 2009 00:22:57 GMT

     [ https://issues.apache.org/jira/browse/SOLR-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Luke Forehand updated SOLR-1406:
--------------------------------

    Description: 
FileDataSource should make openStream method protected so we can extend FileDataSource for
other File types such as GZip, by controlling the underlying InputStreamReader implementation
being returned.

FileListEntityProcessor needs to aggregate a list of files that were processed and expose
that list in an accessible way so that further processing on that file list can be done in
the close method.  For example, deletion or archiving.

Another improvement would be that in the event of an indexing rollback event, processing of
the close method either does not occur, or the close method is allowed access to that event,
to prevent processing within the close method if necessary.

  was:The ability to retrieve the DataConfig is very useful for inspecting configuration attributes
within an EventListener!

        Summary: Refactor FileDataSource and FileListEntityProcessor to be more extendable
 (was: Add ability to retrieve DataConfig from dataimport Context)

> Refactor FileDataSource and FileListEntityProcessor to be more extendable
> -------------------------------------------------------------------------
>
>                 Key: SOLR-1406
>                 URL: https://issues.apache.org/jira/browse/SOLR-1406
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - DataImportHandler
>    Affects Versions: 1.4
>            Reporter: Luke Forehand
>            Assignee: Noble Paul
>         Attachments: SOLR-1406.patch
>
>
> FileDataSource should make openStream method protected so we can extend FileDataSource
for other File types such as GZip, by controlling the underlying InputStreamReader implementation
being returned.
> FileListEntityProcessor needs to aggregate a list of files that were processed and expose
that list in an accessible way so that further processing on that file list can be done in
the close method.  For example, deletion or archiving.
> Another improvement would be that in the event of an indexing rollback event, processing
of the close method either does not occur, or the close method is allowed access to that event,
to prevent processing within the close method if necessary.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message