lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Harness (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SOLR-2851) Allow Data Import Handler to Archive Files After Processing
Date Tue, 25 Oct 2011 12:36:32 GMT
Allow Data Import Handler to Archive Files After Processing
-----------------------------------------------------------

                 Key: SOLR-2851
                 URL: https://issues.apache.org/jira/browse/SOLR-2851
             Project: Solr
          Issue Type: New Feature
          Components: contrib - DataImportHandler
    Affects Versions: 3.3
            Reporter: Josh Harness
            Priority: Minor
             Fix For: 3.3


It would be great if, after processing flat files, DIH could place them in an archive folder
so that other system processes could compress them, delete them, etc. We needed this feature,
so I extended FileDataSource and decorated the InputStreamReader such that when the close
method is called, the file is moved out of the way. This concrete implementation did exactly
what I needed. However, a more correct textbook approach would involve refactoring FileListEntityProcessor
such that it could take a configurable list of post-processing action policy/command classes
so that the user could provide custom behavior that suits nearly any scenario (in a Chain
of Responsibility style pattern). Nonetheless, I wanted to provide the suggestion, a basic
one-off concrete implementation of archiving and start the discussion for where things might
head in the future. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message