lucy-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marvin Humphrey (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCY-103) Snapshot improvements
Date Thu, 20 May 2010 03:00:55 GMT

     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marvin Humphrey updated LUCY-103:
---------------------------------

    Attachment: read_write_file.patch

This second diff, read_write_file.patch, adds the Write_File() and Read_File()
methods.  They write a JSON file which encodes a hash of key-value pairs.  At
present, there are only two keys: a "format" integer, and an array of
filepaths under "entries".  

The role of the "entries" array has changed subtly since Snapshot was first
committed: including a folder name in a snapshot implicitly includes all of
its contents as well.  It is the role of the forthcoming FilePurger module to
implement this semantic change.

Before:

{code:none}
{
   "entries" : [ 
      "schema_1.json",
      "seg_3",
      "seg_3/lexicon-3.dat",
      "seg_3/lexicon-3.ix",
      "seg_3/lexicon-3.ixix",
      "seg_3/postings-3.dat",
      "seg_3/postings.skip",
      "seg_3/records.dat",
      "seg_3/records.ix",
      "seg_3/segmeta.json",
      "seg_3/term_vectors.dat",
      "seg_3/term_vectors.ix"
   ],  
   "format" : "1" 
}
{code}

After:

{code:none}
{
   "entries" : [ 
      "schema_1.json",
      "seg_3",
   ],  
   "format" : "1" 
}
{code}

Having segment directory names represent their contents by proxy frees index
subcomponents from having to manage their files manually so long as those
subcomponents work entirely within the segment system.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch, read_write_file.patch, snap_tests.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message