ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Rakov (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (IGNITE-5938) Implement WAL logs compaction and compression after checkpoint
Date Fri, 03 Nov 2017 11:39:00 GMT

     [ https://issues.apache.org/jira/browse/IGNITE-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ivan Rakov reassigned IGNITE-5938:
----------------------------------

    Assignee: Ivan Rakov  (was: Dmitriy Govorukhin)

> Implement WAL logs compaction and compression after checkpoint
> --------------------------------------------------------------
>
>                 Key: IGNITE-5938
>                 URL: https://issues.apache.org/jira/browse/IGNITE-5938
>             Project: Ignite
>          Issue Type: Improvement
>          Components: persistence
>    Affects Versions: 2.1
>            Reporter: Alexey Goncharuk
>            Assignee: Ivan Rakov
>            Priority: Major
>             Fix For: 2.4
>
>
> Currently, we simply move WAL segments to archive when WAL segment is written and delete
when checkpoint history becomes too old. 
> Archived WAL segment contains physical delta records that are no longer needed for rebalancing,
so these records may be thrown away. In order to optimize disk space and delta WAL rebalancing,
we can do the following:
> 1) Clean the WAL segments from the physical records
> 2) Compress the cleaned segments (I expect this to be very effective since we write full
objects)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message