falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2104) Loss of data in GraphDB when upgrading Falcon from 0.9 to 0.10.
Date Sun, 31 Jul 2016 22:56:20 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401388#comment-15401388

Venkat Ranganathan commented on FALCON-2104:

How about this.   We say that before upgrading to 0.10, one needs to apply a patch to their
current version (say the patch will be available in 0.6.1 or later and we will include it
as part of 0.10). 
The patch will introduce one utility which allows the the export to JSON or import from JSON
to the graph db.  This can potentially help in downgrade situations say people move from 0.10
to an earlier release for some reason or even when moving from berkeleydb to hbase as backend
for example.

I am attaching a shell script and the 0.9 patch and a 0.10 patch for Falcon.  Please check

[~bvellanki]   Please check the patch - not sure if your utility is along similar lines  -
if so, feel free to incorporate as needed

> Loss of data in GraphDB when upgrading Falcon from 0.9 to 0.10. 
> ----------------------------------------------------------------
>                 Key: FALCON-2104
>                 URL: https://issues.apache.org/jira/browse/FALCON-2104
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.10
>            Reporter: Balu Vellanki
>            Assignee: Balu Vellanki
>            Priority: Critical
>             Fix For: trunk, 0.10
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> FALCON-1333 (Instance Search feature) requires Falcon to use titan-berkeleyje version
0.5.4 to support indexing. Up until version 0.9 - Falcon used   titan-berkeleyje-jre6 version
0.4.2.  GraphDB created by version 0.4.2 cannot be read by version 0.5.4. When attempting
an upgrade, I realized that entity and instance lineage data created in 0.9 version could
not be read by Falcon in 0.10 version. 
> The only solution seems to provide a tool to do the following
> - Use 0.4.2 version of titan-berkeleyje-jre6 to read the berkeleyDB based graphDB and
create a JSON file with all data.
> - shutdown falcon-0.9, upgrade Falcon.
> - use 0.5.4 version of titan-berkeleyje to read JSON file and repopulate berkeleyDB based
> - restart falcon-0.10
> I will work on the tool, and update release-notes, upgrade instructions accordingly.

This message was sent by Atlassian JIRA

View raw message