falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Balu Vellanki (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-2029) HDFS-8828 requires Falcon to update Snapshot based mirroring extension
Date Tue, 14 Jun 2016 21:29:30 GMT
Balu Vellanki created FALCON-2029:
-------------------------------------

             Summary: HDFS-8828 requires Falcon to update Snapshot based mirroring extension
                 Key: FALCON-2029
                 URL: https://issues.apache.org/jira/browse/FALCON-2029
             Project: Falcon
          Issue Type: Bug
    Affects Versions: 0.10
            Reporter: Balu Vellanki
            Assignee: Balu Vellanki
            Priority: Critical
             Fix For: trunk, 0.10


HDFS-8828 has introduced the following backward incompatible behavior in Hadoop 2.8.0 (as
yet unreleased version).  "-delete" option in snapshot based distcp is invalid. Distcp utilizes
the snapshot diff report to build diff copy list, if Falcon provides the "-delete" option
an exception will be thrown unless the method DistCpOptions.validate() is called before running
distcp execute method. 

Where as in Hadoop 2.7.*, Falcon is required to provide "-delete" option for snapshot based
distcp. 

HDFS snapshot based mirroring extension provided as part of Falcon 0.10 release (and trunk)
is supposed to work with Hadoop 2.7.1 and above.  To make the code work with both 2.7.*, 2.8.*
and future versions, Falcon should call the validate method on distcp options. If the method
does not exist (in 2.7.1), Falcon should catch the exception and proceed with distCp. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message