falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1793) feed element action="archive" is submittable via command line tool falcon
Date Tue, 02 Feb 2016 20:33:39 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128972#comment-15128972
] 

ASF GitHub Bot commented on FALCON-1793:
----------------------------------------

GitHub user deepakbarr opened a pull request:

    https://github.com/apache/falcon/pull/23

    FALCON-1793

    Changed as per review comments.
    
    
    
    $  bin/falcon entity -submit -type feed -file examples/entity/filesystem/out-feed.xml
    ERROR: Bad Request;javax.xml.bind.UnmarshalException
     - with linked exception:
    [org.xml.sax.SAXParseException; lineNumber: 29; columnNumber: 59; cvc-enumeration-valid:
Value 'archive' is not facet-valid with respect to enumeration '[delete]'. It must be a value
from the enumeration.]
    
    
    
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO]
    [INFO] Apache Falcon ...................................... SUCCESS [  2.459 s]
    [INFO] Apache Falcon UI ................................... SUCCESS [  8.276 s]
    [INFO] Build Tools ........................................ SUCCESS [  5.683 s]
    [INFO] Apache Falcon Java client .......................... SUCCESS [ 13.753 s]
    [INFO] Apache Falcon CLI client ........................... SUCCESS [  4.490 s]
    [INFO] Apache Falcon Metrics .............................. SUCCESS [  6.040 s]
    [INFO] Apache Falcon Hadoop Dependencies .................. SUCCESS [  3.137 s]
    [INFO] Apache Falcon Test Utility ......................... SUCCESS [  4.829 s]
    [INFO] Apache Falcon Commons .............................. SUCCESS [02:52 min]
    [INFO] Apache Falcon Oozie EL Extension ................... SUCCESS [  7.907 s]
    [INFO] Apache Falcon Embedded Hadoop - Test Cluster ....... SUCCESS [ 28.412 s]
    [INFO] Apache Falcon Sharelib Hive - Test Cluster ......... SUCCESS [  3.311 s]
    [INFO] Apache Falcon Sharelib Pig - Test Cluster .......... SUCCESS [  0.800 s]
    [INFO] Apache Falcon Sharelib Hcatalog - Test Cluster ..... SUCCESS [  2.140 s]
    [INFO] Apache Falcon Sharelib Oozie - Test Cluster ........ SUCCESS [  0.168 s]
    [INFO] Apache Falcon Test Tools - Test Cluster ............ SUCCESS [  0.115 s]
    [INFO] Apache Falcon Messaging ............................ SUCCESS [ 21.885 s]
    [INFO] Apache Falcon LIfecycle Module ..................... SUCCESS [  7.531 s]
    [INFO] Apache Falcon Oozie Adaptor ........................ SUCCESS [01:08 min]
    [INFO] Apache Falcon Scheduler ............................ SUCCESS [01:25 min]
    [INFO] Apache Falcon Acquisition .......................... SUCCESS [  1.062 s]
    [INFO] Apache Falcon Distcp Replication ................... SUCCESS [  8.399 s]
    [INFO] Apache Falcon Retention ............................ SUCCESS [ 13.447 s]
    [INFO] Apache Falcon Archival ............................. SUCCESS [  0.505 s]
    [INFO] Apache Falcon Rerun ................................ SUCCESS [ 15.544 s]
    [INFO] Apache Falcon Prism ................................ SUCCESS [01:34 min]
    [INFO] falcon-unit ........................................ SUCCESS [02:48 min]
    [INFO] Apache Falcon Web Application ...................... SUCCESS [07:42 min]
    [INFO] Apache Falcon Documentation ........................ SUCCESS [  6.900 s]
    [INFO] Apache Falcon Distro ............................... SUCCESS [04:27 min]
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD SUCCESS
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 24:48 min
    [INFO] Finished at: 2016-02-03T01:55:36+05:30
    [INFO] Final Memory: 719M/2208M
    [INFO] ------------------------------------------------------------------------

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/deepakbarr/falcon falcon-1793-2

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/falcon/pull/23.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #23
    
----
commit cbaf3fa34eb4bc426258f2bc4dc65a0be902e2d4
Author: Deepak Kumar Barr <deepak.barr@gmail.com>
Date:   2016-02-02T20:28:10Z

    FALCON-1793

----


> feed element action="archive" is submittable via command line tool falcon
> -------------------------------------------------------------------------
>
>                 Key: FALCON-1793
>                 URL: https://issues.apache.org/jira/browse/FALCON-1793
>             Project: Falcon
>          Issue Type: Bug
>          Components: feed
>    Affects Versions: 0.6.1
>         Environment: CentOS Linux release 7.1.1503 (Core)
>            Reporter: Margus Roo
>            Assignee: Deepak Barr
>
> As I understand feed action archive is not supported yet.
> But submitting feed via command line tool:
> > falcon entity -type feed -submit -file [feed.xml] 
> answer: falcon/default/Submit successful (feed) falcon-input-table
> there is no problem
> My example feed.xml is:
> <feed description="input table" name="falcon-input-table" xmlns="uri:falcon:feed:0.1">
>     <frequency>days(1)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="hours(3)"/>
>     <clusters>
>         <cluster name="Cluster2" type="source">
>                         <validity start="2016-01-01T00:00Z" end="2030-01-01T00:00Z"/>
>                         <retention limit="months(99999999)" action="archive" />
>         </cluster>
>     </clusters>
>     <table uri="catalog:default:falcon1#feed_date=${YEAR}-${MONTH}-${DAY}" />
>     <ACL owner="margusja" group="users" permission="0770"/>
>     <schema location="hcat" provider="hcat"/>
> </feed>
> Cluster.xml (domain is removed):
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <cluster xmlns="uri:falcon:cluster:0.1" name="Cluster2" description="" colo="telekomarendus">
>     <interfaces>
>         <interface type="readonly" endpoint="hftp://hadoopnn2:50070" version="2.3.0"/>
>         <interface type="write" endpoint="hdfs://mycluster" version="2.3.0"/>
>         <interface type="execute" endpoint="hadoopnn1:8050" version="2.3.0"/>
>         <interface type="workflow" endpoint="http://hadoopnn1:11000/oozie/" version="4.2.0"/>
>         <interface type="messaging" endpoint="tcp://hadoopnn2.estpak.ee:61616?daemon=true"
version="5.1.6"/>
>         <interface type="registry" endpoint="thrift://hadoopnn1:9083" version=""/>
>     </interfaces>
>     <locations>
>         <location name="staging" path="/apps/falcon/Cluster2/staging"/>
>         <location name="temp" path="/tmp"/>
>         <location name="working" path="/apps/falcon/Cluster2/working"/>
>     </locations>
>     <ACL owner="margusja" group="users" permission="0755"/>
> </cluster>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message