falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Praveen Adlakha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2223) Distributed mode support for User Extension
Date Thu, 15 Dec 2016 12:10:58 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15751213#comment-15751213
] 

Praveen Adlakha commented on FALCON-2223:
-----------------------------------------

DEV testing:

{code}

In distributed mode with client pointing to Server with extension service running on server:

$ ./bin/falcon extension -enumerate 
Hadoop home is set, adding libraries from '/usr/hdp/2.2.0.0-2041/hadoop/bin/hadoop classpath'
into falcon classpath
ERROR: Bad Request;Enumerate is not supported on Server.Please run your operation on prism.

$ ./bin/falcon extension -describe -extensionName abcd
ERROR: Bad Request;Describe is not supported on Server.Please run your operation on prism.

$ ./bin/falcon extension -detail -extensionName abcd
ERROR: Bad Request;Detail is not supported on Server.Please run your operation on prism.

$ ./bin/falcon extension -unregister -extensionName abcd
ERROR: Bad Request;Unregister is not supported on Server.Please run your operation on prism.

$ ./bin/falcon extension -definition -extensionName abcd
ERROR: Bad Request;Definition is not supported on Server.Please run your operation on prism.


In distributed mode with client pointing to Prism with extension service running on prism:

./bin/falcon extension -enumerate 
{
  "extensions": [
    {
      "name": "abcd",
      "type": "Custom extension",
      "location": "hdfs://10.14.118.114:8020/user/dataqa/sampleextension/"
    }
    ],
    "totalResults: 1"
}   

$ ./bin/falcon extension -describe -extensionName test
ERROR: Internal Server Error;java.io.FileNotFoundException: File file:/usr/local/falcon/prism/extensions/test
does not exist
CausedBy: File file:/usr/local/falcon/prism/extensions/test does not exist

Describe seems to be broked.

$ ./bin/falcon extension -detail -extensionName test
{
  "name": "test",
  "type": "Custom extension",
  "description": "test123",
  "location": "hdfs://localhost:8020/user/dataqa/sampleextension"
}

$ ./bin/falcon extension -unregister -extensionName abcd
Deleted extension:abcd

$ ./bin/falcon extension -register  -extensionName abcd -path hdfs://10.14.118.114:8020/user/dataqa/sampleextension/
Extension :abcd registered successfully.


In embedded mode :

./bin/falcon extension -enumerate 
{
  "extensions": [
    {
      "name": "abcd",
      "type": "Custom extension",
      "location": "hdfs://10.14.118.114:8020/user/dataqa/sampleextension/"
    }
    ],
    "totalResults: 1"
} 

$ ./bin/falcon extension -detail -extensionName test
{
  "name": "test",
  "type": "Custom extension",
  "description": "test123",
  "location": "hdfs://localhost:8020/user/dataqa/sampleextension"
}

$ ./bin/falcon extension -unregister -extensionName abcd
Deleted extension:abcd

$ ./bin/falcon extension -register  -extensionName abcd -path hdfs://10.14.118.114:8020/user/dataqa/sampleextension/
Extension :abcd registered successfully.
{code}

> Distributed mode support for User Extension
> -------------------------------------------
>
>                 Key: FALCON-2223
>                 URL: https://issues.apache.org/jira/browse/FALCON-2223
>             Project: Falcon
>          Issue Type: Sub-task
>          Components: extensions
>            Reporter: Praveen Adlakha
>            Assignee: Praveen Adlakha
>
> Hi All,
> This issue is to track distributed mode support for user extension.In this jira I will
be making changes for:
> register 
> unregister
> detail 
> describe API.
> as these are logically grouped together which will be running on prism only.
> Thanks
> Praveen



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message