falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Narayan Periwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-503) The expected result of examples/data/generate.sh <<hdfs endpoint>>?
Date Mon, 14 Sep 2015 08:43:46 GMT

    [ https://issues.apache.org/jira/browse/FALCON-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743165#comment-14743165
] 

Narayan Periwal commented on FALCON-503:
----------------------------------------

The examples/data/generate.sh script is used to generate the input data for the falcon processes(that
are there inside examples/entity/filesystem/) to consume.

The script will generate the /data directory in the hdfs which will contain the input data,
as depicted below:-

[oozie@/opt/gridops/falcon$]hadoop fs -ls /data/in/2013/11/15/00
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

15/09/14 14:11:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
Found 60 items
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/00
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/01
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/02
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/03
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/04
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/05
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/06
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/07
 .......

> The expected result of examples/data/generate.sh <<hdfs endpoint>>?
> -------------------------------------------------------------------
>
>                 Key: FALCON-503
>                 URL: https://issues.apache.org/jira/browse/FALCON-503
>             Project: Falcon
>          Issue Type: Improvement
>          Components: docs
>    Affects Versions: 0.6
>            Reporter: Peng
>
> In the current version setup, there is a command examples/data/generate.sh <<hdfs
endpoint>>. What is the expected result of this command.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message