flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <till.rohrm...@gmail.com>
Subject Re: flink k-means on hadoop cluster
Date Mon, 08 Jun 2015 09:38:47 GMT
I assume that the path inputs and outputs is not correct since you get the
error message *chown `output’: No such file or directory*. Try to provide
the full path to the chown command such as
hdfs://ServerURI/path/to/your/directory.
​

On Mon, Jun 8, 2015 at 11:23 AM Pa Rö <paul.roewer1990@googlemail.com>
wrote:

> Hi Robert,
>
> i have see that you write me on stackoverflow, thanks. now the path is
> right and i get the old exception:
> org.apache.flink.runtime.JobException: Creating the input splits caused an
> error: File file:/127.0.0.1:8020/home/user/cloudera/outputs/seed-1 does
> not exist or the user running Flink ('yarn') has insufficient permissions
> to access it.
>
> i have look at the hdfs and want give the user yarn all permissions:
> [cloudera@quickstart bin]$ hdfs dfs -ls
> Found 9 items
> drwxrwxrwt   - cloudera cloudera          0 2015-06-03 04:24 .Trash
> drwxrwxrwt   - cloudera cloudera          0 2015-06-08 01:17 .flink
> drwxrwxrwt   - cloudera cloudera          0 2015-06-04 06:51 .staging
> drwxrwxrwt   - cloudera cloudera          0 2015-02-17 08:33 gdelt
> drwxrwxrwt   - cloudera cloudera          0 2015-06-02 06:42 inputs
> -rwxrwxrwt   1 cloudera cloudera   31223141 2015-06-03 03:53 ma-mahout.jar
> -rwxrwxrwt   1 cloudera cloudera   30037418 2015-06-03 03:53
> ma-mapreduce.jar
> drwxrwxrwt   - cloudera cloudera          0 2015-06-04 07:38 oozie-oozi
> drwxrwxrwt   - cloudera cloudera          0 2015-06-03 03:59 outputs
> [cloudera@quickstart bin]$ sudo hdfs dfs -chown -R yarn:hadoop inputs
> chown: `inputs': No such file or directory
> [cloudera@quickstart bin]$ sudo hdfs dfs -chown -R yarn:hadoop outputs
> chown: `outputs': No such file or directory
>
> helpful:
> https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.html
>
> something i do wrong, maybe you have a idea?
>
>

Mime
View raw message