flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pa Rö <paul.roewer1...@googlemail.com>
Subject Re: flink k-means on hadoop cluster
Date Mon, 08 Jun 2015 09:23:37 GMT
Hi Robert,

i have see that you write me on stackoverflow, thanks. now the path is
right and i get the old exception:
org.apache.flink.runtime.JobException: Creating the input splits caused an
error: File file:/127.0.0.1:8020/home/user/cloudera/outputs/seed-1 does not
exist or the user running Flink ('yarn') has insufficient permissions to
access it.

i have look at the hdfs and want give the user yarn all permissions:
[cloudera@quickstart bin]$ hdfs dfs -ls
Found 9 items
drwxrwxrwt   - cloudera cloudera          0 2015-06-03 04:24 .Trash
drwxrwxrwt   - cloudera cloudera          0 2015-06-08 01:17 .flink
drwxrwxrwt   - cloudera cloudera          0 2015-06-04 06:51 .staging
drwxrwxrwt   - cloudera cloudera          0 2015-02-17 08:33 gdelt
drwxrwxrwt   - cloudera cloudera          0 2015-06-02 06:42 inputs
-rwxrwxrwt   1 cloudera cloudera   31223141 2015-06-03 03:53 ma-mahout.jar
-rwxrwxrwt   1 cloudera cloudera   30037418 2015-06-03 03:53
ma-mapreduce.jar
drwxrwxrwt   - cloudera cloudera          0 2015-06-04 07:38 oozie-oozi
drwxrwxrwt   - cloudera cloudera          0 2015-06-03 03:59 outputs
[cloudera@quickstart bin]$ sudo hdfs dfs -chown -R yarn:hadoop inputs
chown: `inputs': No such file or directory
[cloudera@quickstart bin]$ sudo hdfs dfs -chown -R yarn:hadoop outputs
chown: `outputs': No such file or directory

helpful:
https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.html

something i do wrong, maybe you have a idea?

Mime
View raw message