flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3930) Implement Service-Level Authorization
Date Thu, 01 Sep 2016 13:04:21 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455310#comment-15455310
] 

ASF GitHub Bot commented on FLINK-3930:
---------------------------------------

Github user rmetzger commented on the issue:

    https://github.com/apache/flink/pull/2425
  
    It seems that some of the YARN tests are failing because the jobmanager / application
master is logging:
    
    ```
    2016-08-27 08:48:54,858 INFO  org.apache.flink.yarn.YarnJobManager                   
      - ApplicatonMaster will shut down YARN session when job f56f54e7288172fdc16966c04e343d91
has finished.
    2016-08-27 08:48:55,370 ERROR org.apache.flink.runtime.blob.BlobServerConnection     
      - Error while executing BLOB connection.
    java.io.EOFException: Read an incomplete length
    	at org.apache.flink.runtime.blob.BlobUtils.readLength(BlobUtils.java:282)
    	at org.apache.flink.runtime.blob.BlobServerConnection.readCookie(BlobServerConnection.java:487)
    	at org.apache.flink.runtime.blob.BlobServerConnection.validateSecureCookie(BlobServerConnection.java:499)
    	at org.apache.flink.runtime.blob.BlobServerConnection.run(BlobServerConnection.java:107)
    2016-08-27 08:48:55,453 INFO  org.apache.flink.yarn.YarnJobManager                   
      - Submitting job f56f54e7288172fdc16966c04e343d91 (Flink Java Job at Sat Aug 27 08:48:46
UTC 2016).
    2016-08-27 08:48:55,465 INFO  org.apache.flink.yarn.YarnJobManager                   
      - Using restart strategy NoRestartStrategy for f56f54e7288172fdc16966c04e343d91.
    2016-08-27 08:48:55,524 INFO  org.apache.flink.yarn.YarnJobManager                   
      - Scheduling job f56f54e7288172fdc16966c04e343d91 (Flink Java Job at Sat Aug 27 08:48:46
UTC 2016).
    2016-08-27 08:48:55,525 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph 
      - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat))
-> FlatMap (FlatMap at main(WordCount.java:80)) -> Combine(SUM(1), at main(WordCount.java:83)
(1/1) (f5b14d29193f2a64970a98423aa00be2) switched from CREATED to SCHEDULED
    2016-08-27 08:48:55,535 INFO  org.apache.flink.yarn.YarnJobManager                   
      - Status of job f56f54e7288172fdc16966c04e343d91 (Flink Java Job at Sat Aug 27 08:48:46
UTC 2016) changed to RUNNING.
    2016-08-27 08:48:55,547 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph 
      - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat))
-> FlatMap (FlatMap at main(WordCount.java:80)) -> Combine(SUM(1), at main(WordCount.java:83)
(1/1) (f5b14d29193f2a64970a98423aa00be2) switched from SCHEDULED to DEPLOYING
    2016-08-27 08:48:55,547 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph 
      - Deploying CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat))
-> FlatMap (FlatMap at main(WordCount.java:80)) -> Combine(SUM(1), at main(WordCount.java:83)
(1/1) (attempt #0) to testing-worker-linux-docker-8659bf87-3480-linux-9
    2016-08-27 08:48:55,673 ERROR org.apache.flink.runtime.blob.BlobServerConnection     
      - Error while executing BLOB connection.
    java.io.EOFException: Read an incomplete length
    	at org.apache.flink.runtime.blob.BlobUtils.readLength(BlobUtils.java:282)
    	at org.apache.flink.runtime.blob.BlobServerConnection.readCookie(BlobServerConnection.java:487)
    	at org.apache.flink.runtime.blob.BlobServerConnection.validateSecureCookie(BlobServerConnection.java:499)
    	at org.apache.flink.runtime.blob.BlobServerConnection.run(BlobServerConnection.java:107)
    ```
    (see: https://s3.amazonaws.com/archive.travis-ci.org/jobs/155437254/log.txt) 


> Implement Service-Level Authorization
> -------------------------------------
>
>                 Key: FLINK-3930
>                 URL: https://issues.apache.org/jira/browse/FLINK-3930
>             Project: Flink
>          Issue Type: New Feature
>          Components: Security
>            Reporter: Eron Wright 
>            Assignee: Vijay Srinivasaraghavan
>              Labels: security
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> _This issue is part of a series of improvements detailed in the [Secure Data Access|https://docs.google.com/document/d/1-GQB6uVOyoaXGwtqwqLV8BHDxWiMO2WnVzBoJ8oPaAs/edit?usp=sharing]
design doc._
> Service-level authorization is the initial authorization mechanism to ensure clients
(or servers) connecting to the Flink cluster are authorized to do so.   The purpose is to
prevent a cluster from being used by an unauthorized user, whether to execute jobs, disrupt
cluster functionality, or gain access to secrets stored within the cluster.
> Implement service-level authorization as described in the design doc.
> - Introduce a shared secret cookie
> - Enable Akka security cookie
> - Implement data transfer authentication
> - Secure the web dashboard



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message