flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3161) Externalize cluster start-up and tear-down when available
Date Wed, 27 Jan 2016 15:03:40 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119390#comment-15119390
] 

ASF GitHub Bot commented on FLINK-3161:
---------------------------------------

Github user greghogan commented on the pull request:

    https://github.com/apache/flink/pull/1523#issuecomment-175671773
  
    The `pdsh` section on [Environment Variables](http://linux.die.net/man/1/pdsh) lists two
options:
    
    > PDSH_SSH_ARGS
    > Override the standard arguments that pdsh passes to the ssh(1) command ("-2 -a -x
-l%u %h"). The use of the parameters %u, %h, and %n (as documented in the rcmd/exec section
above) is optional. If these parameters are missing, pdsh will append them to the ssh commandline
because it is assumed they are mandatory.
    
    > PDSH_SSH_ARGS_APPEND
    > Append additional options to the ssh(1) command invoked by pdsh. For example, PDSH_SSH_ARGS_APPEND="-q"
would run ssh in quiet mode, or "-v" would increase the verbosity of ssh. (Note: these arguments
are actually prepended to the ssh commandline to ensure they appear before any target hostname
argument to ssh.)
    
    By default `pdsh` is enforcing protocol version 2, disabling the authentication agent,
and disabling X11 forwarding. For consistency we can blank out PDSH_SSH_ARGS and set PDSH_SSH_ARGS_APPEND
to FLINK_SSH_OPTS.


> Externalize cluster start-up and tear-down when available
> ---------------------------------------------------------
>
>                 Key: FLINK-3161
>                 URL: https://issues.apache.org/jira/browse/FLINK-3161
>             Project: Flink
>          Issue Type: Improvement
>          Components: Start-Stop Scripts
>    Affects Versions: 1.0.0
>            Reporter: Greg Hogan
>            Assignee: Greg Hogan
>            Priority: Minor
>
> I have been using pdsh, pdcp, and rpdcp to both distribute compiled Flink and to start
and stop the TaskManagers. The current shell script initializes TaskManagers one-at-a-time.
This is trivial to background but would be unthrottled.
> From pdsh's archived homepage: "uses a sliding window of threads to execute remote commands,
conserving socket resources while allowing some connections to timeout if needed".
> What other tools could be supported when available?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message