flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-8973) End-to-end test: Run general purpose job with failures in standalone mode
Date Fri, 23 Mar 2018 13:36:01 GMT

    [ https://issues.apache.org/jira/browse/FLINK-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411378#comment-16411378
] 

ASF GitHub Bot commented on FLINK-8973:
---------------------------------------

Github user fhueske commented on a diff in the pull request:

    https://github.com/apache/flink/pull/5750#discussion_r176725241
  
    --- Diff: flink-end-to-end-tests/test-scripts/common.sh ---
    @@ -39,6 +39,93 @@ cd $TEST_ROOT
     export TEST_DATA_DIR=$TEST_INFRA_DIR/temp-test-directory-$(date +%S%N)
     echo "TEST_DATA_DIR: $TEST_DATA_DIR"
     
    +function revert_default_config() {
    +    sed 's/^    //g' > ${FLINK_DIR}/conf/flink-conf.yaml << EOL
    +    #==============================================================================
    +    # Common
    +    #==============================================================================
    +
    +    jobmanager.rpc.address: localhost
    +    jobmanager.rpc.port: 6123
    +    jobmanager.heap.mb: 1024
    +    taskmanager.heap.mb: 1024
    +    taskmanager.numberOfTaskSlots: 1
    +    parallelism.default: 1
    +
    +    #==============================================================================
    +    # Web Frontend
    +    #==============================================================================
    +
    +    web.port: 8081
    +EOL
    +}
    +
    +function create_ha_conf() {
    --- End diff --
    
    `conf` or `config`? Keep in sync with `revert_default_config()`


> End-to-end test: Run general purpose job with failures in standalone mode
> -------------------------------------------------------------------------
>
>                 Key: FLINK-8973
>                 URL: https://issues.apache.org/jira/browse/FLINK-8973
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Tests
>    Affects Versions: 1.5.0
>            Reporter: Till Rohrmann
>            Assignee: Kostas Kloudas
>            Priority: Blocker
>             Fix For: 1.5.0
>
>
> We should set up an end-to-end test which runs the general purpose job (FLINK-8971) in
a standalone setting with HA enabled (ZooKeeper). When running the job, the job failures should
be activated. 
> Additionally, we should randomly kill Flink processes (cluster entrypoint and TaskExecutors).
When killing them, we should also spawn new processes to make up for the loss.
> This end-to-end test case should run with all different state backend settings: {{RocksDB}}
(full/incremental, async/sync), {{FsStateBackend}} (sync/async)
> We should then verify that the general purpose job is successfully recovered without
data loss or other failures.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message