ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Veselovsky (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-4541) Create test for Hadoop running in external JVM
Date Fri, 03 Feb 2017 14:40:51 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851566#comment-15851566

Ivan Veselovsky commented on IGNITE-4541:

Created 2 versions of this fix:
"Full" version: all the tests suite is running in multi-JVM mode, branch ignite-4541, prq
1490 , build passed on TC, but ~10 tests are disabled -- 2 problems are still pending.
"Lingt" version: only TeraSort test is running in Multi-JVM mode, branch ignite-4541b, prq
1497, waiting for TC results, but locally tests pass. This is ready for review if tests are
ok on TC. 

> Create test for Hadoop running in external JVM
> ----------------------------------------------
>                 Key: IGNITE-4541
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4541
>             Project: Ignite
>          Issue Type: Task
>          Components: hadoop
>    Affects Versions: 1.8
>            Reporter: Vladimir Ozerov
>            Assignee: Ivan Veselovsky
>             Fix For: 2.0
> *Problem*
> Currently we run all Hadoop tests in synthetic "single JVM" mode. This way we miss lots
of potential issues. We need to be able to run them in real distributed mode, but on a single
> *Simplified solution*
> 1) Start N external nodes
> 2) Submit a job to these nodes and validate the result
> We can start with simple Teragen->Terasort->Teravalidate scenario. 
> Please look through {{Process}} and {{ProcessBuilder}} classes usages - most probably
we already have all necessary infrastructure to start nodes in external JVM.

This message was sent by Atlassian JIRA

View raw message