beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (BEAM-1027) Hosting data stores to enable IO Transform testing
Date Tue, 22 Nov 2016 22:38:58 GMT

     [ https://issues.apache.org/jira/browse/BEAM-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Stephen Sisk reassigned BEAM-1027:
----------------------------------

    Assignee: Stephen Sisk

> Hosting data stores to enable IO Transform testing
> --------------------------------------------------
>
>                 Key: BEAM-1027
>                 URL: https://issues.apache.org/jira/browse/BEAM-1027
>             Project: Beam
>          Issue Type: Task
>            Reporter: Stephen Sisk
>            Assignee: Stephen Sisk
>
> Currently we have a good set of unit tests for our IO Transforms - those
> tend to run against in-memory versions of the data stores. However, we'd
> like to further increase our test coverage to include running them against
> real instances of the data stores that the IO Transforms work against (e.g.
> cassandra, mongodb, kafka, etc…), which means we'll need to have real
> instances of various data stores.
> Additionally, if we want to do performance regression detection, it's
> important to have instances of the services that behave realistically,
> which isn't true of in-memory or dev versions of the services.
> My proposed solution is in https://lists.apache.org/thread.html/367fd9669411f21c9ec1f2d27df60464f49d5ce81e6bd16de401d035@%3Cdev.beam.apache.org%3E

> - it still needs further discussion, and (assuming we agree on the general idea), the
beam community needs to decide which cluster management software we want to use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message