spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <>
Subject [jira] [Assigned] (SPARK-6211) Test Python Kafka API using Python unit tests
Date Fri, 03 Apr 2015 06:09:53 GMT


Apache Spark reassigned SPARK-6211:

    Assignee: Saisai Shao  (was: Apache Spark)

> Test Python Kafka API using Python unit tests
> ---------------------------------------------
>                 Key: SPARK-6211
>                 URL:
>             Project: Spark
>          Issue Type: Test
>          Components: Streaming, Tests
>            Reporter: Tathagata Das
>            Assignee: Saisai Shao
>            Priority: Critical
> This is tricky in python because the KafkaStreamSuiteBase (which has the functionality
of creating embedded kafka clusters) is in the test package, which is not in the python path.
To fix that, we have to ways. 
> 1. Add test jar to classpath in python test. Thats kind of trickier.
> 2. Bring that into the src package (maybe renamed as KafkaTestUtils), and then wrap that
in python to use it from python. 
> If (2) does not add any extra test dependencies to the main Kafka pom, then 2 should
be simpler to do.  

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message