flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xingcan Cui (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-8538) Add a Kafka table source factory with JSON format support
Date Mon, 12 Feb 2018 10:27:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360559#comment-16360559

Xingcan Cui commented on FLINK-8538:

Hi [~twalthr] and [~fhueske], I committed a WIP branch to my repository ([xccui/FLINK-8538|https://github.com/xccui/flink/tree/FLINK-8538]).

A temporary new module {{flink-kafka}} was created for this work since I still can't think
out how to consolidate the codes - -!. There are still some features need to be added, e.g.,
to support time attributes and schema mapping. Considering that the framework has already
been constructed, I wonder if you could have a look to see if I'm on the right direction.

Thanks, Xingcan

> Add a Kafka table source factory with JSON format support
> ---------------------------------------------------------
>                 Key: FLINK-8538
>                 URL: https://issues.apache.org/jira/browse/FLINK-8538
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table API &amp; SQL
>            Reporter: Timo Walther
>            Assignee: Xingcan Cui
>            Priority: Major
> Similar to CSVTableSourceFactory a Kafka table source factory for JSON should be added.
This issue includes improving the existing JSON descriptor with validation that can be used
for other connectors as well. It is up for discussion if we want to split the KafkaJsonTableSource
into connector and format such that we can reuse the format for other table sources as well.

This message was sent by Atlassian JIRA

View raw message