beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aviem Zur (JIRA)" <>
Subject [jira] [Assigned] (BEAM-1581) JSON source and sink
Date Fri, 21 Apr 2017 09:18:04 GMT


Aviem Zur reassigned BEAM-1581:

    Assignee:     (was: Aviem Zur)

> JSON source and sink
> --------------------
>                 Key: BEAM-1581
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-extensions
>            Reporter: Aviem Zur
> JSON source and sink to read/write JSON files.
> Similarly to {{XmlSource}}/{{XmlSink}}, these be a {{JsonSource}}/{{JonSink}} which are
a {{FileBaseSource}}/{{FileBasedSink}}.
> Consider using methods/code (or refactor these) found in {{AsJsons}} and {{ParseJsons}}
> The {{PCollection}} of objects the user passes to the transform should be embedded in
a valid JSON file
> The most common pattern for this is a large object with an array member which holds all
the data objects and other members for metadata.
> Examples of public JSON APIs:
> Another pattern used is a file which is simply a JSON array of objects.

This message was sent by Atlassian JIRA

View raw message