beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Etienne Chauchot (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-2993) AvroIO.write without specifying a schema
Date Wed, 27 Sep 2017 08:02:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Etienne Chauchot updated BEAM-2993:
-----------------------------------
    Description: Similarly to https://issues.apache.org/jira/browse/BEAM-2677, we should be
able to write to avro files using {{AvroIO}} without specifying a schema at build time. Consider
the following use case: a user has a {{PCollection<GenericRecord>}}  but the schema
is only known while running the pipeline.  {{AvroIO.writeGenericRecords}} needs the schema,
but the schema is already available in {{GenericRecord}}. We should be able to call {{AvroIO.writeGenericRecords()}}
with no schema.  (was: Similarly to https://issues.apache.org/jira/browse/BEAM-2677, we should
be able to write to avro files using {{AvroIO}} without specifying a schema at build time.
Consider the following use case: a user has a {{PCollection<GenericRecord>}}  but the
schema is only known while running the pipeline.  {{AvroIO.writeGenericRecords}} needs the
schema, but the schema is already available in {{GenericRecord}}. We should be able to call
{{AvroIO.writeGenericRecords()} with no schema.)

> AvroIO.write without specifying a schema
> ----------------------------------------
>
>                 Key: BEAM-2993
>                 URL: https://issues.apache.org/jira/browse/BEAM-2993
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Etienne Chauchot
>
> Similarly to https://issues.apache.org/jira/browse/BEAM-2677, we should be able to write
to avro files using {{AvroIO}} without specifying a schema at build time. Consider the following
use case: a user has a {{PCollection<GenericRecord>}}  but the schema is only known
while running the pipeline.  {{AvroIO.writeGenericRecords}} needs the schema, but the schema
is already available in {{GenericRecord}}. We should be able to call {{AvroIO.writeGenericRecords()}}
with no schema.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message