beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reuven Lax (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-2601) FileBasedSink produces incorrect shards when writing to multiple destinations
Date Wed, 12 Jul 2017 02:45:00 GMT
Reuven Lax created BEAM-2601:
--------------------------------

             Summary: FileBasedSink produces incorrect shards when writing to multiple destinations
                 Key: BEAM-2601
                 URL: https://issues.apache.org/jira/browse/BEAM-2601
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-core
            Reporter: Reuven Lax
            Assignee: Davor Bonaci
             Fix For: 2.2.0


FileBasedSink now supports multiple dynamic destinations, however it finalizes all files in
a bundle without paying attention to destination. This means that the shard counts will be
incorrect across these destinations.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message