beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré (JIRA) <j...@apache.org>
Subject [jira] [Assigned] (BEAM-1018) getEstimatedSizeBytes fails with large MongoDB collection sizes
Date Mon, 21 Nov 2016 15:59:59 GMT

     [ https://issues.apache.org/jira/browse/BEAM-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jean-Baptiste Onofré reassigned BEAM-1018:
------------------------------------------

    Assignee: Jean-Baptiste Onofré

> getEstimatedSizeBytes fails with large MongoDB collection sizes
> ---------------------------------------------------------------
>
>                 Key: BEAM-1018
>                 URL: https://issues.apache.org/jira/browse/BEAM-1018
>             Project: Beam
>          Issue Type: Bug
>    Affects Versions: 0.4.0-incubating
>            Reporter: Sandeep Parikh
>            Assignee: Jean-Baptiste Onofré
>
> When running against large collections sizes (20M+ documents), MongoDbIO fails to correctly
parse the {{size}} element in the document returned by {{db.runCommand({"collStats", "collectionName"})}}.
As the collection sizes grow larger, the returned value is in scientific notation which cannot
be parsed as a Long. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message