beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Work logged] (BEAM-5412) TFRecordIO fails with records larger than 8K
Date Thu, 20 Sep 2018 01:46:00 GMT


ASF GitHub Bot logged work on BEAM-5412:

                Author: ASF GitHub Bot
            Created on: 20/Sep/18 01:45
            Start Date: 20/Sep/18 01:45
    Worklog Time Spent: 10m 
      Work Description: chamikaramj commented on a change in pull request #6440: [BEAM-5412][BEAM-5408]
Fixes a bug that limited the size of TFRecords

 File path: sdks/java/core/src/test/java/org/apache/beam/sdk/io/
 @@ -287,6 +288,18 @@ public void runTestRoundTripZlibFilesWithAuto() throws IOException {
     runTestRoundTrip(LARGE, 10, ".tfrecords", DEFLATE, AUTO);
+  @Test
+  @Category(NeedsRunner.class)
+  public void runTestRoundTripLargeRecords() throws IOException {
 Review comment:
   runTestRoundTripLargeRecordsGzip() fails without this change. Other test is for completeness.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 145901)
    Time Spent: 1h 40m  (was: 1.5h)

> TFRecordIO fails with records larger than 8K
> --------------------------------------------
>                 Key: BEAM-5412
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-text
>    Affects Versions: 2.4.0
>            Reporter: Raghu Angadi
>            Assignee: Chamikara Jayalath
>            Priority: Major
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
> This was reported on [Stackoverflow|].
TFRecordIO reader assumes a single call to {{}} returns as much as can fit in
the input buffer. {{read()}} can return fewer bytes than requested. Assert failure :

This message was sent by Atlassian JIRA

View raw message