flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-629) Add support for null values to the java api
Date Tue, 16 Dec 2014 10:13:13 GMT

    [ https://issues.apache.org/jira/browse/FLINK-629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248081#comment-14248081
] 

Robert Metzger commented on FLINK-629:
--------------------------------------

The issue is that the Tweet class contains a Collection. This causes the system to treat the
whole Tweet class as a "unknown" class, serialized by Avro.

With this change: https://issues.apache.org/jira/browse/FLINK-610, we'll be able to handle
classes like your "Tweet" class more fine-grained. I'll work on the issue today to have the
fix in the upcoming 0.8 release.

> Add support for null values to the java api
> -------------------------------------------
>
>                 Key: FLINK-629
>                 URL: https://issues.apache.org/jira/browse/FLINK-629
>             Project: Flink
>          Issue Type: Improvement
>          Components: Java API
>            Reporter: Stephan Ewen
>            Assignee: Gyula Fora
>            Priority: Critical
>              Labels: github-import
>             Fix For: pre-apache
>
>         Attachments: model.tar.gz
>
>
> Currently, many runtime operations fail when encountering a null value. Tuple serialization
should allow null fields.
> I suggest to add a method to the tuples called `getFieldNotNull()` which throws a meaningful
exception when the accessed field is null. That way, we simplify the logic of operators that
should not dead with null fields, like key grouping or aggregations.
> Even though SQL allows grouping and aggregating of null values, I suggest to exclude
this from the java api, because the SQL semantics of aggregating null fields are messy.
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/629
> Created by: [StephanEwen|https://github.com/StephanEwen]
> Labels: enhancement, java api, 
> Milestone: Release 0.5.1
> Created at: Wed Mar 26 00:27:49 CET 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message