crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adric Eckstein (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-572) Avro schema error in Avros.tableOf() can't redefine org.apache.avro.mapred.Pair
Date Thu, 15 Oct 2015 18:01:05 GMT
Adric Eckstein created CRUNCH-572:
-------------------------------------

             Summary: Avro schema error in Avros.tableOf() can't redefine org.apache.avro.mapred.Pair
                 Key: CRUNCH-572
                 URL: https://issues.apache.org/jira/browse/CRUNCH-572
             Project: Crunch
          Issue Type: Bug
    Affects Versions: 0.13.0
            Reporter: Adric Eckstein


The Avros.tableOf() method produces a record schema named "org.apache.avro.mapred.Pair", which
cannot be unique across types, whereas the Avros.pairs() method similarly creates a record
schema, but calls Avros.createTupleSchema() which creates a unique name at every call.

Example that fails on constructing schema:
AvroType<Pair<String, String>> t1 = Avros.tableOf(Avros.strings(), Avros.strings());
AvroType<Pair<String, Double>> t2 = Avros.tableOf(Avros.strings(), Avros.doubles());
AvroType<Pair<Pair<String, String>, Pair<String, Double>>> t3 = Avros.pairs(t1,
t2);
System.out.println("schema: " + t3.getSchema().toString());

Can the tableOf() method be updated to call the createTupleSchema() method instead of the
avro pair constructor?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message