reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shouheng Yi <sho...@microsoft.com.INVALID>
Subject RE: Updating Avro from 1.7.7 to 1.8.1
Date Tue, 04 Apr 2017 23:24:11 GMT
* Made some changes in the original email to comply with the email format.

Hi Reef devs,

Right now we have an interest of adding a parquet reader in REEF in REEF-1765[1]. The reason
is that we want to consume parquet file format which is widely used in Hadoop and Spark.

To do that, my current solution requires Avro 1.8.1 for it to work. I understand that there
are a lot of moving parts in Avro. Therefore I'm asking if updating 1.7.7 is viable. Thank
you for your feedback.

Best,
Shouheng

[1]: https://issues.apache.org/jira/browse/REEF-1765 <https://issues.apache.org/jira/browse/REEF-1765>



-----Original Message-----
From: Shouheng Yi [mailto:shouyi@microsoft.com.INVALID] 
Sent: Tuesday, April 4, 2017 4:20 PM
To: dev@reef.apache.org
Subject: Updating Avro from 1.7.7 to 1.8.1

Hi Reef devs,

Right now we have an interest of adding a parquet reader in REEF (https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FREEF-1765&data=02%7C01%7Cshouyi%40microsoft.com%7C6bc252f85a9e45a3d5ef08d47bb1246d%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636269448124808079&sdata=IZITo0K8aDXPhfbF9771YMcbbeGMvNQ2RePQO3u0JnE%3D&reserved=0).
The reason is that we want to consume parquet file format which is widely used in Hadoop and
Spark.

To do that, my current solution requires Avro 1.8.1 for it to work. I understand that there
are a lot of moving parts in Avro. Therefore I'm asking if updating 1.7.7 is viable. Thank
you for your feedback.

Best,
Shouheng

Mime
View raw message