gobblin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Tiwari <a...@apache.org>
Subject Re: Schema format for csv-to-json converter
Date Fri, 08 Sep 2017 08:19:09 GMT
Yes, sounds like a good approach and doable as well.


On Thu, Sep 7, 2017 at 10:32 PM, Tamas Nemeth <tamas.nemeth@prezi.com>

> I was more thinking about if it would be possible to abstracting out the
> specific schema implementation and making it pluggable.
> Do you think it would make sense? Now if you would like to introduce a new
> schema type then you need to duplicate all the converters which it would
> affect.
> Thanks,
> Tamas
> On Fri, Sep 8, 2017 at 2:29 AM Abhishek Tiwari <abti@apache.org> wrote:
>> This format seems to be made up, unless I am missing out any standard
>> specification in my search. Neither me nor who I asked around has any
>> context on why this was chosen. Though we have veterans (dormant now) on
>> this mail list who might know.
>> If you are working on any standard schema based csv-to-json converter,
>> then please feel free to raise a PR. Though we will want to keep the
>> current ones around for backwards compatibility.
>> Regards,
>> Abhishek
>> On Wed, Aug 30, 2017 at 2:28 AM, Tilak Patidar <tilakpatidar@gmail.com>
>> wrote:
>>> Hi Team,
>>> I had the similar doubt when working on JsonIntermediateToAvroConverter.
>>> I had to figure the source schema by looking at code usages and example
>>> template file.
>>> Is there any specification for source schema that is followed? Or is it
>>> made up? It looked like it draws inspiration from Avro schema
>>> specifications.
>>> Any thoughts on documenting source schema at some point?
>>> *Regards**Tilak Patidar*
>>> Email             tilakpatidar@gmail.com
>>>                       tilakpr@thoughtworks.com
>>> Telephone+91 8608690984 <+91%2086086%2090984>
>>> [image: ThoughtWorks] <http://www.thoughtworks.com/>*"We are a
>>> community of passionate individuals whose purpose is
>>> to revolutionize software design, creation and delivery, while advocating
>>> for positive social change"* <http://www.thoughtworks.com/>
>>> On Wed, Aug 30, 2017 at 1:02 PM, Tamas Nemeth <tamas.nemeth@prezi.com>
>>> wrote:
>>>> Hi Team,
>>>> I know you have a jira card for documenting the schema format for the
>>>> csv to json converter but I thought I ask if it follows any standard schema
>>>> format or it is a made up schema format?
>>>> If it is a made up schema then why not using some standard like json
>>>> schema for that?
>>>> Do you have any concern about that, what do you think?
>>>> Thanks,
>>>> Tamas

View raw message