gobblin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tamas Nemeth <tamas.nem...@prezi.com>
Subject Re: Schema format for csv-to-json converter
Date Fri, 08 Sep 2017 05:32:55 GMT
I was more thinking about if it would be possible to abstracting out the
specific schema implementation and making it pluggable.
Do you think it would make sense? Now if you would like to introduce a new
schema type then you need to duplicate all the converters which it would
affect.

Thanks,
Tamas

On Fri, Sep 8, 2017 at 2:29 AM Abhishek Tiwari <abti@apache.org> wrote:

> This format seems to be made up, unless I am missing out any standard
> specification in my search. Neither me nor who I asked around has any
> context on why this was chosen. Though we have veterans (dormant now) on
> this mail list who might know.
>
> If you are working on any standard schema based csv-to-json converter,
> then please feel free to raise a PR. Though we will want to keep the
> current ones around for backwards compatibility.
>
> Regards,
> Abhishek
>
>
> On Wed, Aug 30, 2017 at 2:28 AM, Tilak Patidar <tilakpatidar@gmail.com>
> wrote:
>
>> Hi Team,
>>
>> I had the similar doubt when working on JsonIntermediateToAvroConverter.
>> I had to figure the source schema by looking at code usages and example
>> template file.
>> Is there any specification for source schema that is followed? Or is it
>> made up? It looked like it draws inspiration from Avro schema
>> specifications.
>> Any thoughts on documenting source schema at some point?
>>
>>
>> *Regards**Tilak Patidar*
>> Email             tilakpatidar@gmail.com
>>                       tilakpr@thoughtworks.com
>> Telephone+91 8608690984 <+91%2086086%2090984>
>> [image: ThoughtWorks] <http://www.thoughtworks.com/>*"We are a community
>> of passionate individuals whose purpose is to revolutionize software
>> design, creation and delivery, while advocating for positive social change"*
>> <http://www.thoughtworks.com/>
>>
>> On Wed, Aug 30, 2017 at 1:02 PM, Tamas Nemeth <tamas.nemeth@prezi.com>
>> wrote:
>>
>>> Hi Team,
>>>
>>> I know you have a jira card for documenting the schema format for the
>>> csv to json converter but I thought I ask if it follows any standard schema
>>> format or it is a made up schema format?
>>> If it is a made up schema then why not using some standard like json
>>> schema for that?
>>> Do you have any concern about that, what do you think?
>>>
>>> Thanks,
>>> Tamas
>>>
>>
>>
>

Mime
View raw message