Mailing-List: contact dev-help@asterixdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@asterixdb.apache.org
Subject: Re: Dump and restore for AsterixDB datasets
To: dev@asterixdb.apache.org
References: <62477976-0d36-376a-5532-64d06a9a4ba2@ics.uci.edu>
 <CAN_YF5wZ8-BrZZKLXDB7jpkt3YSERgTfZbf_2o88LWhRd_c6ZA@mail.gmail.com>
 <5F728100-7EE5-4BE8-8BAD-F00056577D4E@gmail.com>
From: Mike Carey <dtabass@gmail.com>
Message-ID: <3ecc1367-7373-3234-25e1-3c250a59accf@gmail.com>
Date: Tue, 24 May 2016 15:56:56 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0)
 Gecko/20100101 Thunderbird/45.1.0
MIME-Version: 1.0
In-Reply-To: <5F728100-7EE5-4BE8-8BAD-F00056577D4E@gmail.com>
Content-Type: multipart/alternative;
 boundary="------------BDEB397EB7598653DD397425"
archived-at: Tue, 24 May 2016 22:57:05 -0000

--------------BDEB397EB7598653DD397425
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit

Actually both.  We should test for binary back-compatibility but then 
have dump and restore (in serialized JSON) as a fallback so that when we 
break things, it's not hopeless for our users - they could dump 
(presumably a parallel process leaving JSON locally on each NC) and then 
restore (presumably a parallel process leading to "new binary" on each NC).


On 5/24/16 3:53 PM, Ildar Absalyamov wrote:
> I believe Mike meant binary roundtripability.
> How easy would it be to setup a Jenkins job which:
> 1) Takes a pre-commit version of Asterix, puts in tinySocial data, builds indexes, etc
> 2) Applies a commit and builds a new version.
> 3) Starts a new version with the old data and runs a tinySocial query set
> ?
>
>> On May 24, 2016, at 13:08, Ian Maxon <imaxon@uci.edu> wrote:
>>
>> The main problem right now is just the difference between the AQL that gets
>> output and the AQL the parser expects. We output the i64/i32 suffix for
>> example, but the parser doesn't like it (or at least that's how it was the
>> last time I tried this). I believe the are a few other rough edges like
>> this.
>>
>> On Tue, May 24, 2016 at 12:59 PM, Michael Carey <mjcarey@ics.uci.edu> wrote:
>>
>>> It's time for us to figure out how to get that working!!!  (Data
>>> roundtrips.)
>>>
>>> (So one could use that if we make unfortunate metadata/storage-format
>>> changes.)
>>>
>>> SDSC is getting serious about the data they are collecting (directly into
>>> AsterixDB, from social media, news, etc., sources.
>>>
>>>
>>>
> Best regards,
> Ildar
>


--------------BDEB397EB7598653DD397425--