Mailing-List: contact user-help@avro.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@avro.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type;
  b=SpcB5FcyCjhGwLsB/1F8/S9HHK+f5nLp7EWgASn6YLSpJUAJPwTCodnVqQxO734BHV5oo4dv8W4UYmEvDJTlfIrdQGfrytZlmBM6em2wP+tPZJoojy4x83nTBK1GW0H17Ws7eca33Hamb18gh2AWco+bT2ltAbSLkp9GnAjQD88=;
Message-ID: <974461.39510.qm@web52705.mail.re2.yahoo.com>
Date: Sat, 6 Nov 2010 11:25:26 -0700 (PDT)
From: Douglas Campbell <deegs_ca@yahoo.com>
Reply-To: Douglas Campbell <deegs_ca@yahoo.com>
Subject: Re: 1.2 to 1.4 datafile conversion
To: "user@avro.apache.org" <user@avro.apache.org>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-1520806454-1289067926=:39510"

--0-1520806454-1289067926=:39510
Content-Type: text/plain; charset=us-ascii

Thanks for the info Doug and the patch looks promising.

So our logic for replacement could be something like

upon datafile read request, 
try to load with 1.4 
    if fail, try with 1.2 reader you provided, 
get records, save out with 1.4 after update


Should that be doable with what you've provided?


From: Doug Cutting <cutting@apache.org>
To: user@avro.apache.org
Cc: 
Sent: Thursday, November 4, 2010 2:33:10 PM
Subject: Re: 1.2 to 1.4 datafile conversion

On 11/03/2010 03:11 PM, Douglas Campbell wrote:
> Are there any tools for this because as far as we can tell 1.2 datafiles
> are unreadable by 1.4 apis?

Not that I know of.  I didn't think anyone had used the 1.2 datafile format!  But, if some did, a format converter would be a good tool to have.

I filed a Jira issue about this:

https://issues.apache.org/jira/browse/AVRO-692

I attached a patch to that that adds a class that should be able to read 1.2-format files.  Rewriting them in the current format should then be simple.  Do you require a command-line based tool?

Please follow up on that issue.

Thanks,

Doug


--0-1520806454-1289067926=:39510
Content-Type: text/html; charset=us-ascii

<html><body><div style="font-family:times new roman, new york, times, serif;font-size:12pt"><div><span>Thanks for the info Doug and the patch looks promising.<br></span></div><br>So our logic for replacement could be something like<br><br>upon datafile read request, <br>try to load with 1.4 <br>&nbsp;&nbsp;&nbsp; if fail, try with 1.2 reader you provided, <br>get records, save out with 1.4 after update<br><div style="font-size: 12pt; font-family: times new roman,new york,times,serif;"><br>Should that be doable with what you've provided?<br><br><div style="font-size: 12pt; font-family: times new roman,new york,times,serif;"><font face="Arial" size="2"><div readonly="true" style="border: 1px solid rgb(204, 204, 204); line-height: 0pt; font-size: 0pt; margin-top: 5px; margin-bottom: 5px; font-family: Arial;" class="hr" contenteditable="false"></div><b><span style="font-weight: bold;">From:</span></b> Doug Cutting &lt;cutting@apache.org&gt;<br><b><span
 style="font-weight: bold;">To:</span></b> user@avro.apache.org<br><b><span style="font-weight: bold;">Cc:</span></b> <br><b><span style="font-weight: bold;">Sent:</span></b> Thursday, November 4, 2010 2:33:10 PM<br><b><span style="font-weight: bold;">Subject:</span></b> Re: 1.2 to 1.4 datafile conversion<br></font><br> 
On 11/03/2010 03:11 PM, Douglas Campbell wrote:<br>&gt; Are there any tools for this because as far as we can tell 1.2 datafiles<br>&gt; are unreadable by 1.4 apis?<br><br>Not that I know of.&nbsp; I didn't think anyone had used the 1.2 datafile format!&nbsp; But, if some did, a format converter would be a good tool to have.<br><br>I filed a Jira issue about this:<br><br><a href="https://issues.apache.org/jira/browse/AVRO-692" target="_blank">https://issues.apache.org/jira/browse/AVRO-692</a><br><br>I attached a patch to that that adds a class that should be able to read 1.2-format files.&nbsp; Rewriting them in the current format should then be simple.&nbsp; Do you require a command-line based tool?<br><br>Please follow up on that issue.<br><br>Thanks,<br><br>Doug<br><br><br></div></div></div><br>

      </body></html>
--0-1520806454-1289067926=:39510--