Return-Path: Delivered-To: apmail-hadoop-avro-dev-archive@minotaur.apache.org Received: (qmail 80752 invoked from network); 15 Mar 2010 17:28:38 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Mar 2010 17:28:38 -0000 Received: (qmail 4152 invoked by uid 500); 15 Mar 2010 17:27:50 -0000 Delivered-To: apmail-hadoop-avro-dev-archive@hadoop.apache.org Received: (qmail 4025 invoked by uid 500); 15 Mar 2010 17:27:50 -0000 Mailing-List: contact avro-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: avro-dev@hadoop.apache.org Delivered-To: mailing list avro-dev@hadoop.apache.org Received: (qmail 4017 invoked by uid 99); 15 Mar 2010 17:27:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Mar 2010 17:27:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Mar 2010 17:27:48 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 36D32234C48C for ; Mon, 15 Mar 2010 17:27:27 +0000 (UTC) Message-ID: <1854174772.269611268674047223.JavaMail.jira@brutus.apache.org> Date: Mon, 15 Mar 2010 17:27:27 +0000 (UTC) From: "Jeff Hodges (JIRA)" To: avro-dev@hadoop.apache.org Subject: [jira] Commented: (AVRO-465) C implementation requires you to know a file's schema before reading In-Reply-To: <1360429842.268621268669787304.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/AVRO-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845415#action_12845415 ] Jeff Hodges commented on AVRO-465: ---------------------------------- What I meant was: it should be written in OCaml, obviously. Sorry. Lost my patience. > C implementation requires you to know a file's schema before reading > -------------------------------------------------------------------- > > Key: AVRO-465 > URL: https://issues.apache.org/jira/browse/AVRO-465 > Project: Avro > Issue Type: Bug > Components: c > Affects Versions: 1.3.0 > Reporter: Jeff Hodges > Attachments: AVRO-465-schema_for_reader.patch > > > The C implementation gives the user no way of reading the objects in a data file without knowing the file's schema ahead of time. > While it does fill in the writers_schema part of the avro_file_reader_t on read, this field is not available to the API as it is left out of avro.h. Two options persent itself: 1) preserve the API as is and add a avro_schema_from_file_reader() function or 2) move the avro_file_reader_t and avro_file_writer_t structs to avro.h. > A third option, that I don't approve of, is providing a function that reads from a datafile but uses the writers_schema in the reader given instead of requiring another schema to be passed into it. This is problematic because anyone using the API would have fewer debugging and testing options when dealing with interop datasets. Any problem that occurs might just be the schema in the file being off, or whatever. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.