Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 38899 invoked from network); 21 Jan 2008 22:38:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 21 Jan 2008 22:38:29 -0000 Received: (qmail 54716 invoked by uid 500); 21 Jan 2008 22:38:16 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 54679 invoked by uid 500); 21 Jan 2008 22:38:16 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 54670 invoked by uid 500); 21 Jan 2008 22:38:16 -0000 Delivered-To: apmail-lucene-hadoop-user@lucene.apache.org Received: (qmail 54667 invoked by uid 99); 21 Jan 2008 22:38:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jan 2008 14:38:16 -0800 X-ASF-Spam-Status: No, hits=4.4 required=10.0 tests=DNS_FROM_OPENWHOIS,HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [216.98.159.230] (HELO zimbra1.mindcentric.com) (216.98.159.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jan 2008 22:38:02 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by zimbra1.mindcentric.com (Postfix) with ESMTP id DF3FCCBDD33E for ; Mon, 21 Jan 2008 14:35:47 -0800 (PST) X-Spam-Score: -1.967 X-Spam-Level: Received: from zimbra1.mindcentric.com ([127.0.0.1]) by localhost (zimbra1.mindcentric.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id e9s2CyeL3d8b for ; Mon, 21 Jan 2008 14:35:42 -0800 (PST) Received: from localhost.localdomain (c-76-21-15-84.hsd1.ca.comcast.net [76.21.15.84]) by zimbra1.mindcentric.com (Postfix) with ESMTP id C619BCBDCD15 for ; Mon, 21 Jan 2008 14:35:42 -0800 (PST) Message-ID: <47951EBB.20707@attributor.com> Date: Mon, 21 Jan 2008 14:37:47 -0800 From: Jason Venner User-Agent: Thunderbird 2.0.0.9 (X11/20071115) MIME-Version: 1.0 To: "hadoop-user@lucene.apache.org" Subject: question aboutc++ libhdfs and a bug comment on the libdfs test case Content-Type: multipart/alternative; boundary="------------030200050905010607020105" X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Status: No, score=-1.967 tagged_above=-10 required=6.6 tests=[BAYES_00=-2.599, FORGED_RCVD_HELO=0.135, HTML_40_50=0.496, HTML_MESSAGE=0.001] --------------030200050905010607020105 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit We were wondering how stable it was for use? We have some 10 gig data sets that need a little translation before our java based hadoop jobs can run on them, and the translation library is in c++. We are thinking of using libdfs to to a translate while copying the data in to hdfs. Any gotchas with libhdfs that we should know about. While looking at the the HEAD version of the /lucene/hadoop/trunk/src/c++/libhdfs/hdfs_test.c, I noticed a small typeo *int* *main*(*int* argc, *char* **argv) { hdfsFS fs = hdfsConnect(*"default"*, 0); *if*(!fs) { fprintf(stderr, *"Oops! Failed to connect to hdfs!\n"*); exit(-1); } hdfsFS lfs = hdfsConnect(NULL, 0); *if*(!fs) { fprintf(stderr, *"Oops! Failed to connect to 'local' hdfs!\n"*); exit(-1); } I believe that test should be if(!lfs) { --------------030200050905010607020105--