Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FDC096DA for ; Sat, 22 Sep 2012 19:51:12 +0000 (UTC) Received: (qmail 72824 invoked by uid 500); 22 Sep 2012 19:51:10 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 72795 invoked by uid 500); 22 Sep 2012 19:51:10 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 72786 invoked by uid 99); 22 Sep 2012 19:51:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 22 Sep 2012 19:51:10 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jvalencia@sharethis.com designates 209.85.220.172 as permitted sender) Received: from [209.85.220.172] (HELO mail-vc0-f172.google.com) (209.85.220.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 22 Sep 2012 19:51:03 +0000 Received: by vcbfo14 with SMTP id fo14so5468585vcb.31 for ; Sat, 22 Sep 2012 12:50:42 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=3i1UrNsVbV2cXVWks9BL/KVd9VBLBu6NpP+BMmwyw9g=; b=d1ybdBxJSjRGogCFVhUyeAKjXgnBtsch9N/s2e4bSi6BqtHDudh9IGFwuYX/o6Q8SH O63d70lIv+c1Lzx7iEsuNDJ0IXtaX0z5bGoyt4oelkTfTaRWOsqeSRMbInvi11+00rgy 2eW7hqqwjGVSX4tts6xtCetAHkOA2QqhsL1bWqv5W8qC5R1ZGFPYglroVqiNCEI17egx 3f8agHpx8Kxjyvm8YDwOqlLMo2bSD815nJwzM38C240/AM7d5/4kQ9WE/Esdy3NqOCxj /2XZw73KHdpyqFz/DMXrBI77qzU7KoCgO4UMA610k27r3A1hFl7deVv/f1m8Su/leJJe 7htw== MIME-Version: 1.0 Received: by 10.52.175.130 with SMTP id ca2mr4063487vdc.112.1348343442779; Sat, 22 Sep 2012 12:50:42 -0700 (PDT) Received: by 10.58.79.79 with HTTP; Sat, 22 Sep 2012 12:50:42 -0700 (PDT) In-Reply-To: <505D48FE.9000108@mebigfatguy.com> References: <505D48FE.9000108@mebigfatguy.com> Date: Sat, 22 Sep 2012 12:50:42 -0700 Message-ID: Subject: Re: Using Cassandra BulkOuputFormat With newer versions of Hadoop (.23+) From: Juan Valencia To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=bcaec5014c1df12fe004ca4fabd1 X-Gm-Message-State: ALoCoQkq2v0rxzWHUgbxwl8Sv5YwlGnx0XJC0yaq1wQmGm82JftGDNi8OvpK6No8tLgvQEYDM2Zl --bcaec5014c1df12fe004ca4fabd1 Content-Type: text/plain; charset=ISO-8859-1 I'm not sure, but I think 1.0.3 is the wrong branch: http://f.cl.ly/items/2z1q1k3Q402L2z061S3m/Apache%20Hadoop%20Versions.png I need the branch that goes down .22 to .23 The problem is "You lose binary backward compatibility.... Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected at org.apache.cassandra.hadoop.BulkOutputFormat.checkOutputSpecs(BulkOutputFormat.java:42)" On Fri, Sep 21, 2012 at 10:13 PM, Dave Brosius wrote: > I swapped in hadoop-core-1.0.3.jar and rebuilt cassandra, without issues. > What problems where you having? > > > > On 09/21/2012 07:40 PM, Juan Valencia wrote: > >> >> I can't seem to get Bulk Loading to Work in newer versions of Hadoop. >> since they switched JobContext from a class to an interface >> You lose binary backward compatibility.... >> Exception in thread "main" java.lang.**IncompatibleClassChangeError: >> Found interface org.apache.hadoop.mapreduce.**JobContext, but class was >> expected >> at org.apache.cassandra.hadoop.**BulkOutputFormat.**checkOutputSpecs(** >> BulkOutputFormat.java:42) >> >> I tried recompiling against the newer Hadoop, but things got messy fast. >> Has anyone done this? >> > > -- Learn More: SQI (Social Quality Index) - A Universal Measure of Social Quality --bcaec5014c1df12fe004ca4fabd1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I'm not sure, but I think 1.0.3 is the wrong branch:
http://f.cl.ly/items/2z1q1k3Q402L2z061S3m/Apache%20Hadoop%20Versions.png=
I need the branch that goes down .22 to .23=A0
The problem is
"You lose binary backward compatibility....
Exception in th= read "main" java.lang.IncompatibleClassChangeError: Found interfa= ce org.apache.hadoop.mapreduce.JobContext, but class was expected
at org.apache.cassandra.hadoop.BulkOutputFormat.checkOutputSpecs(BulkO= utputFormat.java:42)"

On Fri, Sep = 21, 2012 at 10:13 PM, Dave Brosius <dbrosius@mebigfatguy.com>= ; wrote:
I swapped in hadoop-core-1.0.3.jar and rebui= lt cassandra, without issues. What problems where you having?



On 09/21/2012 07:40 PM, Juan Valencia wrote:

I can't seem to get Bulk Loading to Work in newer versions of Hadoop. since they switched JobContext from a class to an interface
You lose binary backward compatibility....
Exception in thread "main" java.lang.IncompatibleClassChan= geError: Found interface org.apache.hadoop.mapreduce.JobContext, but= class was expected
at org.apache.cassandra.hadoop.BulkOutputFormat.checkOutputSp= ecs(BulkOutputFormat.java:42)

I tried recompiling against the newer Hadoop, but things got messy fast. = =A0Has anyone done this?




--
=

Learn More: =A0SQI (Social Quality Index) - A Universal= Measure of Social Quality

--bcaec5014c1df12fe004ca4fabd1--