Return-Path: X-Original-To: apmail-datafu-dev-archive@minotaur.apache.org Delivered-To: apmail-datafu-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2DE82100F5 for ; Sat, 15 Mar 2014 15:27:32 +0000 (UTC) Received: (qmail 79243 invoked by uid 500); 15 Mar 2014 15:27:31 -0000 Delivered-To: apmail-datafu-dev-archive@datafu.apache.org Received: (qmail 79208 invoked by uid 500); 15 Mar 2014 15:27:31 -0000 Mailing-List: contact dev-help@datafu.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@datafu.incubator.apache.org Delivered-To: mailing list dev@datafu.incubator.apache.org Received: (qmail 79192 invoked by uid 99); 15 Mar 2014 15:27:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Mar 2014 15:27:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of matthew.terence.hayes@gmail.com designates 209.85.220.178 as permitted sender) Received: from [209.85.220.178] (HELO mail-vc0-f178.google.com) (209.85.220.178) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Mar 2014 15:27:24 +0000 Received: by mail-vc0-f178.google.com with SMTP id im17so4010658vcb.23 for ; Sat, 15 Mar 2014 08:27:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=08yDuJ+jgTgzq1C3saZ/yAoWGHnbcI3gxe5YPVLCOKU=; b=qww3VdX9ZHUORqNrsHXPgVEXyvapYHo/qOhyANa928PW0jUU5Vg3xnja+whVlDZqOc aY6zDT4D1skbl5II+sGM0F6mzO5h1I7pQDqxKNDqoQSwv88fFltCw9m0ltCSlI3mjw7N 2+sRujzy5v9sEsb6anxmUIRovn0fhUZq0JhH8nG23Ul/RwT6lrcJH3+NXQggOhr5//g+ LdTT26h+TUT4+fHgk6TDt3LhWDTeMLjWhgtk4qKbfcpyPRpb3DB7SU+HlS+KmFgPBAqE Hg2deakkbqzkgl/lC5MIIl7nuYFYuPmXOCSijK+u8+FBIv6GLoF3nMGTlZrCw0THWVOI 3+HQ== MIME-Version: 1.0 X-Received: by 10.58.57.42 with SMTP id f10mr11750063veq.1.1394897222813; Sat, 15 Mar 2014 08:27:02 -0700 (PDT) Received: by 10.58.207.129 with HTTP; Sat, 15 Mar 2014 08:27:02 -0700 (PDT) In-Reply-To: References: Date: Sat, 15 Mar 2014 08:27:02 -0700 Message-ID: Subject: Re: Some wrong in DataFu Hourglass's Getting Started. From: Matthew Hayes To: Daniel Wang , DataFu Content-Type: multipart/alternative; boundary=001a1136ac6676d03504f4a6d17d X-Virus-Checked: Checked by ClamAV on apache.org --001a1136ac6676d03504f4a6d17d Content-Type: text/plain; charset=ISO-8859-1 Okay thanks Daniel for confirming. We should update the docs to clarify that Hourglass is only supported on Hadoop 1.x at the moment. -Matt On Sat, Mar 15, 2014 at 3:37 AM, Daniel Wang wrote: > Hi, Matt > Thank you for your answer. I used Hadoop 2.2.0, may be its the problem. > Thanks, > Daniel > > > 2014-03-15 13:12 GMT+08:00, Matthew Hayes >: > > On Fri, Mar 14, 2014 at 10:11 PM, Matthew Hayes < > > matthew.terence.hayes@gmail.com> wrote: > > > >> Hi Daniel, > >> > >> Thanks for reporting this. Can you tell us what version of Hadoop you > >> are > >> using? I just tried the instructions again with Hadoop 1.0.4 and did > not > >> experience any problems. > >> > >> Thanks, > >> Matt > >> > >> > >> On Fri, Mar 14, 2014 at 9:41 PM, Daniel Wang > wrote: > >> > >>> hi ,I did some test by following the > >>> http://datafu.incubator.apache.org/docs/hourglass/getting-started.html > , > >>> but when I run " hadoop jar build/datafu-hourglass-test.jar countbyid > >>> -libjars ${LIBJARS} /data/event /output" some wrong as: > >>> 14/03/15 12:11:32 INFO mapreduce.Job: map 0% reduce 0% > >>> 14/03/15 12:11:48 INFO mapreduce.Job: map 7% reduce 0% > >>> 14/03/15 12:11:48 INFO mapreduce.Job: Task Id : > >>> attempt_1394813193657_0003_m_000011_0, Status : FAILED > >>> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, > >>> but class was expected > >>> 14/03/15 12:11:48 INFO mapreduce.Job: Task Id : > >>> attempt_1394813193657_0003_m_000010_0, Status : FAILED > >>> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, > >>> but class was expected > >>> 14/03/15 12:11:49 INFO mapreduce.Job: map 0% reduce 0% > >>> 14/03/15 12:11:49 INFO mapreduce.Job: Task Id : > >>> attempt_1394813193657_0003_m_000009_0, Status : FAILED > >>> ... > >>> 14/03/15 12:12:52 ERROR > >>> jobs.AbstractPartitionCollapsingIncrementalJob: Job failed! > >>> Quitting... > >>> 14/03/15 12:12:52 INFO jobs.FileCleaner: Removing > >>> /tmp/hourglass-97bfce22-d8f5-4422-a894-7fb15f5e3517 > >>> java.lang.RuntimeException: Job failed > >>> at > >>> > datafu.hourglass.jobs.AbstractPartitionCollapsingIncrementalJob.execute(AbstractPartitionCollapsingIncrementalJob.java:544) > >>> at > >>> > datafu.hourglass.jobs.AbstractPartitionCollapsingIncrementalJob.run(AbstractPartitionCollapsingIncrementalJob.java:352) > >>> at datafu.hourglass.demo.CountById.run(CountById.java:157) > >>> at datafu.hourglass.demo.CountById.run(CountById.java:60) > >>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > >>> at datafu.hourglass.demo.Main.run(Main.java:63) > >>> at datafu.hourglass.demo.Main.main(Main.java:48) > >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >>> at > >>> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >>> at > >>> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >>> at java.lang.reflect.Method.invoke(Method.java:622) > >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > >>> Hourglass demo tool. > >>> > >>> What is wrong with it? How to fix it? Thanks! > >>> > >> > >> > > > --001a1136ac6676d03504f4a6d17d--