Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of lars.george@gmail.com
 designates 209.85.215.46 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type:content-transfer-encoding;
        b=f8w6AlomfJIi5rpat7kNLOui+FVUcbH4Ly5hf2E1LEhIUhIdmMwpUlY+Zm+KZK6iLF
         2jmyXfWsEsi66JtQZ7ci3oV9s15FYk1yJNMhSpAJnZ+VoLmv5CWMym7xKnrK9c2ntpcN
         Xw0YyJbmdh3eVGt55ZccXQuQwGckzpztNA0jY=
MIME-Version: 1.0
In-Reply-To: <AANLkTikoS=bS+AadGKpFCMegARDnh=rQ4aPiBR35_5RZ@mail.gmail.com>
References: <AANLkTikoS=bS+AadGKpFCMegARDnh=rQ4aPiBR35_5RZ@mail.gmail.com>
Date: Mon, 6 Dec 2010 12:08:00 +0100
Message-ID: <AANLkTin3FmRk_yKsU+PdKVojTAQxNv=ckiNit0W43V4D@mail.gmail.com>
Subject: Re: Command line integration question
From: Lars George <lars.george@gmail.com>
To: user@hbase.apache.org
Cc: dev@mahout.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Dmitriy,

I think you sent this to the wrong list? You sent to hbase-user but
this is a Mahout related question. Please check.

Lars

On Mon, Dec 6, 2010 at 12:17 AM, Dmitriy Lyubimov <dlieu.7@gmail.com> wrote=
:
> Dear all,
>
> I am testing the command line integration for the SSVD patch in hadoop mo=
de
> and running into some difficulties.
> Even that I defined $HADDOP_HOME and $HADOOP_CONF_DIR, apparently dfs
> configuration is not being picked up.
>
> I do run on CDH3b3, however, all hadoop configuration is 100% compatible
> with 0.20. I am using AbstractJob.getConf() to acquire initial properties
> but it looks like fs.default.name is not being set still. And i tried to
> locate theh code that loads that hadoop conf but wasn't immediately able =
to
> find it. Could you please help me what i need to do to retrieve initial
> hadoop configuration correctly? I am missing something very simple here.
>
> Thank you in advance.
> -Dmitriy
>
> bin/mahout ssvd -i /mahout/ssvdtest/A -o /mahout/ssvd-out/1 -k 100 -p 100=
 -r
> 200
> Running on hadoop, using HADOOP_HOME=3D/home/dmitriy/tools/hadoop
> HADOOP_CONF_DIR=3D/home/dmitriy/tools/hadoop/conf
> 10/12/05 15:09:55 INFO common.AbstractJob: Command line arguments:
> {--blockHeight=3D200, --computeU=3Dtrue, --computeV=3Dtrue, --endPhase=3D=
2147483647,
> --input=3D/mahout/ssvdtest/A, --minSplitSize=3D-1, --output=3D/mahout/ssv=
d-out/1,
> --oversampling=3D100, --rank=3D100, --reduceTasks=3D1, --startPhase=3D0,
> --tempDir=3Dtemp}
> Exception in thread "main" java.lang.NullPointerException
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:118)
> =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:110=
)
> =A0 =A0 =A0 =A0at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDSolver.run(SSVDSolver.jav=
a:177)
> =A0 =A0 =A0 =A0at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDCli.run(SSVDCli.java:75)
> =A0 =A0 =A0 =A0at
> org.apache.mahout.math.hadoop.stochasticsvd.SSVDCli.main(SSVDCli.java:108=
)
> =A0 =A0 =A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Met=
hod)
> =A0 =A0 =A0 =A0at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:39)
> =A0 =A0 =A0 =A0at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI=
mpl.java:25)
> =A0 =A0 =A0 =A0at java.lang.reflect.Method.invoke(Method.java:597)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDri=
ver.java:68)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> =A0 =A0 =A0 =A0at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver=
.java:182)
> =A0 =A0 =A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Met=
hod)
> =A0 =A0 =A0 =A0at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:39)
> =A0 =A0 =A0 =A0at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI=
mpl.java:25)
> =A0 =A0 =A0 =A0at java.lang.reflect.Method.invoke(Method.java:597)
> =A0 =A0 =A0 =A0at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>