Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of imperros@gmail.com designates
 74.125.82.51 as permitted sender)
Message-ID: <500E039B.1060906@gmail.com>
Date: Tue, 24 Jul 2012 05:08:27 +0300
From: Ioakim Perros <imperros@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux i686;
 rv:14.0) Gecko/20120714 Thunderbird/14.0
MIME-Version: 1.0
To: user@hbase.apache.org
Subject: Re: Efficient read/write - Iterative M/R jobs
References: <500DDB00.4000002@gmail.com>
In-Reply-To: <500DDB00.4000002@gmail.com>
Content-Type: multipart/alternative;
 boundary="------------040403010605020501090601"

--------------040403010605020501090601
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Update (for anyone ending up here after a possible google search on the 
issue) :

Finally, running M/R job in order to bulk import data in a 
pseudo-distributed is feasible (for testing purposes) .

The error concerning TotalOrderPartitioner had something to do with a 
trivial bug at the keys I passed from mappers.

The thing is that you need to add "guava-r09.jar" (or any version of 
latest guava I suppose - it is located under lib folder of hbase setup 
path) to the lib folder of hadoop setup path. I suppose that in order 
for the same job to run on a truly distributed environment, one has to 
add -libjars /path/to/guava.jar to the options of hadoop jar command.

On 07/24/2012 02:06 AM, Jean-Daniel Cryans wrote:
>> ... INFO mapred.JobClient: Task Id : attempt_201207232344_0001_m_000000_0,
>> Status : FAILED
>> java.lang.IllegalArgumentException: *Can't read partitions file*
>>      at
>> org.apache.hadoop.hbase.mapreduce.hadoopbackport.TotalOrderPartitioner.setConf(TotalOrderPartitioner.java:111)
>> ...
>>
>> I followed this link, while googling for the solution :
>> http://hbase.apache.org/book/trouble.mapreduce.html
>> and it implies a misconfiguration concerning a fully distributed
>> environment.
>>
>> I would like, therefore, to ask if it is even possible to bulk import data
>> in a pseudo-distributed mode and if this is the case, does anyone have a
>> guess about this error?
> AFAIK you just can't use the local job tracker for this, so you do
> need to start one.
>
> J-D


--------------040403010605020501090601--