Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of timrobertson100@gmail.com
 designates 209.85.217.10 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:mime-version:content-type
         :content-transfer-encoding:content-disposition;
        b=UUMrF7FWj2wSA0P+wpwp2lc8Niln1rqxhTyaGMDdGR9incO7uHttqdYOaZ6NNsZ63D
         DDqc1NAftzn+utUJCkmvNWjaFTsac5cpaMMIWbvH6rVwUBxUtCSE5sFoT6BM6rN3xvyi
         4QWRuONYuByJtZGZNlmHVgOebGlmBTVIykQzQ=
Message-ID: <32120a6a0901071233r729e8381j8748016a30444e96@mail.gmail.com>
Date: Wed, 7 Jan 2009 21:33:24 +0100
From: "tim robertson" <timrobertson100@gmail.com>
To: hbase-user@hadoop.apache.org
Subject: UnknownScannerException
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi all,

Doing some concurrent tests with the following operations running on a
single table:

- mass insert into family1
- scanner running parsing records from family1, and updating same row
into family2
- lucene index built from family2

I am seeing occasionally the following exception (not reproducible reliably):

Exception in thread "main" java.lang.RuntimeException:
org.apache.hadoop.hbase.UnknownScannerException:
org.apache.hadoop.hbase.UnknownScannerException: Name:
-6847297385504321434
	at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
	at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)

	at org.apache.hadoop.hbase.client.HTable$ClientScanner$1.hasNext(HTable.java:1195)
	at com.ibiodiversity.index.parse.OccurrenceParser.run(OccurrenceParser.java:29)
	at com.ibiodiversity.index.parse.OccurrenceParser.main(OccurrenceParser.java:52)

Just running on laptop right now and a small table (1,000,000 rows) as
a first test - here is the scanner loop that is dying:

HTable table = new HTable("occurrence");
Scanner scanner = table.getScanner(new String[]{"unparsed:latitude",
"unparsed:longitude"});
for (RowResult result : scanner) {
    BatchUpdate batchUpdate = new BatchUpdate(result.getRow());
    Cell latitude = result.get("unparsed:latitude".getBytes());
    Cell longitude = result.get("unparsed:longitude".getBytes());
    batchUpdate.put("parsedGeospatial:latitude", parse(latitude.getValue()));
    batchUpdate.put("parsedGeospatial:longitude", parse(longitude.getValue()));
    table.commit(batchUpdate);
}

Am I abusing HBase running on the laptop (just in development...)?

Thanks,

Tim