hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject REST compression support (was Re: question about meta data query intensity)
Date Wed, 24 Nov 2010 18:15:31 GMT
Regards compressing the HTTP transactions between the REST server and REST client we punted
on this back when Stargate had a WAR target so we could push that off to the servlet container
configuration. Thanks for the question, which reminded me... I have just committed HBASE-3275,
which is a trivial patch to support Accept-Encoding: gzip,deflate

Index: src/main/java/org/apache/hadoop/hbase/rest/Main.java
--- src/main/java/org/apache/hadoop/hbase/rest/Main.java        (revision 1038732)
+++ src/main/java/org/apache/hadoop/hbase/rest/Main.java        (working copy)
@@ -37,6 +37,7 @@
 import org.mortbay.jetty.Server;
 import org.mortbay.jetty.servlet.Context;
 import org.mortbay.jetty.servlet.ServletHolder;
+import org.mortbay.servlet.GzipFilter;
 import com.sun.jersey.spi.container.servlet.ServletContainer;
@@ -132,6 +133,7 @@
       // set up context
     Context context = new Context(server, "/", Context.SESSIONS);
     context.addServlet(sh, "/*");
+    context.addFilter(GzipFilter.class, "/*", 0);

Regards interactions between HBase client and server, there is no option available for compressing
Hadoop RPC.

  - Andy

--- On Wed, 11/24/10, Jack Levin <magnito@gmail.com> wrote:

> From: Jack Levin <magnito@gmail.com>
> Subject: Re: question about meta data query intensity
> To: user@hbase.apache.org, apurtell@apache.org
> Date: Wednesday, November 24, 2010, 9:25 AM
> Yes, but that does not alleviate CPU contention should there be too
> many queries to a single region server.   On a separate topic, is
> 'compression' in the works for REST gateway?   Similar to
> mysql_client_compression?  We plan to drop in 500K or
> more queries at a time into the REST, and it would be interesting
> to see the performance gain against uncompressed data.
> Thanks.
> -Jack


View raw message