accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser" <josh.el...@gmail.com>
Subject Re: Review Request 21826: Accumulo-2632
Date Thu, 22 May 2014 20:34:18 GMT


> On May 22, 2014, 8:28 p.m., Josh Elser wrote:
> > Have you done any benchmarks with these changes? I would think that you should see
higher CPU usage with less disk I/O, and, overall, quicker ingest. It would be good to see
some before and after numbers that show this.

Oops, sorry. I didn't see the attachment you put on the ticket :)


- Josh


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21826/#review43764
-----------------------------------------------------------


On May 22, 2014, 7:57 p.m., John McNamee wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21826/
> -----------------------------------------------------------
> 
> (Updated May 22, 2014, 7:57 p.m.)
> 
> 
> Review request for accumulo.
> 
> 
> Repository: accumulo
> 
> 
> Description
> -------
> 
> The goal was to find a way to increase the write speed in the DfsLogger using compression.
> This patch uses the Snappy compression library and was the most optimum way that I could
find to increase write performance.
> The option to use compression has been made configurable.
> Recovery has been modified to uncompress the WAL if needed.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/accumulo/core/conf/Property.java 62b0a33 
>   server/tserver/src/main/java/org/apache/accumulo/tserver/log/DecompressingInputStream.java
PRE-CREATION 
>   server/tserver/src/main/java/org/apache/accumulo/tserver/log/DfsLogger.java bfa51d3

>   server/tserver/src/test/java/org/apache/accumulo/tserver/log/DecompressingInputStreamTest.java
PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/21826/diff/
> 
> 
> Testing
> -------
> 
> There is a unit test for the DecryptingInputStream.java, and I ran continuous Ingest/
continuous verify with the agitator on.
> 
> 
> Thanks,
> 
> John McNamee
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message