hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14323) Encoding rpc payload instead of compression
Date Fri, 28 Aug 2015 03:10:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717985#comment-14717985
] 

binlijin commented on HBASE-14323:
----------------------------------

{code}
 28.23%    java  perf-12553.map                  [.] 0x00007fd7e5248f3a                  
                                                                                      
 12.65%    java  libjvm.so                       [.] 0x00000000006e07c0                  
                                                                                      
 10.29%    java  libzip.so                       [.] deflate_slow                        
                                                                                      
  6.03%    java  libzip.so                       [.] pqdownheap                          
                                                                                      
  4.57%    java  [kernel.kallsyms]               [k] 0xffffffff8103548a                  
                                                                                      
  4.17%    java  libzip.so                       [.] inflate_fast                        
                                                                                      
  4.02%    java  libzip.so                       [.] compress_block                      
                                                                                      
  3.25%    java  libzip.so                       [.] crc32                               
                                                                                      
  3.24%    java  libzip.so                       [.] build_tree                          
                                                                                      
  3.06%    java  libzip.so                       [.] inflate_table                       
                                                                                      
  2.30%    java  libc-2.5.so                     [.] 0x000000000007b874                  
                                                                                      
  2.22%    java  libzip.so                       [.] longest_match                       
                                                                                      
  1.35%    java  libzip.so                       [.] inflate                             
                                                                                      
  1.25%    java  libzip.so                       [.] fill_window                         
                                                                                      
  1.23%    java  libjemalloc.so.1                [.] arena_avail_comp                    
                                                                                      
  1.19%    java  libzip.so                       [.] send_tree                           
                                                                                      
  1.09%    java  libintlc.so.5                   [.] __intel_new_memcpy                  
                                                                                      
  0.84%    java  libjemalloc.so.1                [.] arena_avail_tree_insert             
                                                                                      
  0.81%    java  libjemalloc.so.1                [.] arena_avail_tree_remove             
                                                                                      
  0.69%    java  libzip.so                       [.] scan_tree                           
                                                                                      
  0.55%    java  libzip.so                       [.] Java_java_util_zip_Deflater_deflateBytes
                                                                                  
  0.47%    java  libjemalloc.so.1                [.] arena_mapp_get                      
                                                                                      
  0.43%    java  libzip.so                       [.] deflate                             
                                                                                      
  0.34%    java  libzip.so                       [.] _tr_flush_block                     
                                                                                      
  0.29%  :12553  [unknown]                       [.] 0x00007fd7e81a81a2                  
                                                                                      
  0.28%    java  libpthread-2.5.so               [.] 0x0000000000008d10                  
                                                                                      
  0.23%    java  libjemalloc.so.1                [.] arena_mapbits_get                   
                                                                                      
  0.19%    java  libjemalloc.so.1                [.] arena_run_dalloc                    
                                                                                      
  0.19%    java  libzip.so                       [.] _tr_init                            
                                                                                      
  0.18%    java  libjemalloc.so.1                [.] arena_run_split                     
                                                                                      
  0.17%    java  libzip.so                       [.] Java_java_util_zip_CRC32_updateBytes
                                                                                      
  0.16%    java  libjemalloc.so.1                [.] arena_mapbitsp_get                  
                                                                                      
  0.15%    java  libjemalloc.so.1                [.] arena_avail_tree_nsearch            
                                                                                      
  0.15%    java  libjemalloc.so.1                [.] arena_mapbits_get                   
                                                                                      
  0.14%    java  libzip.so                       [.] inflateEnd                          
                                                                                      
  0.13%    java  libjemalloc.so.1                [.] arena_malloc_large                  
                                                                                      
  0.12%    java  [vsyscall]                      [.] 0x0000000000000168                  
                                                                                      
  0.12%    java  libjemalloc.so.1                [.] tcache_alloc_small                  
                                                                                      
  0.11%    java  libjemalloc.so.1                [.] arena_mapbits_unallocated_set       
                                                                                      
  0.11%    java  libjemalloc.so.1                [.] arena_dalloc_large_locked           
                                                                                      
  0.11%    java  libjemalloc.so.1                [.] arena_mapp_get                      
                                                                                      
  0.09%    java  libjemalloc.so.1                [.] malloc                     
{code}

> Encoding rpc payload instead of compression
> -------------------------------------------
>
>                 Key: HBASE-14323
>                 URL: https://issues.apache.org/jira/browse/HBASE-14323
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: binlijin
>         Attachments: HBASE-14323-test.patch
>
>
> Current HFile block support both encoding and compression, but rpc support only compression
and it is slow. If we add encoding in rpc we can slow a little but may use much less network.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message