hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-13241) LLAP: Incremental Caching marks some small chunks as "incomplete CB"
Date Wed, 09 Mar 2016 03:09:40 GMT
Gopal V created HIVE-13241:
------------------------------

             Summary: LLAP: Incremental Caching marks some small chunks as "incomplete CB"
                 Key: HIVE-13241
                 URL: https://issues.apache.org/jira/browse/HIVE-13241
             Project: Hive
          Issue Type: Bug
            Reporter: Gopal V


Run #3 of a query with 1 node still has cache misses.

{code}
LLAP IO Summary
----------------------------------------------------------------------------------------------
  VERTICES ROWGROUPS  META_HIT  META_MISS  DATA_HIT  DATA_MISS  ALLOCATION     USED  TOTAL_IO
----------------------------------------------------------------------------------------------
     Map 1        11      1116          0    1.65GB    93.61MB          0B       0B    32.72s
----------------------------------------------------------------------------------------------
{code}

{code}
2016-03-08T21:05:39,417 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking
0x1c44401d(1) due to reuse
2016-03-08T21:05:39,417 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding
an already-uncompressed buffer 0x1c44401d(2)
2016-03-08T21:05:39,417 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking
0x4e51b032(1) due to reuse
2016-03-08T21:05:39,417 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding
an already-uncompressed buffer 0x4e51b032(2)
2016-03-08T21:05:39,418 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:addOneCompressionBuffer(1161)) - Found CB
at 1373931, chunk length 86587, total 86590, compressed
2016-03-08T21:05:39,418 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:addIncompleteCompressionBuffer(1241)) -
Replacing data range [1373931, 1408408), size: 34474(!) type: direct (and 0 previous chunks)
with incomplete CB start: 1373931 end: 1408408 in the buffers
2016-03-08T21:05:39,418 INFO  [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl (EncodedReaderImpl.java:createRgColumnStreamData(441)) - Getting
data for column 7 RG 14 stream DATA at 1460521, 319811 index position 0: compressed [1626961,
1780332)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message