hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergey Shelukhin <ser...@hortonworks.com>
Subject Re: Review Request 55247: LLAP: use LLAP cache for non-columnar formats in a somewhat general way
Date Fri, 06 Jan 2017 22:52:59 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55247/
-----------------------------------------------------------

(Updated Jan. 6, 2017, 10:52 p.m.)


Review request for hive, Gopal V, Prasanth_J, and Siddharth Seth.


Repository: hive-git


Description
-------

see JIRA


Diffs (updated)
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 47db0c0 
  data/files/over10k.gz PRE-CREATION 
  llap-client/src/java/org/apache/hadoop/hive/llap/io/api/LlapIo.java d82757f 
  llap-server/src/java/org/apache/hadoop/hive/llap/IncrementalObjectSizeEstimator.java 3efbcc2

  llap-server/src/java/org/apache/hadoop/hive/llap/cache/BuddyAllocator.java d9d407d 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/EvictionDispatcher.java b6fd3e3 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/FileCache.java PRE-CREATION 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/FileCacheCleanupThread.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/cache/LlapDataBuffer.java d1a961c 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelCacheImpl.java ea458ca 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelLrfuCachePolicy.java 17be8a0

  llap-server/src/java/org/apache/hadoop/hive/llap/cache/SerDeLowLevelCacheImpl.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapInputFormat.java 290624d

  llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapIoImpl.java 8048624 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapRecordReader.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/ColumnVectorProducer.java db86296

  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/EncodedDataConsumer.java 6b54b30

  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/GenericColumnVectorProducer.java
PRE-CREATION 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/OrcColumnVectorProducer.java
2e9b9c3 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/OrcEncodedDataConsumer.java 29f1ba8

  llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/ReadPipeline.java 4e1b851 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/LineRrOffsetReader.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/PassThruOffsetReader.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/SerDeEncodedDataReader.java
PRE-CREATION 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/ConsumerFileMetadata.java PRE-CREATION

  llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/ConsumerStripeMetadata.java
PRE-CREATION 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/OrcFileMetadata.java 70cba05

  llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/OrcMetadataCache.java 3f4f43b

  llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/OrcStripeMetadata.java 6f0b9ff

  orc/src/java/org/apache/orc/OrcUtils.java dc83b9c 
  orc/src/java/org/apache/orc/impl/PhysicalWriter.java 83742e4 
  orc/src/java/org/apache/orc/impl/RecordReaderImpl.java 975804b 
  orc/src/java/org/apache/orc/impl/TreeReaderFactory.java 3ddafba 
  orc/src/java/org/apache/orc/impl/WriterImpl.java 518a5f7 
  ql/src/java/org/apache/hadoop/hive/llap/DebugUtils.java 3d81e43 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java 601ad08 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 0161c20 
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorMapOperator.java 323419c 
  ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveRecordReader.java ba25573 
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 94fcd60 
  ql/src/java/org/apache/hadoop/hive/ql/io/LlapWrappableInputFormatInterface.java 66e1f90

  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 361901e 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/WriterImpl.java 075c3b4 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/CacheChunk.java 2325140 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/EncodedTreeReaderFactory.java d5f5f9d

  ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/StreamUtils.java cef765c 
  ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/stats/PartialScanMapper.java 09e4a47 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/LlapDecider.java e1fb8fb 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java 2a99274 
  ql/src/java/org/apache/hadoop/hive/ql/plan/MapWork.java 601324a 
  ql/src/java/org/apache/hadoop/hive/ql/plan/VectorPartitionDesc.java 7bf70c6 
  ql/src/test/queries/clientpositive/llap_text.q PRE-CREATION 
  ql/src/test/results/clientpositive/llap_text.q.out PRE-CREATION 
  storage-api/src/java/org/apache/hadoop/hive/common/io/DiskRangeList.java 62f9d8e 
  storage-api/src/java/org/apache/hadoop/hive/common/io/encoded/EncodedColumnBatch.java 13772c9


Diff: https://reviews.apache.org/r/55247/diff/


Testing
-------


Thanks,

Sergey Shelukhin


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message