pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From j.prasant...@gmail.com
Subject Re: Review Request: PIG-2831: MR-Cube implementation (Distributed cubing for holistic measures)
Date Tue, 04 Sep 2012 02:39:47 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6651/
-----------------------------------------------------------

(Updated Sept. 4, 2012, 2:39 a.m.)


Review request for pig and Dmitriy Ryaboy.


Changes
-------

Added RichInterStorage for statistics gathering and persisting. CubeSampleLoader for sampling
based random open input splits also added. Removed all old statistics estimation code.

Unit tests: All passed

Pre-commit tests: All passed
ant clean test-commit


Description
-------

This is a review board request for https://issues.apache.org/jira/browse/PIG-2831


This addresses bug PIG-2831.
    https://issues.apache.org/jira/browse/PIG-2831


Diffs (updated)
-----

  src/org/apache/pig/ResourceStatistics.java 97d2c53 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/CubeCompiler.java PRE-CREATION

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
48fc4af 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java 1d05a20

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java b87c209

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java
939da3c 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/RichInterInputFormat.java
PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/RichInterOutputFormat.java
PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/RichInterRecordReader.java
PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/RichInterRecordWriter.java
PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/RichInterStorage.java PRE-CREATION

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/MRPrinter.java 157caad

  src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java
e8c2f2c 
  src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/PhyPlanVisitor.java
ff65146 
  src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCube.java
PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java 0502917 
  src/org/apache/pig/builtin/CubeDimensions.java 5652029 
  src/org/apache/pig/builtin/JsonMetadata.java 28d5f91 
  src/org/apache/pig/builtin/RollupDimensions.java f6c26e4 
  src/org/apache/pig/impl/builtin/CubeSampleLoader.java PRE-CREATION 
  src/org/apache/pig/impl/builtin/HolisticCube.java PRE-CREATION 
  src/org/apache/pig/impl/builtin/HolisticCubeCompoundKey.java PRE-CREATION 
  src/org/apache/pig/impl/builtin/PartitionMaxGroup.java PRE-CREATION 
  src/org/apache/pig/impl/builtin/PostProcessCube.java PRE-CREATION 
  src/org/apache/pig/impl/util/Utils.java 270cb6a 
  src/org/apache/pig/newplan/logical/optimizer/LogicalPlanPrinter.java 13439c6 
  src/org/apache/pig/newplan/logical/relational/LOCube.java b262efb 
  src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java 67610cf 
  src/org/apache/pig/newplan/logical/rules/ColumnPruneHelper.java 369f5c2 
  src/org/apache/pig/parser/LogicalPlanBuilder.java 289a76f 
  src/org/apache/pig/pen/EquivalenceClasses.java 194f8cb 
  src/org/apache/pig/pen/LineageTrimmingVisitor.java 917073c 
  src/org/apache/pig/pen/util/DisplayExamples.java 265f8f7 
  test/org/apache/pig/impl/builtin/TestHolisticCubeCompundKey.java PRE-CREATION 
  test/org/apache/pig/impl/builtin/TestPostProcessCube.java PRE-CREATION 
  test/org/apache/pig/test/TestCubeOperator.java 65d56a6 

Diff: https://reviews.apache.org/r/6651/diff/


Testing
-------

Unit tests: All passed

Pre-commit tests: All passed
ant clean test-commit


Thanks,

Prasanth_J


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message