spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From marmbrus <>
Subject [GitHub] spark pull request: [WIP][SPARK-2054][SQL] Code Generation for Exp...
Date Fri, 06 Jun 2014 06:02:51 GMT
GitHub user marmbrus opened a pull request:

    [WIP][SPARK-2054][SQL] Code Generation for Expression Evaluation

    This PR drops the aggregation code generation, which will be added back in a follow-up
PR.  The following remains to be done:
     - [ ] Remove remaining spurious changes.
     - [ ] Make configurable with #956

You can merge this pull request into a Git repository by running:

    $ git pull newCodeGen

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #993
commit 1972e2d5ecf919824cb47ee6b6295242c785e064
Author: Michael Armbrust <>
Date:   2014-05-11T18:30:56Z

    Split out generic logic for hash joins and create two concrete physical operators: BroadcastHashJoin
and ShuffledHashJoin.

commit f27119cf9dc46d18ea869e0e49a69f16dd0b7886
Author: Michael Armbrust <>
Date:   2014-05-11T18:31:20Z

    A simple strategy that broadcasts tables only when they are found in a configuration hint.

commit f7c750b7cf6473188a8f06d97e6532d8041660ed
Author: Michael Armbrust <>
Date:   2014-05-12T22:09:39Z


commit 2904d29e5a0d9197f301bac82c40682619f6b508
Author: Michael Armbrust <>
Date:   2014-05-29T22:34:24Z

    WIP: Code generation and more

commit fa6939c552623fa05f14cc06ce80b20fa7b7d549
Author: Michael Armbrust <>
Date:   2014-05-29T22:46:30Z

    Widen datatypes

commit 8b1b4a955895f2046384be5f5ca254b7e2971ab2
Author: Michael Armbrust <>
Date:   2014-05-29T23:52:53Z

    Simple draft of IN generation.

commit c742978b817762a802c8c18a72e13bb723b518c0
Author: Michael Armbrust <>
Date:   2014-05-30T01:01:29Z

    Make IN case insensitive.

commit 0557d4c8799a8b5384c1410544912f9359b01977
Author: Michael Armbrust <>
Date:   2014-05-30T01:14:14Z

    Add byte code dumper.

commit c6f4835c67f07d199e2e79defbe716cc2f47293b
Author: Michael Armbrust <>
Date:   2014-05-30T01:22:59Z

    Unique names for isIn functions.

commit 764673b7ab2d4de48bf3880256940f66ad06f662
Author: Michael Armbrust <>
Date:   2014-05-30T02:27:50Z

    Global lock on code generation, cache orderings.

commit 6ebe45f7142f600f72aac73a4cac32f56ab684d4
Author: Zongheng Yang <>
Date:   2014-06-01T20:31:20Z

    WIP: Case code gen hack.

commit 760ce3cdc16db449068e1f9cf3e15384e3cf305f
Author: Zongheng Yang <>
Date:   2014-06-01T21:30:12Z

    Fix parsing CASE?

commit b54d3bc7a9fcd8d8134b2c4eb1765482872d9c9e
Author: Michael Armbrust <>
Date:   2014-06-01T22:51:32Z

    Hacky draft of case statements with code gen.

commit 7c5405f45b7b546d6e3b3f4f5667ce515910e50c
Author: Michael Armbrust <>
Date:   2014-06-02T02:36:53Z

    Correctly type nulls in the case when.

commit 5d0db90ae86e7fb38de67a93960c074810993a77
Author: Michael Armbrust <>
Date:   2014-06-06T05:12:03Z

    Quiet logging.

commit 82cbd15483775a62fddd446a333401ff7640e8e2
Author: Michael Armbrust <>
Date:   2014-06-06T05:12:42Z

    Turn off HashAggregation

commit 1209daaf49b0a87e7f68f89c79d02b446e624db3
Author: Michael Armbrust <>
Date:   2014-06-06T05:16:37Z

    Drop broken CASE WHEN.

commit 9c8872b57c5b120ae841c4525f032f7d5cb5712c
Author: Michael Armbrust <>
Date:   2014-06-06T05:37:37Z

    Drop anon SchemaRDD.

commit 0748abd9adc171257548df142bf63ab73159e5ac
Author: Michael Armbrust <>
Date:   2014-06-06T05:55:32Z

    Fix style. Drop test code.


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message