spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wangyum <...@git.apache.org>
Subject [GitHub] spark issue #16990: [SPARK-19660][CORE][SQL] Replace the configuration prope...
Date Wed, 22 Feb 2017 01:36:22 GMT
Github user wangyum commented on the issue:

    https://github.com/apache/spark/pull/16990
  
    @srowen @felixcheung 
    The SQL query is related to the file name, see:
    https://github.com/apache/spark/blob/v2.1.0/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala#L314
    
    e.g;
    `set mapred.reduce.tasks=31`'s MD5 is `83c59d378571a6e487aa20217bd87817`, `set mapreduce.job.reduces=31`'s
MD5 is `be2c0b32a02a1154bfdee1a52530f387`.
    
    So I change the following file names:
    ```
    mv input12_hadoop20-0-db1cd54a4cb36de2087605f32e41824f                          input12_hadoop20-0-2b9ccaa793eae0e73bf76335d3d6880
    mv join14_hadoop20-1-db1cd54a4cb36de2087605f32e41824f                           join14_hadoop20-1-2b9ccaa793eae0e73bf76335d3d6880
    mv auto_join14_hadoop20-2-db1cd54a4cb36de2087605f32e41824f                      auto_join14_hadoop20-2-2b9ccaa793eae0e73bf76335d3d6880
    mv groupby4_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby4_noskew-2-be2c0b32a02a1154bfdee1a52530f387
    mv groupby4_map-2-83c59d378571a6e487aa20217bd87817                              groupby4_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby4_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby4_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby7_map-3-83c59d378571a6e487aa20217bd87817                              groupby7_map-3-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby2_limit-0-83c59d378571a6e487aa20217bd87817                            groupby2_limit-0-be2c0b32a02a1154bfdee1a52530f387
                     
    mv groupby6_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby6_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby5_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby5_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby5_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby5_noskew-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby2_map-2-83c59d378571a6e487aa20217bd87817                              groupby2_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby7_noskew-3-83c59d378571a6e487aa20217bd87817                           groupby7_noskew-3-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby1_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby1_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby8_map-2-83c59d378571a6e487aa20217bd87817                              groupby8_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby6_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby6_noskew-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby7_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby7_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby7_noskew_multi_single_reducer-2-83c59d378571a6e487aa20217bd87817      groupby7_noskew_multi_single_reducer-2-be2c0b32a02a1154bfdee1a52530f387
    mv groupby_map_ppr-2-83c59d378571a6e487aa20217bd87817                           groupby_map_ppr-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby8_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby8_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
                  
    mv groupby6_map-2-83c59d378571a6e487aa20217bd87817                              groupby6_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby1_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby1_noskew-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby1_limit-0-83c59d378571a6e487aa20217bd87817                            groupby1_limit-0-be2c0b32a02a1154bfdee1a52530f387
                     
    mv groupby5_map-2-83c59d378571a6e487aa20217bd87817                              groupby5_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby7_map_multi_single_reducer-2-83c59d378571a6e487aa20217bd87817         groupby7_map_multi_single_reducer-2-be2c0b32a02a1154bfdee1a52530f387
  
    mv groupby1_map-2-83c59d378571a6e487aa20217bd87817                              groupby1_map-2-be2c0b32a02a1154bfdee1a52530f387
                       
    mv groupby2_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby2_noskew-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby8_noskew-2-83c59d378571a6e487aa20217bd87817                           groupby8_noskew-2-be2c0b32a02a1154bfdee1a52530f387
                    
    mv groupby2_map_skew-2-83c59d378571a6e487aa20217bd87817                         groupby2_map_skew-2-be2c0b32a02a1154bfdee1a52530f387
  
    mv groupby1-3-d57ed4bbfee1ffaffaeba0a4be84c31d                                  groupby1-3-c8478dac3497697b4375ee35118a5c3e
    mv merge2-2-c95dc367df88c9e5cf77157f29ba2daf                                    merge2-2-6142f47d3fcdd4323162014d5eb35e07
    mv combine2-2-c95dc367df88c9e5cf77157f29ba2daf                                  combine2-2-6142f47d3fcdd4323162014d5eb35e07
    mv combine1-2-c95dc367df88c9e5cf77157f29ba2daf                                  combine1-2-6142f47d3fcdd4323162014d5eb35e07
    mv combine1-3-6e53a3ac93113f20db3a12f1dcf30e86                                  combine1-3-10266e3d5dd4c841c0d65030b1edba7c
    mv combine2-3-6e53a3ac93113f20db3a12f1dcf30e86                                  combine2-3-10266e3d5dd4c841c0d65030b1edba7c
    mv merge2-3-6e53a3ac93113f20db3a12f1dcf30e86                                    merge2-3-10266e3d5dd4c841c0d65030b1edba7c
    mv combine1-4-84967075baa3e56fff2a23f8ab9ba076                                  combine1-4-9cbd6d400fb6c3cd09010e3dbd76601
    mv combine2-4-84967075baa3e56fff2a23f8ab9ba076                                  combine2-4-9cbd6d400fb6c3cd09010e3dbd76601
    mv merge2-4-84967075baa3e56fff2a23f8ab9ba076                                    merge2-4-9cbd6d400fb6c3cd09010e3dbd76601
    mv merge2-5-2ee5d706fe3a3bcc38b795f6e94970ea                                    merge2-5-1ba2d6f3bb3348da3fee7fab4f283f34
    mv combine1-5-2ee5d706fe3a3bcc38b795f6e94970ea                                  combine1-5-1ba2d6f3bb3348da3fee7fab4f283f34
    mv combine2-5-2ee5d706fe3a3bcc38b795f6e94970ea                                  combine2-5-1ba2d6f3bb3348da3fee7fab4f283f34
    mv groupby1-5-dd7bf298b8c921355edd8665c6b0c168                                  groupby1-5-c9cee6382b64bd3d71177527961b8be2
    mv leftsemijoin_mr-7-8e9c2969b999557363e40f9ebb3f6d7c                           leftsemijoin_mr-7-6b9861b999092f1ea4fa1fd27a666af6
    mv rcfile_lazydecompress-5-68975193b30cb34102b380e647d8d5f4                     rcfile_lazydecompress-5-dd959af1968381d0ed90178d349b01a7
    mv input_testsequencefile-0-68975193b30cb34102b380e647d8d5f4                    input_testsequencefile-0-dd959af1968381d0ed90178d349b01a7
    mv input_testsequencefile-1-1c0f3be2d837dee49312e0a80440447e                    input_testsequencefile-1-ddbb8d5e5dc0988bda96ac2b4aec8f94
    mv rcfile_lazydecompress-11-3708198aac609695b22e19e89306034c                    rcfile_lazydecompress-11-25715870c569b0f8c3d483e3a38b3199
    mv input_testsequencefile-5-3708198aac609695b22e19e89306034c                    input_testsequencefile-5-25715870c569b0f8c3d483e3a38b3199
    mv parallel-0-23a4feaede17467a8cc26e4d86ec30f9                                  parallel-0-6dc30e2de057022e63bd2a645fbec4c2
    ```



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message