beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tibor Kiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1680) Uber-JIRA: Extend Python-SDK's unit test coverage
Date Sun, 02 Apr 2017 06:35:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952554#comment-15952554
] 

Tibor Kiss commented on BEAM-1680:
----------------------------------

Updated the coverage results to use GCP profile

> Uber-JIRA: Extend Python-SDK's unit test coverage
> -------------------------------------------------
>
>                 Key: BEAM-1680
>                 URL: https://issues.apache.org/jira/browse/BEAM-1680
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py
>            Reporter: Tibor Kiss
>            Assignee: Tibor Kiss
>            Priority: Minor
>
> Some components of the Python-SDK has low coverage rate.
> As of now ([ea33e33|https://github.com/apache/beam/tree/ea33e33]) the test coverage looks
as follows (excluding autocomplete_test.py):
> {code}
> Ran 1050 tests in 145.653s
> OK (skipped=14)
> py27gcp runtests: commands[5] | coverage report
> Name                                                                               Stmts
  Miss  Cover
> ------------------------------------------------------------------------------------------------------
> apache_beam/__init__.py                                                             
 12      1    92%
> apache_beam/coders/__init__.py                                                      
  2      0   100%
> apache_beam/coders/coder_impl.py                                                    
414     23    94%
> apache_beam/coders/coders.py                                                        
392     68    83%
> apache_beam/coders/coders_test.py                                                   
 54      3    94%
> apache_beam/coders/coders_test_common.py                                            
179      3    98%
> apache_beam/coders/observable.py                                                    
 10      0   100%
> apache_beam/coders/observable_test.py                                               
 28      2    93%
> apache_beam/coders/proto2_coder_test_messages_pb2.py                                
 51      0   100%
> apache_beam/coders/slow_coders_test.py                                              
 15      3    80%
> apache_beam/coders/slow_stream.py                                                   
105      6    94%
> apache_beam/coders/standard_coders_test.py                                          
 72     15    79%
> apache_beam/coders/stream_test.py                                                   
127     14    89%
> apache_beam/coders/typecoders.py                                                    
 69      6    91%
> apache_beam/error.py                                                                
  7      0   100%
> apache_beam/internal/__init__.py                                                    
  0      0   100%
> apache_beam/internal/gcp/__init__.py                                                
  0      0   100%
> apache_beam/internal/gcp/auth.py                                                    
 75     39    48%
> apache_beam/internal/gcp/auth_test.py                                               
 17      2    88%
> apache_beam/internal/gcp/json_value.py                                              
 64      8    88%
> apache_beam/internal/gcp/json_value_test.py                                         
 49      3    94%
> apache_beam/internal/module_test.py                                                 
 23      0   100%
> apache_beam/internal/pickler.py                                                     
 96     10    90%
> apache_beam/internal/pickler_test.py                                                
 30      1    97%
> apache_beam/internal/util.py                                                        
 30      0   100%
> apache_beam/internal/util_test.py                                                   
 32      1    97%
> apache_beam/io/__init__.py                                                          
 16      2    88%
> apache_beam/io/avroio.py                                                            
139     14    90%
> apache_beam/io/avroio_test.py                                                       
200     17    92%
> apache_beam/io/concat_source.py                                                     
134     10    93%
> apache_beam/io/concat_source_test.py                                                
132      8    94%
> apache_beam/io/filebasedsource.py                                                   
112      3    97%
> apache_beam/io/filebasedsource_test.py                                              
478      4    99%
> apache_beam/io/fileio.py                                                            
188     55    71%
> apache_beam/io/fileio_test.py                                                       
154      2    99%
> apache_beam/io/filesystem.py                                                        
184     23    88%
> apache_beam/io/filesystems_util.py                                                  
  7      0   100%
> apache_beam/io/gcp/__init__.py                                                      
  0      0   100%
> apache_beam/io/gcp/bigquery.py                                                      
418     29    93%
> apache_beam/io/gcp/bigquery_test.py                                                 
434     11    97%
> apache_beam/io/gcp/datastore/__init__.py                                            
  0      0   100%
> apache_beam/io/gcp/datastore/v1/__init__.py                                         
  0      0   100%
> apache_beam/io/gcp/datastore/v1/datastoreio.py                                      
170     33    81%
> apache_beam/io/gcp/datastore/v1/datastoreio_test.py                                 
146      5    97%
> apache_beam/io/gcp/datastore/v1/fake_datastore.py                                   
 38      2    95%
> apache_beam/io/gcp/datastore/v1/helper.py                                           
126      8    94%
> apache_beam/io/gcp/datastore/v1/helper_test.py                                      
175      4    98%
> apache_beam/io/gcp/datastore/v1/query_splitter.py                                   
102      7    93%
> apache_beam/io/gcp/datastore/v1/query_splitter_test.py                              
127      3    98%
> apache_beam/io/gcp/gcsfilesystem.py                                                 
109     11    90%
> apache_beam/io/gcp/gcsfilesystem_test.py                                            
129      2    98%
> apache_beam/io/gcp/gcsio.py                                                         
413     46    89%
> apache_beam/io/gcp/gcsio_test.py                                                    
478      5    99%
> apache_beam/io/gcp/internal/__init__.py                                             
  0      0   100%
> apache_beam/io/gcp/internal/clients/__init__.py                                     
  0      0   100%
> apache_beam/io/gcp/internal/clients/bigquery/__init__.py                            
  9      2    78%
> apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py                  
116     65    44%
> apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_messages.py                
459      0   100%
> apache_beam/io/gcp/internal/clients/storage/__init__.py                             
  9      2    78%
> apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py                    
165     71    57%
> apache_beam/io/gcp/internal/clients/storage/storage_v1_messages.py                  
507      0   100%
> apache_beam/io/gcp/pubsub.py                                                        
 27      4    85%
> apache_beam/io/gcp/pubsub_test.py                                                   
 28      2    93%
> apache_beam/io/gcp/tests/__init__.py                                                
  0      0   100%
> apache_beam/io/gcp/tests/bigquery_matcher.py                                        
 47      7    85%
> apache_beam/io/gcp/tests/bigquery_matcher_test.py                                   
 57      4    93%
> apache_beam/io/iobase.py                                                            
151     27    82%
> apache_beam/io/localfilesystem.py                                                   
102      2    98%
> apache_beam/io/localfilesystem_test.py                                              
127      8    94%
> apache_beam/io/range_trackers.py                                                    
265     22    92%
> apache_beam/io/range_trackers_test.py                                               
346      4    99%
> apache_beam/io/source_test_utils.py                                                 
215     25    88%
> apache_beam/io/source_test_utils_test.py                                            
 64      3    95%
> apache_beam/io/sources_test.py                                                      
 71     17    76%
> apache_beam/io/textio.py                                                            
151     13    91%
> apache_beam/io/textio_test.py                                                       
436      4    99%
> apache_beam/io/tfrecordio.py                                                        
 87      4    95%
> apache_beam/io/tfrecordio_test.py                                                   
229     29    87%
> apache_beam/metrics/__init__.py                                                     
  1      0   100%
> apache_beam/metrics/cells.py                                                        
129     21    84%
> apache_beam/metrics/cells_test.py                                                   
 82      1    99%
> apache_beam/metrics/execution.py                                                    
 87      2    98%
> apache_beam/metrics/execution_test.py                                               
 79      1    99%
> apache_beam/metrics/metric.py                                                       
 96      6    94%
> apache_beam/metrics/metric_test.py                                                  
 83      1    99%
> apache_beam/metrics/metricbase.py                                                   
 21      3    86%
> apache_beam/pipeline.py                                                             
241     18    93%
> apache_beam/pipeline_test.py                                                        
293     24    92%
> apache_beam/pvalue.py                                                               
146     12    92%
> apache_beam/pvalue_test.py                                                          
 11      1    91%
> apache_beam/runners/__init__.py                                                     
  8      0   100%
> apache_beam/runners/api/__init__.py                                                 
  0      0   100%
> apache_beam/runners/api/beam_runner_api_pb2.py                                      
370      0   100%
> apache_beam/runners/common.py                                                       
237     35    85%
> apache_beam/runners/dataflow/__init__.py                                            
  0      0   100%
> apache_beam/runners/dataflow/dataflow_metrics.py                                    
 67     10    85%
> apache_beam/runners/dataflow/dataflow_metrics_test.py                               
 53      1    98%
> apache_beam/runners/dataflow/dataflow_runner.py                                     
327    137    58%
> apache_beam/runners/dataflow/dataflow_runner_test.py                                
 88      4    95%
> apache_beam/runners/dataflow/internal/__init__.py                                   
  0      0   100%
> apache_beam/runners/dataflow/internal/apiclient.py                                  
351    134    62%
> apache_beam/runners/dataflow/internal/apiclient_test.py                             
 56      5    91%
> apache_beam/runners/dataflow/internal/clients/__init__.py                           
  0      0   100%
> apache_beam/runners/dataflow/internal/clients/dataflow/__init__.py                  
  9      2    78%
> apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py      
148     40    73%
> apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_messages.py    1043
     0   100%
> apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers.py          
 62     13    79%
> apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers_test.py     
 36      3    92%
> apache_beam/runners/dataflow/internal/dependency.py                                 
226     69    69%
> apache_beam/runners/dataflow/internal/dependency_test.py                            
249     13    95%
> apache_beam/runners/dataflow/internal/names.py                                      
 54      0   100%
> apache_beam/runners/dataflow/native_io/__init__.py                                  
  0      0   100%
> apache_beam/runners/dataflow/native_io/iobase.py                                    
 95     46    52%
> apache_beam/runners/dataflow/template_runner_test.py                                
 37      3    92%
> apache_beam/runners/dataflow/test_dataflow_runner.py                                
 15      7    53%
> apache_beam/runners/direct/__init__.py                                              
  2      0   100%
> apache_beam/runners/direct/bundle_factory.py                                        
 75      5    93%
> apache_beam/runners/direct/clock.py                                                 
 17      6    65%
> apache_beam/runners/direct/consumer_tracking_pipeline_visitor.py                    
 25      0   100%
> apache_beam/runners/direct/consumer_tracking_pipeline_visitor_test.py               
 68      6    91%
> apache_beam/runners/direct/direct_metrics.py                                        
 55      0   100%
> apache_beam/runners/direct/direct_metrics_test.py                                   
 60      1    98%
> apache_beam/runners/direct/direct_runner.py                                         
 83      2    98%
> apache_beam/runners/direct/evaluation_context.py                                    
143      5    97%
> apache_beam/runners/direct/executor.py                                              
304     14    95%
> apache_beam/runners/direct/helper_transforms.py                                     
 48      0   100%
> apache_beam/runners/direct/transform_evaluator.py                                   
246     29    88%
> apache_beam/runners/direct/transform_result.py                                      
 26      0   100%
> apache_beam/runners/direct/watermark_manager.py                                     
129      2    98%
> apache_beam/runners/pipeline_context.py                                             
 42      0   100%
> apache_beam/runners/pipeline_context_test.py                                        
 20      1    95%
> apache_beam/runners/runner.py                                                       
142     31    78%
> apache_beam/runners/runner_test.py                                                  
 54      1    98%
> apache_beam/runners/test/__init__.py                                                
  5      2    60%
> apache_beam/test_pipeline.py                                                        
 46      0   100%
> apache_beam/test_pipeline_test.py                                                   
 53      4    92%
> apache_beam/tests/__init__.py                                                       
  0      0   100%
> apache_beam/tests/pipeline_verifiers.py                                             
 60      6    90%
> apache_beam/tests/pipeline_verifiers_test.py                                        
 74      5    93%
> apache_beam/tests/test_utils.py                                                     
 22      0   100%
> apache_beam/transforms/__init__.py                                                  
  6      0   100%
> apache_beam/transforms/combiners.py                                                 
282     23    92%
> apache_beam/transforms/combiners_test.py                                            
186      1    99%
> apache_beam/transforms/core.py                                                      
558     75    87%
> apache_beam/transforms/cy_combiners.py                                              
195    102    48%
> apache_beam/transforms/display.py                                                   
118     11    91%
> apache_beam/transforms/display_test.py                                              
116     20    83%
> apache_beam/transforms/ptransform.py                                                
294     29    90%
> apache_beam/transforms/ptransform_test.py                                           1040
    19    98%
> apache_beam/transforms/sideinputs.py                                                
 35      1    97%
> apache_beam/transforms/sideinputs_test.py                                           
161      2    99%
> apache_beam/transforms/timeutil.py                                                  
 57     13    77%
> apache_beam/transforms/trigger.py                                                   
599     72    88%
> apache_beam/transforms/trigger_test.py                                              
249     97    61%
> apache_beam/transforms/util.py                                                      
 80      1    99%
> apache_beam/transforms/util_test.py                                                 
 23      1    96%
> apache_beam/transforms/window.py                                                    
210     25    88%
> apache_beam/transforms/window_test.py                                               
132      1    99%
> apache_beam/transforms/write_ptransform_test.py                                     
 73      2    97%
> apache_beam/typehints/__init__.py                                                   
  3      0   100%
> apache_beam/typehints/decorators.py                                                 
170      9    95%
> apache_beam/typehints/opcodes.py                                                    
157     20    87%
> apache_beam/typehints/trivial_inference.py                                          
262     38    85%
> apache_beam/typehints/trivial_inference_test.py                                     
 71      8    89%
> apache_beam/typehints/typecheck.py                                                  
 96      1    99%
> apache_beam/typehints/typed_pipeline_test.py                                        
156      6    96%
> apache_beam/typehints/typehints.py                                                  
401     38    91%
> apache_beam/typehints/typehints_test.py                                             
615     15    98%
> apache_beam/utils/__init__.py                                                       
  2      0   100%
> apache_beam/utils/annotations.py                                                    
 21      0   100%
> apache_beam/utils/annotations_test.py                                               
 57      3    95%
> apache_beam/utils/counters.py                                                       
 58     31    47%
> apache_beam/utils/path.py                                                           
  6      0   100%
> apache_beam/utils/path_test.py                                                      
 26      1    96%
> apache_beam/utils/pipeline_options.py                                               
169      7    96%
> apache_beam/utils/pipeline_options_test.py                                          
 79      3    96%
> apache_beam/utils/pipeline_options_validator.py                                     
 94      1    99%
> apache_beam/utils/pipeline_options_validator_test.py                                
141      4    97%
> apache_beam/utils/processes.py                                                      
 22      0   100%
> apache_beam/utils/processes_test.py                                                 
 29      1    97%
> apache_beam/utils/proto_utils.py                                                    
 19      0   100%
> apache_beam/utils/retry.py                                                          
 68      3    96%
> apache_beam/utils/retry_test.py                                                     
109      4    96%
> apache_beam/utils/test_stream.py                                                    
 74      7    91%
> apache_beam/utils/test_stream_test.py                                               
 22      1    95%
> apache_beam/utils/timestamp.py                                                      
105      2    98%
> apache_beam/utils/timestamp_test.py                                                 
103      1    99%
> apache_beam/utils/urns.py                                                           
  7      0   100%
> apache_beam/utils/windowed_value.py                                                 
 42      3    93%
> apache_beam/utils/windowed_value_test.py                                            
 31      1    97%
> apache_beam/version.py                                                              
  2      0   100%
> ------------------------------------------------------------------------------------------------------
> TOTAL                                                                              24460
  2262    91%
> {code} 
> CC: [~altay]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message