singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-singa] chrishkchris opened a new pull request #539: SINGA-491 Python Code Cleaning
Date Mon, 30 Sep 2019 09:40:28 GMT
chrishkchris opened a new pull request #539: SINGA-491 Python Code Cleaning
URL: https://github.com/apache/incubator-singa/pull/539
 
 
   Only Python code is cleaned at this time that is likely to remove around hundred alerts in python code.
   
   Since there are lots of changes in the folders examples/imagenet/inception and examples/imagenet/googlenet, I have run those code again including four parts:
   
   PART (I) examples/imagenet/googlenet/serve.py
   PART (II) examples/imagenet/inception/inception_v3.py
   PART (III) examples/imagenet/inception/inception_v4.py
   PART (IV) Python Unit Test (test_operation.py)
   
   Two test photos from the imagenet dataset are used for testing in PART (I), (II), (III) 
   image1.JPEG
   ![image1](https://user-images.githubusercontent.com/38325429/65866514-7bf1d280-e3a7-11e9-9ecf-5c8f789734db.JPEG)
   image2.JPEG
   ![image2](https://user-images.githubusercontent.com/38325429/65866516-7dbb9600-e3a7-11e9-952d-c0ac00c28d8e.JPEG)
   
   The results are okay as expected.
   
   PART (I) examples/imagenet/googlenet/serve.py
   
   ```
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/googlenet$ python3 serve.py &
   runing with gpu
    * Serving Flask app "rafiki.agent" (lazy loading)
    * Environment: production
      WARNING: This is a development server. Do not use it in a production deployment.
      Use a production WSGI server instead.
    * Debug mode: off
    * Running on http://0.0.0.0:9999/ (Press CTRL+C to quit)
   Start intialization............
   ('conv1/7x7_s2', (64, 112, 112))
   ('conv1/relu_7x7', (64, 112, 112))
   ('pool1/3x3_s2/pad', (64, 113, 113))
   ('pool1/3x3_s2', (64, 56, 56))
   ('pool1/norm1', (64, 56, 56))
   ('conv2/3x3_reduce', (64, 56, 56))
   ('conv2/relue_3x3_reduce', (64, 56, 56))
   ('conv2/3x3', (192, 56, 56))
   ('conv2/relue_3x3', (192, 56, 56))
   ('conv2/norm2', (192, 56, 56))
   ('pool2/3x3_s2/pad', (192, 57, 57))
   ('pool2/3x3_s2', (192, 28, 28))
   ('inception_3a/split', [(192, 28, 28), (192, 28, 28), (192, 28, 28), (192, 28, 28)])
   ('inception_3a/1x1', (64, 28, 28))
   ('inception_3a/relue_1x1', (64, 28, 28))
   ('inception_3a/3x3_reduce', (96, 28, 28))
   ('inception_3a/relue_3x3_reduce', (96, 28, 28))
   ('inception_3a/3x3', (128, 28, 28))
   ('inception_3a/relue_3x3', (128, 28, 28))
   ('inception_3a/5x5_reduce', (16, 28, 28))
   ('inception_3a/relue_5x5_reduce', (16, 28, 28))
   ('inception_3a/5x5', (32, 28, 28))
   ('inception_3a/relue_5x5', (32, 28, 28))
   ('inception_3a/pool', (192, 28, 28))
   ('inception_3a/pool_proj', (32, 28, 28))
   ('inception_3a/relue_pool_proj', (32, 28, 28))
   ('inception_3a/output', (256, 28, 28))
   ('inception_3b/split', [(256, 28, 28), (256, 28, 28), (256, 28, 28), (256, 28, 28)])
   ('inception_3b/1x1', (128, 28, 28))
   ('inception_3b/relue_1x1', (128, 28, 28))
   ('inception_3b/3x3_reduce', (128, 28, 28))
   ('inception_3b/relue_3x3_reduce', (128, 28, 28))
   ('inception_3b/3x3', (192, 28, 28))
   ('inception_3b/relue_3x3', (192, 28, 28))
   ('inception_3b/5x5_reduce', (32, 28, 28))
   ('inception_3b/relue_5x5_reduce', (32, 28, 28))
   ('inception_3b/5x5', (96, 28, 28))
   ('inception_3b/relue_5x5', (96, 28, 28))
   ('inception_3b/pool', (256, 28, 28))
   ('inception_3b/pool_proj', (64, 28, 28))
   ('inception_3b/relue_pool_proj', (64, 28, 28))
   ('inception_3b/output', (480, 28, 28))
   ('pool3/3x3_s2/pad', (480, 29, 29))
   ('pool3/3x3_s2', (480, 14, 14))
   ('inception_4a/split', [(480, 14, 14), (480, 14, 14), (480, 14, 14), (480, 14, 14)])
   ('inception_4a/1x1', (192, 14, 14))
   ('inception_4a/relue_1x1', (192, 14, 14))
   ('inception_4a/3x3_reduce', (96, 14, 14))
   ('inception_4a/relue_3x3_reduce', (96, 14, 14))
   ('inception_4a/3x3', (208, 14, 14))
   ('inception_4a/relue_3x3', (208, 14, 14))
   ('inception_4a/5x5_reduce', (16, 14, 14))
   ('inception_4a/relue_5x5_reduce', (16, 14, 14))
   ('inception_4a/5x5', (48, 14, 14))
   ('inception_4a/relue_5x5', (48, 14, 14))
   ('inception_4a/pool', (480, 14, 14))
   ('inception_4a/pool_proj', (64, 14, 14))
   ('inception_4a/relue_pool_proj', (64, 14, 14))
   ('inception_4a/output', (512, 14, 14))
   ('inception_4b/split', [(512, 14, 14), (512, 14, 14), (512, 14, 14), (512, 14, 14)])
   ('inception_4b/1x1', (160, 14, 14))
   ('inception_4b/relue_1x1', (160, 14, 14))
   ('inception_4b/3x3_reduce', (112, 14, 14))
   ('inception_4b/relue_3x3_reduce', (112, 14, 14))
   ('inception_4b/3x3', (224, 14, 14))
   ('inception_4b/relue_3x3', (224, 14, 14))
   ('inception_4b/5x5_reduce', (24, 14, 14))
   ('inception_4b/relue_5x5_reduce', (24, 14, 14))
   ('inception_4b/5x5', (64, 14, 14))
   ('inception_4b/relue_5x5', (64, 14, 14))
   ('inception_4b/pool', (512, 14, 14))
   ('inception_4b/pool_proj', (64, 14, 14))
   ('inception_4b/relue_pool_proj', (64, 14, 14))
   ('inception_4b/output', (512, 14, 14))
   ('inception_4c/split', [(512, 14, 14), (512, 14, 14), (512, 14, 14), (512, 14, 14)])
   ('inception_4c/1x1', (128, 14, 14))
   ('inception_4c/relue_1x1', (128, 14, 14))
   ('inception_4c/3x3_reduce', (128, 14, 14))
   ('inception_4c/relue_3x3_reduce', (128, 14, 14))
   ('inception_4c/3x3', (256, 14, 14))
   ('inception_4c/relue_3x3', (256, 14, 14))
   ('inception_4c/5x5_reduce', (24, 14, 14))
   ('inception_4c/relue_5x5_reduce', (24, 14, 14))
   ('inception_4c/5x5', (64, 14, 14))
   ('inception_4c/relue_5x5', (64, 14, 14))
   ('inception_4c/pool', (512, 14, 14))
   ('inception_4c/pool_proj', (64, 14, 14))
   ('inception_4c/relue_pool_proj', (64, 14, 14))
   ('inception_4c/output', (512, 14, 14))
   ('inception_4d/split', [(512, 14, 14), (512, 14, 14), (512, 14, 14), (512, 14, 14)])
   ('inception_4d/1x1', (112, 14, 14))
   ('inception_4d/relue_1x1', (112, 14, 14))
   ('inception_4d/3x3_reduce', (144, 14, 14))
   ('inception_4d/relue_3x3_reduce', (144, 14, 14))
   ('inception_4d/3x3', (288, 14, 14))
   ('inception_4d/relue_3x3', (288, 14, 14))
   ('inception_4d/5x5_reduce', (32, 14, 14))
   ('inception_4d/relue_5x5_reduce', (32, 14, 14))
   ('inception_4d/5x5', (64, 14, 14))
   ('inception_4d/relue_5x5', (64, 14, 14))
   ('inception_4d/pool', (512, 14, 14))
   ('inception_4d/pool_proj', (64, 14, 14))
   ('inception_4d/relue_pool_proj', (64, 14, 14))
   ('inception_4d/output', (528, 14, 14))
   ('inception_4e/split', [(528, 14, 14), (528, 14, 14), (528, 14, 14), (528, 14, 14)])
   ('inception_4e/1x1', (256, 14, 14))
   ('inception_4e/relue_1x1', (256, 14, 14))
   ('inception_4e/3x3_reduce', (160, 14, 14))
   ('inception_4e/relue_3x3_reduce', (160, 14, 14))
   ('inception_4e/3x3', (320, 14, 14))
   ('inception_4e/relue_3x3', (320, 14, 14))
   ('inception_4e/5x5_reduce', (32, 14, 14))
   ('inception_4e/relue_5x5_reduce', (32, 14, 14))
   ('inception_4e/5x5', (128, 14, 14))
   ('inception_4e/relue_5x5', (128, 14, 14))
   ('inception_4e/pool', (528, 14, 14))
   ('inception_4e/pool_proj', (128, 14, 14))
   ('inception_4e/relue_pool_proj', (128, 14, 14))
   ('inception_4e/output', (832, 14, 14))
   ('pool4/3x3_s2/pad', (832, 15, 15))
   ('pool4/3x3_s2', (832, 7, 7))
   ('inception_5a/split', [(832, 7, 7), (832, 7, 7), (832, 7, 7), (832, 7, 7)])
   ('inception_5a/1x1', (256, 7, 7))
   ('inception_5a/relue_1x1', (256, 7, 7))
   ('inception_5a/3x3_reduce', (160, 7, 7))
   ('inception_5a/relue_3x3_reduce', (160, 7, 7))
   ('inception_5a/3x3', (320, 7, 7))
   ('inception_5a/relue_3x3', (320, 7, 7))
   ('inception_5a/5x5_reduce', (32, 7, 7))
   ('inception_5a/relue_5x5_reduce', (32, 7, 7))
   ('inception_5a/5x5', (128, 7, 7))
   ('inception_5a/relue_5x5', (128, 7, 7))
   ('inception_5a/pool', (832, 7, 7))
   ('inception_5a/pool_proj', (128, 7, 7))
   ('inception_5a/relue_pool_proj', (128, 7, 7))
   ('inception_5a/output', (832, 7, 7))
   ('inception_5b/split', [(832, 7, 7), (832, 7, 7), (832, 7, 7), (832, 7, 7)])
   ('inception_5b/1x1', (384, 7, 7))
   ('inception_5b/relue_1x1', (384, 7, 7))
   ('inception_5b/3x3_reduce', (192, 7, 7))
   ('inception_5b/relue_3x3_reduce', (192, 7, 7))
   ('inception_5b/3x3', (384, 7, 7))
   ('inception_5b/relue_3x3', (384, 7, 7))
   ('inception_5b/5x5_reduce', (48, 7, 7))
   ('inception_5b/relue_5x5_reduce', (48, 7, 7))
   ('inception_5b/5x5', (128, 7, 7))
   ('inception_5b/relue_5x5', (128, 7, 7))
   ('inception_5b/pool', (832, 7, 7))
   ('inception_5b/pool_proj', (128, 7, 7))
   ('inception_5b/relue_pool_proj', (128, 7, 7))
   ('inception_5b/output', (1024, 7, 7))
   ('pool5/7x7_s1', (1024, 1, 1))
   ('drop', (1024, 1, 1))
   ('flat', (1024,))
   ('loss3/classifier', (1000,))
   NOTE: If your model was saved using Snapshot, then set use_pickle=False for loading it
   total num of params 116
   End intialization............
   
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/googlenet$ curl -i -F image=@image1.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 298
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 03:52:42 GMT
   
   n02125311 cougar, puma, catamount, mountain lion, painter, panther, Felis concolor:0.9935162<br/>n02129165 lion, king of beasts, Panthera leo:0.0023484386<br/>n02484975 guenon, guenon monkey:0.00046582596<br/>n02127052 lynx, catamount:0.00039392215<br/>n02123045 tabby, tabby cat:0.00037758864<br/>
   
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/googlenet$ curl -i -F image=@image2.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 242
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 03:52:30 GMT
   
   n01608432 kite:0.4541745<br/>n01616318 vulture:0.39047056<br/>n01614925 bald eagle, American eagle, Haliaeetus leucocephalus:0.04131015<br/>n02002724 black stork, Ciconia nigra:0.038732238<br/>
   ```
   
   PART (II) examples/imagenet/inception/inception_v3.py
   
   ```
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ python3 serve.py --model=v3 --parameter_file=inception_v3.pickle &
   runing with gpu
    * Serving Flask app "rafiki.agent" (lazy loading)
    * Environment: production
      WARNING: This is a development server. Do not use it in a production deployment.
      Use a production WSGI server instead.
    * Debug mode: off
    * Running on http://0.0.0.0:9999/ (Press CTRL+C to quit)
   Start intialization............
   ('InceptionV3/Conv2d_1a_3x3', (32, 149, 149))
   ('InceptionV3/Conv2d_1a_3x3/BatchNorm', (32, 149, 149))
   ('InceptionV3/Conv2d_1a_3x3/relu', (32, 149, 149))
   ('InceptionV3/Conv2d_2a_3x3', (32, 147, 147))
   ('InceptionV3/Conv2d_2a_3x3/BatchNorm', (32, 147, 147))
   ('InceptionV3/Conv2d_2a_3x3/relu', (32, 147, 147))
   ('InceptionV3/Conv2d_2b_3x3', (64, 147, 147))
   ('InceptionV3/Conv2d_2b_3x3/BatchNorm', (64, 147, 147))
   ('InceptionV3/Conv2d_2b_3x3/relu', (64, 147, 147))
   ('InceptionV3/MaxPool_3a_3x3', (64, 73, 73))
   ('InceptionV3/Conv2d_3b_1x1', (80, 73, 73))
   ('InceptionV3/Conv2d_3b_1x1/BatchNorm', (80, 73, 73))
   ('InceptionV3/Conv2d_3b_1x1/relu', (80, 73, 73))
   ('InceptionV3/Conv2d_4a_3x3', (192, 71, 71))
   ('InceptionV3/Conv2d_4a_3x3/BatchNorm', (192, 71, 71))
   ('InceptionV3/Conv2d_4a_3x3/relu', (192, 71, 71))
   ('InceptionV3/MaxPool_5a_3x3', (192, 35, 35))
   ('InceptionV3/Mixed_5b/Split', [(192, 35, 35), (192, 35, 35), (192, 35, 35), (192, 35, 35)])
   ('InceptionV3/Mixed_5b/Branch_0/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_0/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0a_1x1', (48, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm', (48, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0a_1x1/relu', (48, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0b_5x5', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0b_5x5/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_1/Conv2d_0b_5x5/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_3/AvgPool_0a_3x3', (192, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_3/Conv2d_0b_1x1', (32, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm', (32, 35, 35))
   ('InceptionV3/Mixed_5b/Branch_3/Conv2d_0b_1x1/relu', (32, 35, 35))
   ('InceptionV3/Mixed_5b/Concat', (256, 35, 35))
   ('InceptionV3/Mixed_5c/Split', [(256, 35, 35), (256, 35, 35), (256, 35, 35), (256, 35, 35)])
   ('InceptionV3/Mixed_5c/Branch_0/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_0/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv2d_0b_1x1', (48, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv2d_0b_1x1/BatchNorm', (48, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv2d_0b_1x1/relu', (48, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv_1_0c_5x5', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv_1_0c_5x5/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_1/Conv_1_0c_5x5/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_3/AvgPool_0a_3x3', (256, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_3/Conv2d_0b_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Branch_3/Conv2d_0b_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5c/Concat', (288, 35, 35))
   ('InceptionV3/Mixed_5d/Split', [(288, 35, 35), (288, 35, 35), (288, 35, 35), (288, 35, 35)])
   ('InceptionV3/Mixed_5d/Branch_0/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_0/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_0/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0a_1x1', (48, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0a_1x1/BatchNorm', (48, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0a_1x1/relu', (48, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0b_5x5', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0b_5x5/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_1/Conv2d_0b_5x5/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_3/AvgPool_0a_3x3', (288, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_3/Conv2d_0b_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_3/Conv2d_0b_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Branch_3/Conv2d_0b_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_5d/Concat', (288, 35, 35))
   ('InceptionV3/Mixed_6a/Split', [(288, 35, 35), (288, 35, 35), (288, 35, 35)])
   ('InceptionV3/Mixed_6a/Branch_0/Conv2d_1a_1x1', (384, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_0/Conv2d_1a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_0/Conv2d_1a_1x1/relu', (384, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_1a_1x1', (96, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_1a_1x1/BatchNorm', (96, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_1/Conv2d_1a_1x1/relu', (96, 17, 17))
   ('InceptionV3/Mixed_6a/Branch_2/MaxPool_1a_3x3', (288, 17, 17))
   ('InceptionV3/Mixed_6a/Concat', (768, 17, 17))
   ('InceptionV3/Mixed_6b/Split', [(768, 17, 17), (768, 17, 17), (768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_6b/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0a_1x1', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0a_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0a_1x1/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0b_1x7', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0b_1x7/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0b_1x7/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0c_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0c_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_1/Conv2d_0c_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0a_1x1', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0a_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0a_1x1/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0b_7x1', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0b_7x1/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0b_7x1/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0c_1x7', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0c_1x7/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0c_1x7/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0d_7x1', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0d_7x1/BatchNorm', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0d_7x1/relu', (128, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0e_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0e_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_2/Conv2d_0e_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_3/AvgPool_0a_3x3', (768, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_3/Conv2d_0b_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Branch_3/Conv2d_0b_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6b/Concat', (768, 17, 17))
   ('InceptionV3/Mixed_6c/Split', [(768, 17, 17), (768, 17, 17), (768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_6c/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0a_1x1', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0a_1x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0a_1x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0b_1x7', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0b_1x7/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0b_1x7/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0c_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0c_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_1/Conv2d_0c_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0a_1x1', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0a_1x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0a_1x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0b_7x1', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0b_7x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0b_7x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0c_1x7', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0c_1x7/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0c_1x7/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0d_7x1', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0d_7x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0d_7x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0e_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0e_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_2/Conv2d_0e_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_3/AvgPool_0a_3x3', (768, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_3/Conv2d_0b_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Branch_3/Conv2d_0b_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6c/Concat', (768, 17, 17))
   ('InceptionV3/Mixed_6d/Split', [(768, 17, 17), (768, 17, 17), (768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_6d/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0a_1x1', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0a_1x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0a_1x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0b_1x7', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0b_1x7/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0b_1x7/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0c_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0c_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_1/Conv2d_0c_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0a_1x1', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0a_1x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0a_1x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0b_7x1', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0b_7x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0b_7x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0c_1x7', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0c_1x7/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0c_1x7/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0d_7x1', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0d_7x1/BatchNorm', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0d_7x1/relu', (160, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0e_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0e_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_2/Conv2d_0e_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_3/AvgPool_0a_3x3', (768, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_3/Conv2d_0b_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Branch_3/Conv2d_0b_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6d/Concat', (768, 17, 17))
   ('InceptionV3/Mixed_6e/Split', [(768, 17, 17), (768, 17, 17), (768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_6e/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0b_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0b_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0b_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0c_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0c_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_1/Conv2d_0c_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0c_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0c_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0c_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0d_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0d_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0d_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0e_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0e_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_2/Conv2d_0e_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_3/AvgPool_0a_3x3', (768, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_3/Conv2d_0b_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Branch_3/Conv2d_0b_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_6e/Concat', (768, 17, 17))
   ('InceptionV3/Mixed_6e-aux', [(768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_7a/Split', [(768, 17, 17), (768, 17, 17), (768, 17, 17)])
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_1a_3x3', (320, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_1a_3x3/BatchNorm', (320, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_0/Conv2d_1a_3x3/relu', (320, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0b_1x7', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0b_1x7/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0b_1x7/relu', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0c_7x1', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0c_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_0c_7x1/relu', (192, 17, 17))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_1a_3x3', (192, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_1a_3x3/BatchNorm', (192, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_1/Conv2d_1a_3x3/relu', (192, 8, 8))
   ('InceptionV3/Mixed_7a/Branch_2/MaxPool_1a_3x3', (768, 8, 8))
   ('InceptionV3/Mixed_7a/Concat', (1280, 8, 8))
   ('InceptionV3/Mixed_7b/Split', [(1280, 8, 8), (1280, 8, 8), (1280, 8, 8), (1280, 8, 8)])
   ('InceptionV3/Mixed_7b/Branch_0/Conv2d_0a_1x1', (320, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_0/Conv2d_0a_1x1/BatchNorm', (320, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_0/Conv2d_0a_1x1/relu', (320, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Split1', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_1x3', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_1x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_1x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_3x1', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_3x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Conv2d_0b_3x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_1/Concat1', (768, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0a_1x1', (448, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0a_1x1/BatchNorm', (448, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0a_1x1/relu', (448, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0b_3x3', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0b_3x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0b_3x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Split2', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0c_1x3', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0c_1x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0c_1x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0d_3x1', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0d_3x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Conv2d_0d_3x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_2/Concat2', (768, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_3/AvgPool_0a_3x3', (1280, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_3/Conv2d_0b_1x1', (192, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 8, 8))
   ('InceptionV3/Mixed_7b/Branch_3/Conv2d_0b_1x1/relu', (192, 8, 8))
   ('InceptionV3/Mixed_7b/Concat', (2048, 8, 8))
   ('InceptionV3/Mixed_7c/Split', [(2048, 8, 8), (2048, 8, 8), (2048, 8, 8), (2048, 8, 8)])
   ('InceptionV3/Mixed_7c/Branch_0/Conv2d_0a_1x1', (320, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_0/Conv2d_0a_1x1/BatchNorm', (320, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_0/Conv2d_0a_1x1/relu', (320, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Split1', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0b_1x3', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0b_1x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0b_1x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0c_3x1', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0c_3x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Conv2d_0c_3x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_1/Concat1', (768, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0a_1x1', (448, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0a_1x1/BatchNorm', (448, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0a_1x1/relu', (448, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0b_3x3', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0b_3x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0b_3x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Split2', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0c_1x3', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0c_1x3/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0c_1x3/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0d_3x1', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0d_3x1/BatchNorm', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Conv2d_0d_3x1/relu', (384, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_2/Concat2', (768, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_3/AvgPool_0a_3x3', (2048, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_3/Conv2d_0b_1x1', (192, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_3/Conv2d_0b_1x1/BatchNorm', (192, 8, 8))
   ('InceptionV3/Mixed_7c/Branch_3/Conv2d_0b_1x1/relu', (192, 8, 8))
   ('InceptionV3/Mixed_7c/Concat', (2048, 8, 8))
   ('InceptionV3/AuxLogits/AvgPool_1a_5x5', (768, 5, 5))
   ('InceptionV3/AuxLogits/Conv2d_1b_1x1', (128, 5, 5))
   ('InceptionV3/AuxLogits/Conv2d_1b_1x1/BatchNorm', (128, 5, 5))
   ('InceptionV3/AuxLogits/Conv2d_1b_1x1/relu', (128, 5, 5))
   ('InceptionV3/AuxLogits/Conv2d_2a_5x5', (768, 1, 1))
   ('InceptionV3/AuxLogits/Conv2d_2a_5x5/BatchNorm', (768, 1, 1))
   ('InceptionV3/AuxLogits/Conv2d_2a_5x5/relu', (768, 1, 1))
   ('InceptionV3/AuxLogits/Conv2d_2b_1x1', (1001, 1, 1))
   ('InceptionV3/AuxLogits/flat', (1001,))
   ('InceptionV3/Logits/AvgPool_1a', (2048, 1, 1))
   ('InceptionV3/Logits/Dropout_1b', (2048, 1, 1))
   ('InceptionV3/Logits/Conv2d_1c_1x1', (1001, 1, 1))
   ('InceptionV3/Logits/flat', (1001,))
   NOTE: If your model was saved using Snapshot, then set use_pickle=False for loading it
   End intialization............
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ curl -i -F image=@image1.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 286
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 06:43:51 GMT
   
   n02125311 cougar, puma, catamount, mountain lion, painter, panther, Felis concolor:0.978803<br/>n02129165 lion, king of bea                           
   sts, Panthera leo:0.004202829<br/>n02127052 lynx, catamount:0.002688996<br/>n02129604 tiger, Panthera tigris:0.0015836802<b                           
   r/>n02123159 tiger cat:0.0009985013<br/>
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ curl -i -F image=@image2.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 246
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 06:44:11 GMT
   
   n01616318 vulture:0.5493038<br/>n01608432 kite:0.22520584<br/>n01614925 bald eagle, American eagle, Haliaeetus leucocephalu                           s:0.13361189<br/>n02002724 black stork, Ciconia nigra:0.010519981<br/>n02002556 white stork, Ciconia ciconia:0.0055103<br/>
   ```
   
   PART (III) examples/imagenet/inception/inception_v4.py
   
   ```
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ python3 serve.py &
   runing with gpu
    * Serving Flask app "rafiki.agent" (lazy loading)
    * Environment: production
      WARNING: This is a development server. Do not use it in a production deployment.
      Use a production WSGI server instead.
    * Debug mode: off
    * Running on http://0.0.0.0:9999/ (Press CTRL+C to quit)
   Start intialization............
   ('InceptionV4/Conv2d_1a_3x3', (32, 149, 149))
   ('InceptionV4/Conv2d_1a_3x3/BatchNorm', (32, 149, 149))
   ('InceptionV4/Conv2d_1a_3x3/relu', (32, 149, 149))
   ('InceptionV4/Conv2d_2a_3x3', (32, 147, 147))
   ('InceptionV4/Conv2d_2a_3x3/BatchNorm', (32, 147, 147))
   ('InceptionV4/Conv2d_2a_3x3/relu', (32, 147, 147))
   ('InceptionV4/Conv2d_2b_3x3', (64, 147, 147))
   ('InceptionV4/Conv2d_2b_3x3/BatchNorm', (64, 147, 147))
   ('InceptionV4/Conv2d_2b_3x3/relu', (64, 147, 147))
   ('InceptionV4/Mixed_3a/Split', [(64, 147, 147), (64, 147, 147)])
   ('InceptionV4/Mixed_3a/Branch_0/MaxPool_0a_3x3', (64, 73, 73))
   ('InceptionV4/Mixed_3a/Branch_1/Conv2d_0a_3x3', (96, 73, 73))
   ('InceptionV4/Mixed_3a/Branch_1/Conv2d_0a_3x3/BatchNorm', (96, 73, 73))
   ('InceptionV4/Mixed_3a/Branch_1/Conv2d_0a_3x3/relu', (96, 73, 73))
   ('InceptionV4/Mixed_3a/Concat', (160, 73, 73))
   ('InceptionV4/Mixed_4a/Split', [(160, 73, 73), (160, 73, 73)])
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_0a_1x1', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_0a_1x1/relu', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_1a_3x3', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Branch_0/Conv2d_1a_3x3/relu', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0a_1x1', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0a_1x1/relu', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0b_1x7', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0b_1x7/BatchNorm', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0b_1x7/relu', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0c_7x1', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0c_7x1/BatchNorm', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_0c_7x1/relu', (64, 73, 73))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_1a_3x3', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Branch_1/Conv2d_1a_3x3/relu', (96, 71, 71))
   ('InceptionV4/Mixed_4a/Concat', (192, 71, 71))
   ('InceptionV4/Mixed_5a/Split', [(192, 71, 71), (192, 71, 71)])
   ('InceptionV4/Mixed_5a/Branch_0/Conv2d_1a_3x3', (192, 35, 35))
   ('InceptionV4/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm', (192, 35, 35))
   ('InceptionV4/Mixed_5a/Branch_0/Conv2d_1a_3x3/relu', (192, 35, 35))
   ('InceptionV4/Mixed_5a/Branch_1/MaxPool_1a_3x3', (192, 35, 35))
   ('InceptionV4/Mixed_5a/Concat', (384, 35, 35))
   ('InceptionV4/Mixed_5b/Split', [(384, 35, 35), (384, 35, 35), (384, 35, 35), (384, 35, 35)])
   ('InceptionV4/Mixed_5b/Branch_0/Conv2d_0a_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_0/Conv2d_0a_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_1/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_3/AvgPool_0a_3x3', (384, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_3/Conv2d_0b_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Branch_3/Conv2d_0b_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5b/Concat', (384, 35, 35))
   ('InceptionV4/Mixed_5c/Split', [(384, 35, 35), (384, 35, 35), (384, 35, 35), (384, 35, 35)])
   ('InceptionV4/Mixed_5c/Branch_0/Conv2d_0a_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_0/Conv2d_0a_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_1/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_3/AvgPool_0a_3x3', (384, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_3/Conv2d_0b_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Branch_3/Conv2d_0b_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5c/Concat', (384, 35, 35))
   ('InceptionV4/Mixed_5d/Split', [(384, 35, 35), (384, 35, 35), (384, 35, 35), (384, 35, 35)])
   ('InceptionV4/Mixed_5d/Branch_0/Conv2d_0a_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_0/Conv2d_0a_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_0/Conv2d_0a_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_1/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_3/AvgPool_0a_3x3', (384, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_3/Conv2d_0b_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_3/Conv2d_0b_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Branch_3/Conv2d_0b_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5d/Concat', (384, 35, 35))
   ('InceptionV4/Mixed_5e/Split', [(384, 35, 35), (384, 35, 35), (384, 35, 35), (384, 35, 35)])
   ('InceptionV4/Mixed_5e/Branch_0/Conv2d_0a_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_0/Conv2d_0a_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_0/Conv2d_0a_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_1/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0a_1x1', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0a_1x1/BatchNorm', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0a_1x1/relu', (64, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0b_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0b_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0b_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0c_3x3', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0c_3x3/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_2/Conv2d_0c_3x3/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_3/AvgPool_0a_3x3', (384, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_3/Conv2d_0b_1x1', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_3/Conv2d_0b_1x1/BatchNorm', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Branch_3/Conv2d_0b_1x1/relu', (96, 35, 35))
   ('InceptionV4/Mixed_5e/Concat', (384, 35, 35))
   ('InceptionV4/Mixed_6a/Split', [(384, 35, 35), (384, 35, 35), (384, 35, 35)])
   ('InceptionV4/Mixed_6a/Branch_0/Conv2d_1a_3x3', (384, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_0/Conv2d_1a_3x3/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_0/Conv2d_1a_3x3/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0a_1x1', (192, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0a_1x1/relu', (192, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0b_3x3', (224, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0b_3x3/BatchNorm', (224, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_0b_3x3/relu', (224, 35, 35))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_1a_3x3', (256, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_1a_3x3/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_1/Conv2d_1a_3x3/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6a/Branch_2/MaxPool_1a_3x3', (384, 17, 17))
   ('InceptionV4/Mixed_6a/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6b/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6b/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6b/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6b/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6c/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6c/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6c/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6c/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6d/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6d/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6d/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6d/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6e/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6e/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6e/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6e/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6e-aux', [(1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6f/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6f/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6f/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6f/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6g/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6g/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6g/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6g/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_6h/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_6h/Branch_0/Conv2d_0a_1x1', (384, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_0/Conv2d_0a_1x1/BatchNorm', (384, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_0/Conv2d_0a_1x1/relu', (384, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0b_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0b_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0b_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0c_7x1', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0c_7x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_1/Conv2d_0c_7x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0b_7x1', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0b_7x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0b_7x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0c_1x7', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0c_1x7/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0c_1x7/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0d_7x1', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0d_7x1/BatchNorm', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0d_7x1/relu', (224, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0e_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0e_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_2/Conv2d_0e_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_3/AvgPool_0a_3x3', (1024, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_3/Conv2d_0b_1x1', (128, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_3/Conv2d_0b_1x1/BatchNorm', (128, 17, 17))
   ('InceptionV4/Mixed_6h/Branch_3/Conv2d_0b_1x1/relu', (128, 17, 17))
   ('InceptionV4/Mixed_6h/Concat', (1024, 17, 17))
   ('InceptionV4/Mixed_7a/Split', [(1024, 17, 17), (1024, 17, 17), (1024, 17, 17)])
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_0a_1x1', (192, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_0a_1x1/BatchNorm', (192, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_0a_1x1/relu', (192, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_1a_3x3', (192, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_1a_3x3/BatchNorm', (192, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_0/Conv2d_1a_3x3/relu', (192, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0a_1x1', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0a_1x1/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0a_1x1/relu', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0b_1x7', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0b_1x7/BatchNorm', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0b_1x7/relu', (256, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0c_7x1', (320, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0c_7x1/BatchNorm', (320, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_0c_7x1/relu', (320, 17, 17))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_1a_3x3', (320, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_1a_3x3/BatchNorm', (320, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_1/Conv2d_1a_3x3/relu', (320, 8, 8))
   ('InceptionV4/Mixed_7a/Branch_2/MaxPool_1a_3x3', (1024, 8, 8))
   ('InceptionV4/Mixed_7a/Concat', (1536, 8, 8))
   ('InceptionV4/Mixed_7b/Split', [(1536, 8, 8), (1536, 8, 8), (1536, 8, 8), (1536, 8, 8)])
   ('InceptionV4/Mixed_7b/Branch_0/Conv2d_0a_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_0/Conv2d_0a_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_0/Conv2d_0a_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Split', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0b_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0b_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0b_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0c_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0c_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Conv2d_0c_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_1/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0b_3x1', (448, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0b_3x1/BatchNorm', (448, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0b_3x1/relu', (448, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0c_1x3', (512, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0c_1x3/BatchNorm', (512, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0c_1x3/relu', (512, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Split', [(512, 8, 8), (512, 8, 8)])
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0d_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0d_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0d_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0e_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0e_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Conv2d_0e_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_2/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_3/AvgPool_0a_3x3', (1536, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_3/Conv2d_0b_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_3/Conv2d_0b_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Branch_3/Conv2d_0b_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7b/Concat', (1536, 8, 8))
   ('InceptionV4/Mixed_7c/Split', [(1536, 8, 8), (1536, 8, 8), (1536, 8, 8), (1536, 8, 8)])
   ('InceptionV4/Mixed_7c/Branch_0/Conv2d_0a_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_0/Conv2d_0a_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_0/Conv2d_0a_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Split', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0b_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0b_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0b_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0c_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0c_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Conv2d_0c_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_1/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0b_3x1', (448, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0b_3x1/BatchNorm', (448, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0b_3x1/relu', (448, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0c_1x3', (512, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0c_1x3/BatchNorm', (512, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0c_1x3/relu', (512, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Split', [(512, 8, 8), (512, 8, 8)])
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0d_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0d_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0d_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0e_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0e_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Conv2d_0e_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_2/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_3/AvgPool_0a_3x3', (1536, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_3/Conv2d_0b_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_3/Conv2d_0b_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Branch_3/Conv2d_0b_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7c/Concat', (1536, 8, 8))
   ('InceptionV4/Mixed_7d/Split', [(1536, 8, 8), (1536, 8, 8), (1536, 8, 8), (1536, 8, 8)])
   ('InceptionV4/Mixed_7d/Branch_0/Conv2d_0a_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_0/Conv2d_0a_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_0/Conv2d_0a_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Split', [(384, 8, 8), (384, 8, 8)])
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0b_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0b_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0b_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0c_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0c_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Conv2d_0c_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_1/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0a_1x1', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0a_1x1/BatchNorm', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0a_1x1/relu', (384, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0b_3x1', (448, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0b_3x1/BatchNorm', (448, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0b_3x1/relu', (448, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0c_1x3', (512, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0c_1x3/BatchNorm', (512, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0c_1x3/relu', (512, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Split', [(512, 8, 8), (512, 8, 8)])
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0d_1x3', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0d_1x3/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0d_1x3/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0e_3x1', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0e_3x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Conv2d_0e_3x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_2/Concat', (512, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_3/AvgPool_0a_3x3', (1536, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_3/Conv2d_0b_1x1', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_3/Conv2d_0b_1x1/BatchNorm', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Branch_3/Conv2d_0b_1x1/relu', (256, 8, 8))
   ('InceptionV4/Mixed_7d/Concat', (1536, 8, 8))
   ('InceptionV4/AuxLogits/AvgPool_1a_5x5', (1024, 5, 5))
   ('InceptionV4/AuxLogits/Conv2d_1b_1x1', (128, 5, 5))
   ('InceptionV4/AuxLogits/Conv2d_1b_1x1/BatchNorm', (128, 5, 5))
   ('InceptionV4/AuxLogits/Conv2d_1b_1x1/relu', (128, 5, 5))
   ('InceptionV4/AuxLogits/Conv2d_2a', (768, 1, 1))
   ('InceptionV4/AuxLogits/Conv2d_2a/BatchNorm', (768, 1, 1))
   ('InceptionV4/AuxLogits/Conv2d_2a/relu', (768, 1, 1))
   ('InceptionV4/AuxLogits/flat', (768,))
   ('InceptionV4/AuxLogits/Aux_logits', (1001,))
   ('InceptionV4/Logits/AvgPool_1a', (1536, 1, 1))
   ('InceptionV4/Logits/Dropout_1b', (1536, 1, 1))
   ('InceptionV4/Logits/PreLogitsFlatten', (1536,))
   ('InceptionV4/Logits/Logits', (1001,))
   NOTE: If your model was saved using Snapshot, then set use_pickle=False for loading it
   End intialization............
   
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ curl -i -F image=@image1.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 338
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 07:21:35 GMT
   
   n02125311 cougar, puma, catamount, mountain lion, painter, panther, Felis concolor:0.9205458<br/>n02128925 jaguar, panther, Panthera onca, Felis onca:0.0015412117<br/>n02672831 accordion, piano accordion, squeeze box:0.000676971<br/>n02129165 lion, king of beasts, Panthera leo:0.00063944317<br/>n04589890 window screen:0.00049529533<br/>ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$
   
   
   ubuntu@ip-172-31-39-12:~/incubator-singa/examples/imagenet/inception$ curl -i -F image=@image2.JPEG http://localhost:9999/api
   HTTP/1.1 100 Continue
   
   HTTP/1.0 200 OK
   Content-Type: text/html; charset=utf-8
   Content-Length: 227
   Access-Control-Allow-Origin: *
   Server: Werkzeug/0.16.0 Python/3.5.2
   Date: Mon, 30 Sep 2019 07:21:50 GMT
   
   n01616318 vulture:0.69436944<br/>n01608432 kite:0.17471701<br/>n01614925 bald eagle, American eagle, Haliaeetus leucocephalus:0.022925273<br/>n02002724 black stork, Ciconia nigra:0.0035106454<br/>n01818515 macaw:0.00340347<br/>
   ```
   
   PART (IV) Python Unit Test (test_operation.py)
   
   ```
   ubuntu@ip-172-31-39-12:~/incubator-singa/test/python$ python3 test_operation.py
   ......................................................................................WARNING: Logging before InitGoogleLogging() is written to STDERR
   I0930 09:23:32.326658  2059 tensor_math_cpp.h:146] not equal stride
   I0930 09:23:32.326978  2059 tensor_math_cpp.h:146] not equal stride
   .I0930 09:23:32.327564  2059 tensor_math_cpp.h:146] not equal stride
   I0930 09:23:32.327929  2059 tensor_math_cpp.h:146] not equal stride
   ......
   ----------------------------------------------------------------------
   Ran 93 tests in 0.919s
   
   OK
   
   ```
   The results are as expected.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message