"GoogLeNet"의 두 판 사이의 차이
ph
잔글 |
|||
| 3번째 줄: | 3번째 줄: | ||
* abstract<blockquote>We propose a deep convolutional neural network architecture codenamed "Inception", which was responsible for setting the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC 2014). The main hallmark of this architecture is the improved utilization of the computing resources inside the network. This was achieved by a carefully crafted design that allows for increasing the depth and width of the network while keeping the computational budget constant. To optimize quality, the architectural decisions were based on the [https://en.wikipedia.org/wiki/Hebbian_theory Hebbian principle] and the intuition of multi-scale processing. One particular incarnation used in our submission for ILSVRC 2014 is called GoogLeNet, a 22 layers deep network, the quality of which is assessed in the context of classification and detection.</blockquote> | * abstract<blockquote>We propose a deep convolutional neural network architecture codenamed "Inception", which was responsible for setting the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC 2014). The main hallmark of this architecture is the improved utilization of the computing resources inside the network. This was achieved by a carefully crafted design that allows for increasing the depth and width of the network while keeping the computational budget constant. To optimize quality, the architectural decisions were based on the [https://en.wikipedia.org/wiki/Hebbian_theory Hebbian principle] and the intuition of multi-scale processing. One particular incarnation used in our submission for ILSVRC 2014 is called GoogLeNet, a 22 layers deep network, the quality of which is assessed in the context of classification and detection.</blockquote> | ||
* Hebbian principle? | * Hebbian principle? | ||
| + | * | ||
| + | |||
| + | |||
| + | ==graphical view== | ||
| + | mxnet의 tutorial에 나오는 그림. | ||
| + | <html><svg width="2137pt" height="1285pt" viewBox="0.00 0.00 2137.40 1285.00" xmlns:xlink="http://www.w3.org/1999/xlink" style="width: 100%; height: 100%;" version="1.1" xmlns="http://www.w3.org/2000/svg"><defs><style type="text/css"></style></defs> | ||
| + | <g id="graph0" class="graph" transform="scale(1 1) rotate(0) translate(4 1281)"> | ||
| + | <title>plot</title> | ||
| + | <polygon fill="white" stroke="none" points="-4,4 -4,-1281 2133.4,-1281 2133.4,4 -4,4"></polygon> | ||
| + | <!-- Previous Output --> | ||
| + | <g id="node1" class="node"><title>Previous Output</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="522.399" cy="-29" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="522.399" y="-25.3" font-family="Times,serif" font-size="14.00">Previous Output</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_1x1 --> | ||
| + | <g id="node2" class="node"><title>conv_in3a_1x1</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="156.399,-874 62.3985,-874 62.3985,-816 156.399,-816 156.399,-874"></polygon> | ||
| + | <text text-anchor="middle" x="109.399" y="-848.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="109.399" y="-833.8" font-family="Times,serif" font-size="14.00">1x1/1x1, 64</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_1x1->Previous Output --> | ||
| + | <g id="edge1" class="edge"><title>conv_in3a_1x1->Previous Output</title> | ||
| + | <path fill="none" stroke="black" d="M132.749,-807.289C149.233,-777.844 168.399,-734.83 168.399,-694 168.399,-694 168.399,-694 168.399,-137 168.399,-73.4376 380.163,-44.1903 476.119,-34.2003"></path> | ||
| + | <polygon fill="black" stroke="black" points="127.743,-815.974 128.838,-805.063 130.24,-811.642 132.737,-807.31 132.737,-807.31 132.737,-807.31 130.24,-811.642 136.635,-809.557 127.743,-815.974 127.743,-815.974"></polygon> | ||
| + | <text text-anchor="middle" x="192.399" y="-428.3" font-family="Times,serif" font-size="14.00">3x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1_gamma --> | ||
| + | <g id="node3" class="node"><title>bn_in3a_1x1_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="66.3985" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="66.3985" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_1x1_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1_beta --> | ||
| + | <g id="node4" class="node"><title>bn_in3a_1x1_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="178.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="178.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_1x1_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1_moving_mean --> | ||
| + | <g id="node5" class="node"><title>bn_in3a_1x1_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="290.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="290.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_1x1_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1_moving_var --> | ||
| + | <g id="node6" class="node"><title>bn_in3a_1x1_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="402.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="402.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_1x1_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1 --> | ||
| + | <g id="node7" class="node"><title>bn_in3a_1x1</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="281.399,-1059 187.399,-1059 187.399,-1001 281.399,-1001 281.399,-1059"></polygon> | ||
| + | <text text-anchor="middle" x="234.399" y="-1026.3" font-family="Times,serif" font-size="14.00">bn_in3a_1x1</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1->conv_in3a_1x1 --> | ||
| + | <g id="edge2" class="edge"><title>bn_in3a_1x1->conv_in3a_1x1</title> | ||
| + | <path fill="none" stroke="black" d="M177.242,-1027.35C123.304,-1022.31 45.6101,-1005.2 10.3985,-950 -3.46543,-928.268 -3.4667,-913.731 10.3985,-892 21.9687,-873.866 42.7395,-862.769 62.2783,-856.035"></path> | ||
| + | <polygon fill="black" stroke="black" points="187.357,-1028.19 177.022,-1031.85 182.374,-1027.78 177.391,-1027.37 177.391,-1027.37 177.391,-1027.37 182.374,-1027.78 177.759,-1022.88 187.357,-1028.19 187.357,-1028.19"></polygon> | ||
| + | <text text-anchor="middle" x="68.8985" y="-971.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1->bn_in3a_1x1_gamma --> | ||
| + | <g id="edge3" class="edge"><title>bn_in3a_1x1->bn_in3a_1x1_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M181.583,-995.362C154.253,-977.955 121.79,-957.279 98.3037,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="190.259,-1000.89 179.407,-999.311 186.041,-998.201 181.824,-995.515 181.824,-995.515 181.824,-995.515 186.041,-998.201 184.241,-991.719 190.259,-1000.89 190.259,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1->bn_in3a_1x1_beta --> | ||
| + | <g id="edge4" class="edge"><title>bn_in3a_1x1->bn_in3a_1x1_beta</title> | ||
| + | <path fill="none" stroke="black" d="M214.966,-991.87C207.552,-977.704 199.251,-961.844 192.435,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="219.685,-1000.89 211.061,-994.114 217.367,-996.457 215.048,-992.027 215.048,-992.027 215.048,-992.027 217.367,-996.457 219.035,-989.94 219.685,-1000.89 219.685,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1->bn_in3a_1x1_moving_mean --> | ||
| + | <g id="edge5" class="edge"><title>bn_in3a_1x1->bn_in3a_1x1_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M253.831,-991.87C261.245,-977.704 269.546,-961.844 276.362,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="249.112,-1000.89 249.762,-989.94 251.43,-996.457 253.749,-992.027 253.749,-992.027 253.749,-992.027 251.43,-996.457 257.736,-994.114 249.112,-1000.89 249.112,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_1x1->bn_in3a_1x1_moving_var --> | ||
| + | <g id="edge6" class="edge"><title>bn_in3a_1x1->bn_in3a_1x1_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M287.214,-995.362C314.544,-977.955 347.007,-957.279 370.493,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="278.539,-1000.89 284.556,-991.719 282.756,-998.201 286.973,-995.515 286.973,-995.515 286.973,-995.515 282.756,-998.201 289.391,-999.311 278.539,-1000.89 278.539,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_1x1 --> | ||
| + | <g id="node8" class="node"><title>relu_in3a_1x1</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="690.399,-1168 596.399,-1168 596.399,-1110 690.399,-1110 690.399,-1168"></polygon> | ||
| + | <text text-anchor="middle" x="643.399" y="-1142.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="643.399" y="-1127.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_1x1->bn_in3a_1x1 --> | ||
| + | <g id="edge7" class="edge"><title>relu_in3a_1x1->bn_in3a_1x1</title> | ||
| + | <path fill="none" stroke="black" d="M586.007,-1122.99C504.582,-1101.68 357.053,-1063.09 281.605,-1043.35"></path> | ||
| + | <polygon fill="black" stroke="black" points="596.081,-1125.62 585.268,-1127.44 591.244,-1124.36 586.407,-1123.09 586.407,-1123.09 586.407,-1123.09 591.244,-1124.36 587.546,-1118.74 596.081,-1125.62 596.081,-1125.62"></polygon> | ||
| + | <text text-anchor="middle" x="490.899" y="-1080.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_3x3_reduce --> | ||
| + | <g id="node9" class="node"><title>conv_in3a_3x3_reduce</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="486.399,-461 392.399,-461 392.399,-403 486.399,-403 486.399,-461"></polygon> | ||
| + | <text text-anchor="middle" x="439.399" y="-435.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="439.399" y="-420.8" font-family="Times,serif" font-size="14.00">1x1/1x1, 64</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_3x3_reduce->Previous Output --> | ||
| + | <g id="edge8" class="edge"><title>conv_in3a_3x3_reduce->Previous Output</title> | ||
| + | <path fill="none" stroke="black" d="M464.981,-394.24C479.739,-369.48 495.399,-335.444 495.399,-302.5 495.399,-302.5 495.399,-302.5 495.399,-137 495.399,-109.22 504.061,-78.5821 511.572,-57.2362"></path> | ||
| + | <polygon fill="black" stroke="black" points="459.616,-402.923 461.044,-392.05 462.244,-398.669 464.872,-394.416 464.872,-394.416 464.872,-394.416 462.244,-398.669 468.701,-396.781 459.616,-402.923 459.616,-402.923"></polygon> | ||
| + | <text text-anchor="middle" x="519.399" y="-243.3" font-family="Times,serif" font-size="14.00">3x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce_gamma --> | ||
| + | <g id="node10" class="node"><title>bn_in3a_3x3_reduce_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="402.399" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="402.399" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_reduce_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce_beta --> | ||
| + | <g id="node11" class="node"><title>bn_in3a_3x3_reduce_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="514.399" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="514.399" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_reduce_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce_moving_mean --> | ||
| + | <g id="node12" class="node"><title>bn_in3a_3x3_reduce_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="626.399" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="626.399" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_reduce_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce_moving_var --> | ||
| + | <g id="node13" class="node"><title>bn_in3a_3x3_reduce_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="738.399" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="738.399" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_reduce_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce --> | ||
| + | <g id="node14" class="node"><title>bn_in3a_3x3_reduce</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="561.399,-646 467.399,-646 467.399,-588 561.399,-588 561.399,-646"></polygon> | ||
| + | <text text-anchor="middle" x="514.399" y="-613.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_reduce</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce->conv_in3a_3x3_reduce --> | ||
| + | <g id="edge9" class="edge"><title>bn_in3a_3x3_reduce->conv_in3a_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M457.429,-607.294C417.507,-597.723 367.638,-577.864 346.399,-537 334.51,-514.127 332.799,-500.899 346.399,-479 356.662,-462.474 374.817,-451.704 392.38,-444.776"></path> | ||
| + | <polygon fill="black" stroke="black" points="467.341,-609.512 456.6,-611.719 462.462,-608.42 457.582,-607.328 457.582,-607.328 457.582,-607.328 462.462,-608.42 458.565,-602.937 467.341,-609.512 467.341,-609.512"></polygon> | ||
| + | <text text-anchor="middle" x="400.899" y="-558.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_gamma --> | ||
| + | <g id="edge10" class="edge"><title>bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M477.619,-580.863C461.18,-565.157 442.224,-547.048 427.455,-532.938"></path> | ||
| + | <polygon fill="black" stroke="black" points="484.972,-587.887 474.633,-584.233 481.357,-584.433 477.741,-580.979 477.741,-580.979 477.741,-580.979 481.357,-584.433 480.85,-577.725 484.972,-587.887 484.972,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_beta --> | ||
| + | <g id="edge11" class="edge"><title>bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_beta</title> | ||
| + | <path fill="none" stroke="black" d="M514.399,-577.582C514.399,-564.284 514.399,-549.632 514.399,-537.297"></path> | ||
| + | <polygon fill="black" stroke="black" points="514.399,-587.887 509.899,-577.887 514.399,-582.887 514.399,-577.887 514.399,-577.887 514.399,-577.887 514.399,-582.887 518.899,-577.887 514.399,-587.887 514.399,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_moving_mean --> | ||
| + | <g id="edge12" class="edge"><title>bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M551.178,-580.863C567.618,-565.157 586.573,-547.048 601.342,-532.938"></path> | ||
| + | <polygon fill="black" stroke="black" points="543.825,-587.887 547.947,-577.725 547.441,-584.433 551.056,-580.979 551.056,-580.979 551.056,-580.979 547.441,-584.433 554.164,-584.233 543.825,-587.887 543.825,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_moving_var --> | ||
| + | <g id="edge13" class="edge"><title>bn_in3a_3x3_reduce->bn_in3a_3x3_reduce_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M571.003,-589.796C603.659,-574.576 645.447,-554.923 682.399,-537 688.951,-533.822 695.91,-530.389 702.613,-527.053"></path> | ||
| + | <polygon fill="black" stroke="black" points="561.613,-594.168 568.779,-585.868 566.146,-592.058 570.679,-589.947 570.679,-589.947 570.679,-589.947 566.146,-592.058 572.578,-594.027 561.613,-594.168 561.613,-594.168"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_3x3_reduce --> | ||
| + | <g id="node15" class="node"><title>relu_in3a_3x3_reduce</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="561.399,-798 467.399,-798 467.399,-740 561.399,-740 561.399,-798"></polygon> | ||
| + | <text text-anchor="middle" x="514.399" y="-772.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="514.399" y="-757.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_3x3_reduce->bn_in3a_3x3_reduce --> | ||
| + | <g id="edge14" class="edge"><title>relu_in3a_3x3_reduce->bn_in3a_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M514.399,-729.507C514.399,-703.451 514.399,-669.621 514.399,-646.087"></path> | ||
| + | <polygon fill="black" stroke="black" points="514.399,-739.786 509.899,-729.786 514.399,-734.786 514.399,-729.786 514.399,-729.786 514.399,-729.786 514.399,-734.786 518.899,-729.786 514.399,-739.786 514.399,-739.786"></polygon> | ||
| + | <text text-anchor="middle" x="541.899" y="-689.3" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_3x3 --> | ||
| + | <g id="node16" class="node"><title>conv_in3a_3x3</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="561.399,-950 467.399,-950 467.399,-892 561.399,-892 561.399,-950"></polygon> | ||
| + | <text text-anchor="middle" x="514.399" y="-924.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="514.399" y="-909.8" font-family="Times,serif" font-size="14.00">3x3/1x1, 64</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_3x3->relu_in3a_3x3_reduce --> | ||
| + | <g id="edge15" class="edge"><title>conv_in3a_3x3->relu_in3a_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M514.399,-881.507C514.399,-855.451 514.399,-821.621 514.399,-798.087"></path> | ||
| + | <polygon fill="black" stroke="black" points="514.399,-891.786 509.899,-881.786 514.399,-886.786 514.399,-881.786 514.399,-881.786 514.399,-881.786 514.399,-886.786 518.899,-881.786 514.399,-891.786 514.399,-891.786"></polygon> | ||
| + | <text text-anchor="middle" x="541.899" y="-841.3" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_gamma --> | ||
| + | <g id="node17" class="node"><title>bn_in3a_3x3_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="626.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="626.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_beta --> | ||
| + | <g id="node18" class="node"><title>bn_in3a_3x3_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="738.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="738.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_moving_mean --> | ||
| + | <g id="node19" class="node"><title>bn_in3a_3x3_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="850.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="850.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3_moving_var --> | ||
| + | <g id="node20" class="node"><title>bn_in3a_3x3_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="962.399" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="962.399" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3 --> | ||
| + | <g id="node21" class="node"><title>bn_in3a_3x3</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="841.399,-1059 747.399,-1059 747.399,-1001 841.399,-1001 841.399,-1059"></polygon> | ||
| + | <text text-anchor="middle" x="794.399" y="-1026.3" font-family="Times,serif" font-size="14.00">bn_in3a_3x3</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3->conv_in3a_3x3 --> | ||
| + | <g id="edge16" class="edge"><title>bn_in3a_3x3->conv_in3a_3x3</title> | ||
| + | <path fill="none" stroke="black" d="M737.303,-1013.93C708.256,-1005.74 672.589,-994.867 641.399,-983 608.876,-970.626 601.741,-965.116 570.399,-950 567.461,-948.583 564.443,-947.114 561.404,-945.625"></path> | ||
| + | <polygon fill="black" stroke="black" points="747.283,-1016.72 736.442,-1018.36 742.467,-1015.37 737.65,-1014.03 737.65,-1014.03 737.65,-1014.03 742.467,-1015.37 738.859,-1009.69 747.283,-1016.72 747.283,-1016.72"></polygon> | ||
| + | <text text-anchor="middle" x="668.899" y="-971.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3->bn_in3a_3x3_gamma --> | ||
| + | <g id="edge17" class="edge"><title>bn_in3a_3x3->bn_in3a_3x3_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M741.583,-995.362C714.253,-977.955 681.79,-957.279 658.304,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="750.259,-1000.89 739.407,-999.311 746.041,-998.201 741.824,-995.515 741.824,-995.515 741.824,-995.515 746.041,-998.201 744.241,-991.719 750.259,-1000.89 750.259,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3->bn_in3a_3x3_beta --> | ||
| + | <g id="edge18" class="edge"><title>bn_in3a_3x3->bn_in3a_3x3_beta</title> | ||
| + | <path fill="none" stroke="black" d="M774.966,-991.87C767.552,-977.704 759.251,-961.844 752.435,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="779.685,-1000.89 771.061,-994.114 777.367,-996.457 775.048,-992.027 775.048,-992.027 775.048,-992.027 777.367,-996.457 779.035,-989.94 779.685,-1000.89 779.685,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3->bn_in3a_3x3_moving_mean --> | ||
| + | <g id="edge19" class="edge"><title>bn_in3a_3x3->bn_in3a_3x3_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M813.831,-991.87C821.245,-977.704 829.546,-961.844 836.362,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="809.112,-1000.89 809.762,-989.94 811.43,-996.457 813.749,-992.027 813.749,-992.027 813.749,-992.027 811.43,-996.457 817.736,-994.114 809.112,-1000.89 809.112,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_3x3->bn_in3a_3x3_moving_var --> | ||
| + | <g id="edge20" class="edge"><title>bn_in3a_3x3->bn_in3a_3x3_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M847.214,-995.362C874.544,-977.955 907.007,-957.279 930.493,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="838.539,-1000.89 844.556,-991.719 842.756,-998.201 846.973,-995.515 846.973,-995.515 846.973,-995.515 842.756,-998.201 849.391,-999.311 838.539,-1000.89 838.539,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_3x3 --> | ||
| + | <g id="node22" class="node"><title>relu_in3a_3x3</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="938.399,-1168 844.399,-1168 844.399,-1110 938.399,-1110 938.399,-1168"></polygon> | ||
| + | <text text-anchor="middle" x="891.399" y="-1142.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="891.399" y="-1127.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_3x3->bn_in3a_3x3 --> | ||
| + | <g id="edge21" class="edge"><title>relu_in3a_3x3->bn_in3a_3x3</title> | ||
| + | <path fill="none" stroke="black" d="M859.059,-1102.33C846.367,-1088.33 832.008,-1072.49 820.051,-1059.3"></path> | ||
| + | <polygon fill="black" stroke="black" points="865.913,-1109.89 855.863,-1105.5 862.555,-1106.18 859.197,-1102.48 859.197,-1102.48 859.197,-1102.48 862.555,-1106.18 862.53,-1099.46 865.913,-1109.89 865.913,-1109.89"></polygon> | ||
| + | <text text-anchor="middle" x="876.899" y="-1080.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_reduce --> | ||
| + | <g id="node23" class="node"><title>conv_in3a_double_3x3_reduce</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="618.399,-167 524.399,-167 524.399,-109 618.399,-109 618.399,-167"></polygon> | ||
| + | <text text-anchor="middle" x="571.399" y="-141.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="571.399" y="-126.8" font-family="Times,serif" font-size="14.00">1x1/1x1, 64</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_reduce->Previous Output --> | ||
| + | <g id="edge22" class="edge"><title>conv_in3a_double_3x3_reduce->Previous Output</title> | ||
| + | <path fill="none" stroke="black" d="M554.244,-99.5393C547.856,-85.5909 540.734,-70.0396 534.848,-57.1865"></path> | ||
| + | <polygon fill="black" stroke="black" points="558.524,-108.887 550.269,-101.669 556.443,-104.341 554.361,-99.795 554.361,-99.795 554.361,-99.795 556.443,-104.341 558.452,-97.9214 558.524,-108.887 558.524,-108.887"></polygon> | ||
| + | <text text-anchor="middle" x="574.399" y="-79.8" font-family="Times,serif" font-size="14.00">3x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce_gamma --> | ||
| + | <g id="node24" class="node"><title>bn_in3a_double_3x3_reduce_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="684.399" cy="-138" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="684.399" y="-134.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_reduce_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce_beta --> | ||
| + | <g id="node25" class="node"><title>bn_in3a_double_3x3_reduce_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="796.399" cy="-138" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="796.399" y="-134.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_reduce_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce_moving_mean --> | ||
| + | <g id="node26" class="node"><title>bn_in3a_double_3x3_reduce_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="908.399" cy="-138" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="908.399" y="-134.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_reduce_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce_moving_var --> | ||
| + | <g id="node27" class="node"><title>bn_in3a_double_3x3_reduce_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1020.4" cy="-138" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1020.4" y="-134.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_reduce_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce --> | ||
| + | <g id="node28" class="node"><title>bn_in3a_double_3x3_reduce</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="850.399,-276 756.399,-276 756.399,-218 850.399,-218 850.399,-276"></polygon> | ||
| + | <text text-anchor="middle" x="803.399" y="-243.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_reduce</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce->conv_in3a_double_3x3_reduce --> | ||
| + | <g id="edge23" class="edge"><title>bn_in3a_double_3x3_reduce->conv_in3a_double_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M746.627,-227.348C724.952,-219.648 700.217,-210.149 678.399,-200 657.653,-190.35 635.557,-178.111 616.863,-167.132"></path> | ||
| + | <polygon fill="black" stroke="black" points="756.35,-230.755 745.424,-231.695 751.631,-229.102 746.912,-227.448 746.912,-227.448 746.912,-227.448 751.631,-229.102 748.401,-223.201 756.35,-230.755 756.35,-230.755"></polygon> | ||
| + | <text text-anchor="middle" x="705.899" y="-188.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_gamma --> | ||
| + | <g id="edge24" class="edge"><title>bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M764.683,-211.189C746.841,-195.146 726.147,-176.539 710.238,-162.234"></path> | ||
| + | <polygon fill="black" stroke="black" points="772.133,-217.887 761.688,-214.547 768.415,-214.544 764.697,-211.201 764.697,-211.201 764.697,-211.201 768.415,-214.544 767.705,-207.855 772.133,-217.887 772.133,-217.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_beta --> | ||
| + | <g id="edge25" class="edge"><title>bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_beta</title> | ||
| + | <path fill="none" stroke="black" d="M800.885,-207.582C800.015,-194.284 799.057,-179.632 798.25,-167.297"></path> | ||
| + | <polygon fill="black" stroke="black" points="801.559,-217.887 796.416,-208.202 801.233,-212.898 800.906,-207.908 800.906,-207.908 800.906,-207.908 801.233,-212.898 805.397,-207.615 801.559,-217.887 801.559,-217.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_moving_mean --> | ||
| + | <g id="edge26" class="edge"><title>bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M838.242,-210.493C853.44,-195.005 870.874,-177.239 884.56,-163.292"></path> | ||
| + | <polygon fill="black" stroke="black" points="830.986,-217.887 834.778,-207.598 834.488,-214.318 837.99,-210.75 837.99,-210.75 837.99,-210.75 834.488,-214.318 841.202,-213.901 830.986,-217.887 830.986,-217.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_moving_var --> | ||
| + | <g id="edge27" class="edge"><title>bn_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M859.96,-218.374C890.85,-203.255 929.759,-184.158 964.399,-167 970.925,-163.767 977.87,-160.309 984.569,-156.964"></path> | ||
| + | <polygon fill="black" stroke="black" points="850.645,-222.932 857.649,-214.495 855.136,-220.735 859.627,-218.537 859.627,-218.537 859.627,-218.537 855.136,-220.735 861.605,-222.579 850.645,-222.932 850.645,-222.932"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_reduce --> | ||
| + | <g id="node29" class="node"><title>relu_in3a_double_3x3_reduce</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="892.399,-385 798.399,-385 798.399,-327 892.399,-327 892.399,-385"></polygon> | ||
| + | <text text-anchor="middle" x="845.399" y="-359.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="845.399" y="-344.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce --> | ||
| + | <g id="edge28" class="edge"><title>relu_in3a_double_3x3_reduce->bn_in3a_double_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M830.628,-317.371C825.327,-303.865 819.443,-288.876 814.506,-276.297"></path> | ||
| + | <polygon fill="black" stroke="black" points="834.364,-326.887 826.521,-319.223 832.537,-322.233 830.71,-317.578 830.71,-317.578 830.71,-317.578 832.537,-322.233 834.898,-315.934 834.364,-326.887 834.364,-326.887"></polygon> | ||
| + | <text text-anchor="middle" x="854.899" y="-297.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_0 --> | ||
| + | <g id="node30" class="node"><title>conv_in3a_double_3x3_0</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="897.399,-537 803.399,-537 803.399,-479 897.399,-479 897.399,-537"></polygon> | ||
| + | <text text-anchor="middle" x="850.399" y="-511.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="850.399" y="-496.8" font-family="Times,serif" font-size="14.00">3x3/1x1, 96</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_0->relu_in3a_double_3x3_reduce --> | ||
| + | <g id="edge29" class="edge"><title>conv_in3a_double_3x3_0->relu_in3a_double_3x3_reduce</title> | ||
| + | <path fill="none" stroke="black" d="M849.115,-468.507C848.247,-442.451 847.119,-408.621 846.335,-385.087"></path> | ||
| + | <polygon fill="black" stroke="black" points="849.458,-478.786 844.627,-468.942 849.291,-473.789 849.125,-468.792 849.125,-468.792 849.125,-468.792 849.291,-473.789 853.622,-468.642 849.458,-478.786 849.458,-478.786"></polygon> | ||
| + | <text text-anchor="middle" x="876.899" y="-428.3" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0_gamma --> | ||
| + | <g id="node31" class="node"><title>bn_in3a_double_3x3_0_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="962.399" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="962.399" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_0_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0_beta --> | ||
| + | <g id="node32" class="node"><title>bn_in3a_double_3x3_0_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1074.4" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1074.4" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_0_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0_moving_mean --> | ||
| + | <g id="node33" class="node"><title>bn_in3a_double_3x3_0_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1186.4" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1186.4" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_0_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0_moving_var --> | ||
| + | <g id="node34" class="node"><title>bn_in3a_double_3x3_0_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1298.4" cy="-508" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1298.4" y="-504.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_0_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0 --> | ||
| + | <g id="node35" class="node"><title>bn_in3a_double_3x3_0</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="1121.4,-646 1027.4,-646 1027.4,-588 1121.4,-588 1121.4,-646"></polygon> | ||
| + | <text text-anchor="middle" x="1074.4" y="-613.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_0</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0->conv_in3a_double_3x3_0 --> | ||
| + | <g id="edge30" class="edge"><title>bn_in3a_double_3x3_0->conv_in3a_double_3x3_0</title> | ||
| + | <path fill="none" stroke="black" d="M1017.79,-596.764C997.195,-589.17 973.935,-579.895 953.399,-570 933.365,-560.348 912.085,-548.108 894.099,-537.129"></path> | ||
| + | <polygon fill="black" stroke="black" points="1027.36,-600.241 1016.42,-601.054 1022.66,-598.533 1017.96,-596.825 1017.96,-596.825 1017.96,-596.825 1022.66,-598.533 1019.5,-592.595 1027.36,-600.241 1027.36,-600.241"></polygon> | ||
| + | <text text-anchor="middle" x="980.899" y="-558.8" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_gamma --> | ||
| + | <g id="edge31" class="edge"><title>bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M1037.62,-580.863C1021.18,-565.157 1002.22,-547.048 987.455,-532.938"></path> | ||
| + | <polygon fill="black" stroke="black" points="1044.97,-587.887 1034.63,-584.233 1041.36,-584.433 1037.74,-580.979 1037.74,-580.979 1037.74,-580.979 1041.36,-584.433 1040.85,-577.725 1044.97,-587.887 1044.97,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_beta --> | ||
| + | <g id="edge32" class="edge"><title>bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_beta</title> | ||
| + | <path fill="none" stroke="black" d="M1074.4,-577.582C1074.4,-564.284 1074.4,-549.632 1074.4,-537.297"></path> | ||
| + | <polygon fill="black" stroke="black" points="1074.4,-587.887 1069.9,-577.887 1074.4,-582.887 1074.4,-577.887 1074.4,-577.887 1074.4,-577.887 1074.4,-582.887 1078.9,-577.887 1074.4,-587.887 1074.4,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_moving_mean --> | ||
| + | <g id="edge33" class="edge"><title>bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M1111.18,-580.863C1127.62,-565.157 1146.57,-547.048 1161.34,-532.938"></path> | ||
| + | <polygon fill="black" stroke="black" points="1103.83,-587.887 1107.95,-577.725 1107.44,-584.433 1111.06,-580.979 1111.06,-580.979 1111.06,-580.979 1107.44,-584.433 1114.16,-584.233 1103.83,-587.887 1103.83,-587.887"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_moving_var --> | ||
| + | <g id="edge34" class="edge"><title>bn_in3a_double_3x3_0->bn_in3a_double_3x3_0_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M1131,-589.796C1163.66,-574.576 1205.45,-554.923 1242.4,-537 1248.95,-533.822 1255.91,-530.389 1262.61,-527.053"></path> | ||
| + | <polygon fill="black" stroke="black" points="1121.61,-594.168 1128.78,-585.868 1126.15,-592.058 1130.68,-589.947 1130.68,-589.947 1130.68,-589.947 1126.15,-592.058 1132.58,-594.027 1121.61,-594.168 1121.61,-594.168"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_0 --> | ||
| + | <g id="node36" class="node"><title>relu_in3a_double_3x3_0</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="1121.4,-798 1027.4,-798 1027.4,-740 1121.4,-740 1121.4,-798"></polygon> | ||
| + | <text text-anchor="middle" x="1074.4" y="-772.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="1074.4" y="-757.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_0->bn_in3a_double_3x3_0 --> | ||
| + | <g id="edge35" class="edge"><title>relu_in3a_double_3x3_0->bn_in3a_double_3x3_0</title> | ||
| + | <path fill="none" stroke="black" d="M1074.4,-729.507C1074.4,-703.451 1074.4,-669.621 1074.4,-646.087"></path> | ||
| + | <polygon fill="black" stroke="black" points="1074.4,-739.786 1069.9,-729.786 1074.4,-734.786 1074.4,-729.786 1074.4,-729.786 1074.4,-729.786 1074.4,-734.786 1078.9,-729.786 1074.4,-739.786 1074.4,-739.786"></polygon> | ||
| + | <text text-anchor="middle" x="1101.9" y="-689.3" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_1 --> | ||
| + | <g id="node37" class="node"><title>conv_in3a_double_3x3_1</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="1121.4,-950 1027.4,-950 1027.4,-892 1121.4,-892 1121.4,-950"></polygon> | ||
| + | <text text-anchor="middle" x="1074.4" y="-924.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="1074.4" y="-909.8" font-family="Times,serif" font-size="14.00">3x3/1x1, 96</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_double_3x3_1->relu_in3a_double_3x3_0 --> | ||
| + | <g id="edge36" class="edge"><title>conv_in3a_double_3x3_1->relu_in3a_double_3x3_0</title> | ||
| + | <path fill="none" stroke="black" d="M1074.4,-881.507C1074.4,-855.451 1074.4,-821.621 1074.4,-798.087"></path> | ||
| + | <polygon fill="black" stroke="black" points="1074.4,-891.786 1069.9,-881.786 1074.4,-886.786 1074.4,-881.786 1074.4,-881.786 1074.4,-881.786 1074.4,-886.786 1078.9,-881.786 1074.4,-891.786 1074.4,-891.786"></polygon> | ||
| + | <text text-anchor="middle" x="1101.9" y="-841.3" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1_gamma --> | ||
| + | <g id="node38" class="node"><title>bn_in3a_double_3x3_1_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1186.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1186.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_1_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1_beta --> | ||
| + | <g id="node39" class="node"><title>bn_in3a_double_3x3_1_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1298.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1298.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_1_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1_moving_mean --> | ||
| + | <g id="node40" class="node"><title>bn_in3a_double_3x3_1_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1410.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1410.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_1_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1_moving_var --> | ||
| + | <g id="node41" class="node"><title>bn_in3a_double_3x3_1_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1522.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1522.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_1_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1 --> | ||
| + | <g id="node42" class="node"><title>bn_in3a_double_3x3_1</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="1289.4,-1059 1195.4,-1059 1195.4,-1001 1289.4,-1001 1289.4,-1059"></polygon> | ||
| + | <text text-anchor="middle" x="1242.4" y="-1026.3" font-family="Times,serif" font-size="14.00">bn_in3a_double_3x3_1</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1->conv_in3a_double_3x3_1 --> | ||
| + | <g id="edge37" class="edge"><title>bn_in3a_double_3x3_1->conv_in3a_double_3x3_1</title> | ||
| + | <path fill="none" stroke="black" d="M1186.16,-1002.36C1174.76,-996.374 1163.02,-989.779 1152.4,-983 1137.04,-973.196 1121.03,-961.052 1107.53,-950.188"></path> | ||
| + | <polygon fill="black" stroke="black" points="1195.21,-1007.01 1184.25,-1006.43 1190.76,-1004.72 1186.31,-1002.43 1186.31,-1002.43 1186.31,-1002.43 1190.76,-1004.72 1188.38,-998.433 1195.21,-1007.01 1195.21,-1007.01"></polygon> | ||
| + | <text text-anchor="middle" x="1179.9" y="-971.8" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_gamma --> | ||
| + | <g id="edge38" class="edge"><title>bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M1222.97,-991.87C1215.55,-977.704 1207.25,-961.844 1200.43,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="1227.69,-1000.89 1219.06,-994.114 1225.37,-996.457 1223.05,-992.027 1223.05,-992.027 1223.05,-992.027 1225.37,-996.457 1227.04,-989.94 1227.69,-1000.89 1227.69,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_beta --> | ||
| + | <g id="edge39" class="edge"><title>bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_beta</title> | ||
| + | <path fill="none" stroke="black" d="M1261.83,-991.87C1269.25,-977.704 1277.55,-961.844 1284.36,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="1257.11,-1000.89 1257.76,-989.94 1259.43,-996.457 1261.75,-992.027 1261.75,-992.027 1261.75,-992.027 1259.43,-996.457 1265.74,-994.114 1257.11,-1000.89 1257.11,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_moving_mean --> | ||
| + | <g id="edge40" class="edge"><title>bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M1295.21,-995.362C1322.54,-977.955 1355.01,-957.279 1378.49,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="1286.54,-1000.89 1292.56,-991.719 1290.76,-998.201 1294.97,-995.515 1294.97,-995.515 1294.97,-995.515 1290.76,-998.201 1297.39,-999.311 1286.54,-1000.89 1286.54,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_moving_var --> | ||
| + | <g id="edge41" class="edge"><title>bn_in3a_double_3x3_1->bn_in3a_double_3x3_1_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M1299.54,-1011.03C1345.26,-996.133 1410.7,-973.638 1466.4,-950 1473.2,-947.112 1480.34,-943.783 1487.16,-940.451"></path> | ||
| + | <polygon fill="black" stroke="black" points="1289.81,-1014.18 1297.94,-1006.82 1294.57,-1012.64 1299.33,-1011.1 1299.33,-1011.1 1299.33,-1011.1 1294.57,-1012.64 1300.71,-1015.38 1289.81,-1014.18 1289.81,-1014.18"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_1 --> | ||
| + | <g id="node43" class="node"><title>relu_in3a_double_3x3_1</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="1090.4,-1168 996.399,-1168 996.399,-1110 1090.4,-1110 1090.4,-1168"></polygon> | ||
| + | <text text-anchor="middle" x="1043.4" y="-1142.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="1043.4" y="-1127.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_double_3x3_1->bn_in3a_double_3x3_1 --> | ||
| + | <g id="edge42" class="edge"><title>relu_in3a_double_3x3_1->bn_in3a_double_3x3_1</title> | ||
| + | <path fill="none" stroke="black" d="M1099.69,-1107.73C1129.85,-1091.51 1166.59,-1071.76 1195.23,-1056.36"></path> | ||
| + | <polygon fill="black" stroke="black" points="1090.56,-1112.64 1097.24,-1103.94 1094.96,-1110.27 1099.37,-1107.91 1099.37,-1107.91 1099.37,-1107.91 1094.96,-1110.27 1101.5,-1111.87 1090.56,-1112.64 1090.56,-1112.64"></polygon> | ||
| + | <text text-anchor="middle" x="1182.9" y="-1080.8" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- avg_pool_in3a_pool --> | ||
| + | <g id="node44" class="node"><title>avg_pool_in3a_pool</title> | ||
| + | <polygon fill="#80b1d3" stroke="black" points="1518.4,-722 1424.4,-722 1424.4,-664 1518.4,-664 1518.4,-722"></polygon> | ||
| + | <text text-anchor="middle" x="1471.4" y="-696.8" font-family="Times,serif" font-size="14.00">Pooling</text> | ||
| + | <text text-anchor="middle" x="1471.4" y="-681.8" font-family="Times,serif" font-size="14.00">avg, 3x3/1x1</text> | ||
| + | </g> | ||
| + | <!-- avg_pool_in3a_pool->Previous Output --> | ||
| + | <g id="edge43" class="edge"><title>avg_pool_in3a_pool->Previous Output</title> | ||
| + | <path fill="none" stroke="black" d="M1441.59,-655.676C1424.49,-631.177 1406.4,-597.27 1406.4,-563.5 1406.4,-563.5 1406.4,-563.5 1406.4,-137 1406.4,-51.9259 752.8,-34.0439 569.614,-30.7028"></path> | ||
| + | <polygon fill="black" stroke="black" points="1447.56,-663.933 1438.06,-658.469 1444.63,-659.882 1441.7,-655.831 1441.7,-655.831 1441.7,-655.831 1444.63,-659.882 1445.35,-653.194 1447.56,-663.933 1447.56,-663.933"></polygon> | ||
| + | <text text-anchor="middle" x="1430.4" y="-352.3" font-family="Times,serif" font-size="14.00">3x28x28</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_proj --> | ||
| + | <g id="node45" class="node"><title>conv_in3a_proj</title> | ||
| + | <polygon fill="#fb8072" stroke="black" points="1681.4,-950 1587.4,-950 1587.4,-892 1681.4,-892 1681.4,-950"></polygon> | ||
| + | <text text-anchor="middle" x="1634.4" y="-924.8" font-family="Times,serif" font-size="14.00">Convolution</text> | ||
| + | <text text-anchor="middle" x="1634.4" y="-909.8" font-family="Times,serif" font-size="14.00">1x1/1x1, 32</text> | ||
| + | </g> | ||
| + | <!-- conv_in3a_proj->avg_pool_in3a_pool --> | ||
| + | <g id="edge44" class="edge"><title>conv_in3a_proj->avg_pool_in3a_pool</title> | ||
| + | <path fill="none" stroke="black" d="M1608.1,-883.53C1575.63,-838.524 1521.14,-762.961 1491.71,-722.165"></path> | ||
| + | <polygon fill="black" stroke="black" points="1614.08,-891.834 1604.58,-886.356 1611.16,-887.779 1608.23,-883.723 1608.23,-883.723 1608.23,-883.723 1611.16,-887.779 1611.88,-881.091 1614.08,-891.834 1614.08,-891.834"></polygon> | ||
| + | <text text-anchor="middle" x="1622.4" y="-841.3" font-family="Times,serif" font-size="14.00">3x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj_gamma --> | ||
| + | <g id="node46" class="node"><title>bn_in3a_proj_gamma</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1746.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1746.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_proj_gamma</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj_beta --> | ||
| + | <g id="node47" class="node"><title>bn_in3a_proj_beta</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1858.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1858.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_proj_beta</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj_moving_mean --> | ||
| + | <g id="node48" class="node"><title>bn_in3a_proj_moving_mean</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="1970.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="1970.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_proj_moving_mean</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj_moving_var --> | ||
| + | <g id="node49" class="node"><title>bn_in3a_proj_moving_var</title> | ||
| + | <ellipse fill="#8dd3c7" stroke="black" cx="2082.4" cy="-921" rx="47" ry="29"></ellipse> | ||
| + | <text text-anchor="middle" x="2082.4" y="-917.3" font-family="Times,serif" font-size="14.00">bn_in3a_proj_moving_var</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj --> | ||
| + | <g id="node50" class="node"><title>bn_in3a_proj</title> | ||
| + | <polygon fill="#bebada" stroke="black" points="1849.4,-1059 1755.4,-1059 1755.4,-1001 1849.4,-1001 1849.4,-1059"></polygon> | ||
| + | <text text-anchor="middle" x="1802.4" y="-1026.3" font-family="Times,serif" font-size="14.00">bn_in3a_proj</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj->conv_in3a_proj --> | ||
| + | <g id="edge45" class="edge"><title>bn_in3a_proj->conv_in3a_proj</title> | ||
| + | <path fill="none" stroke="black" d="M1745.87,-1002.66C1734.23,-996.62 1722.22,-989.924 1711.4,-983 1696.17,-973.26 1680.35,-961.127 1667.04,-950.254"></path> | ||
| + | <polygon fill="black" stroke="black" points="1755.1,-1007.36 1744.15,-1006.83 1750.65,-1005.09 1746.19,-1002.82 1746.19,-1002.82 1746.19,-1002.82 1750.65,-1005.09 1748.23,-998.811 1755.1,-1007.36 1755.1,-1007.36"></polygon> | ||
| + | <text text-anchor="middle" x="1738.9" y="-971.8" font-family="Times,serif" font-size="14.00">32x28x28</text> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj->bn_in3a_proj_gamma --> | ||
| + | <g id="edge46" class="edge"><title>bn_in3a_proj->bn_in3a_proj_gamma</title> | ||
| + | <path fill="none" stroke="black" d="M1782.97,-991.87C1775.55,-977.704 1767.25,-961.844 1760.43,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="1787.69,-1000.89 1779.06,-994.114 1785.37,-996.457 1783.05,-992.027 1783.05,-992.027 1783.05,-992.027 1785.37,-996.457 1787.04,-989.94 1787.69,-1000.89 1787.69,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj->bn_in3a_proj_beta --> | ||
| + | <g id="edge47" class="edge"><title>bn_in3a_proj->bn_in3a_proj_beta</title> | ||
| + | <path fill="none" stroke="black" d="M1821.83,-991.87C1829.25,-977.704 1837.55,-961.844 1844.36,-948.819"></path> | ||
| + | <polygon fill="black" stroke="black" points="1817.11,-1000.89 1817.76,-989.94 1819.43,-996.457 1821.75,-992.027 1821.75,-992.027 1821.75,-992.027 1819.43,-996.457 1825.74,-994.114 1817.11,-1000.89 1817.11,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj->bn_in3a_proj_moving_mean --> | ||
| + | <g id="edge48" class="edge"><title>bn_in3a_proj->bn_in3a_proj_moving_mean</title> | ||
| + | <path fill="none" stroke="black" d="M1855.21,-995.362C1882.54,-977.955 1915.01,-957.279 1938.49,-942.321"></path> | ||
| + | <polygon fill="black" stroke="black" points="1846.54,-1000.89 1852.56,-991.719 1850.76,-998.201 1854.97,-995.515 1854.97,-995.515 1854.97,-995.515 1850.76,-998.201 1857.39,-999.311 1846.54,-1000.89 1846.54,-1000.89"></polygon> | ||
| + | </g> | ||
| + | <!-- bn_in3a_proj->bn_in3a_proj_moving_var --> | ||
| + | <g id="edge49" class="edge"><title>bn_in3a_proj->bn_in3a_proj_moving_var</title> | ||
| + | <path fill="none" stroke="black" d="M1859.54,-1011.03C1905.26,-996.133 1970.7,-973.638 2026.4,-950 2033.2,-947.112 2040.34,-943.783 2047.16,-940.451"></path> | ||
| + | <polygon fill="black" stroke="black" points="1849.81,-1014.18 1857.94,-1006.82 1854.57,-1012.64 1859.33,-1011.1 1859.33,-1011.1 1859.33,-1011.1 1854.57,-1012.64 1860.71,-1015.38 1849.81,-1014.18 1849.81,-1014.18"></polygon> | ||
| + | </g> | ||
| + | <!-- relu_in3a_proj --> | ||
| + | <g id="node51" class="node"><title>relu_in3a_proj</title> | ||
| + | <polygon fill="#ffffb3" stroke="black" points="1334.4,-1168 1240.4,-1168 1240.4,-1110 1334.4,-1110 1334.4,-1168"></polygon> | ||
| + | <text text-anchor="middle" x="1287.4" y="-1142.8" font-family="Times,serif" font-size="14.00">Activation</text> | ||
| + | <text text-anchor="middle" x="1287.4" y="-1127.8" font-family="Times,serif" font-size="14.00">relu</text> | ||
| + | </g> | ||
| + | <!-- relu_in3a_proj->bn_in3a_proj --> | ||
| + | <g id="edge50" class="edge"><title>relu_in3a_proj->bn_in3a_proj</title> | ||
| + | <path fill="none" stroke="black" d="M1344.32,-1126.17C1446.78,-1104.89 1660.39,-1060.5 1755.25,-1040.8"></path> | ||
| + | <polygon fill="black" stroke="black" points="1334.47,-1128.22 1343.34,-1121.78 1339.36,-1127.2 1344.26,-1126.19 1344.26,-1126.19 1344.26,-1126.19 1339.36,-1127.2 1345.17,-1130.59 1334.47,-1128.22 1334.47,-1128.22"></polygon> | ||
| + | <text text-anchor="middle" x="1602.9" y="-1080.8" font-family="Times,serif" font-size="14.00">32x28x28</text> | ||
| + | </g> | ||
| + | <!-- ch_concat_in3a_chconcat --> | ||
| + | <g id="node52" class="node"><title>ch_concat_in3a_chconcat</title> | ||
| + | <polygon fill="#fdb462" stroke="black" points="1013.4,-1277 919.399,-1277 919.399,-1219 1013.4,-1219 1013.4,-1277"></polygon> | ||
| + | <text text-anchor="middle" x="966.399" y="-1244.3" font-family="Times,serif" font-size="14.00">ch_concat_in3a_chconcat</text> | ||
| + | </g> | ||
| + | <!-- ch_concat_in3a_chconcat->relu_in3a_1x1 --> | ||
| + | <g id="edge51" class="edge"><title>ch_concat_in3a_chconcat->relu_in3a_1x1</title> | ||
| + | <path fill="none" stroke="black" d="M909.421,-1228.12C847.184,-1207.51 748.644,-1174.86 690.575,-1155.63"></path> | ||
| + | <polygon fill="black" stroke="black" points="919.086,-1231.33 908.178,-1232.45 914.339,-1229.75 909.593,-1228.18 909.593,-1228.18 909.593,-1228.18 914.339,-1229.75 911.008,-1223.91 919.086,-1231.33 919.086,-1231.33"></polygon> | ||
| + | <text text-anchor="middle" x="851.899" y="-1189.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- ch_concat_in3a_chconcat->relu_in3a_3x3 --> | ||
| + | <g id="edge52" class="edge"><title>ch_concat_in3a_chconcat->relu_in3a_3x3</title> | ||
| + | <path fill="none" stroke="black" d="M940.847,-1210.55C931.17,-1196.74 920.307,-1181.24 911.233,-1168.3"></path> | ||
| + | <polygon fill="black" stroke="black" points="946.693,-1218.89 937.268,-1213.28 943.823,-1214.79 940.953,-1210.7 940.953,-1210.7 940.953,-1210.7 943.823,-1214.79 944.638,-1208.12 946.693,-1218.89 946.693,-1218.89"></polygon> | ||
| + | <text text-anchor="middle" x="960.899" y="-1189.8" font-family="Times,serif" font-size="14.00">64x28x28</text> | ||
| + | </g> | ||
| + | <!-- ch_concat_in3a_chconcat->relu_in3a_double_3x3_1 --> | ||
| + | <g id="edge53" class="edge"><title>ch_concat_in3a_chconcat->relu_in3a_double_3x3_1</title> | ||
| + | <path fill="none" stroke="black" d="M992.631,-1210.55C1002.57,-1196.74 1013.72,-1181.24 1023.04,-1168.3"></path> | ||
| + | <polygon fill="black" stroke="black" points="986.629,-1218.89 988.818,-1208.14 989.55,-1214.83 992.47,-1210.77 992.47,-1210.77 992.47,-1210.77 989.55,-1214.83 996.123,-1213.4 986.629,-1218.89 986.629,-1218.89"></polygon> | ||
| + | <text text-anchor="middle" x="1037.9" y="-1189.8" font-family="Times,serif" font-size="14.00">96x28x28</text> | ||
| + | </g> | ||
| + | <!-- ch_concat_in3a_chconcat->relu_in3a_proj --> | ||
| + | <g id="edge54" class="edge"><title>ch_concat_in3a_chconcat->relu_in3a_proj</title> | ||
| + | <path fill="none" stroke="black" d="M1023.01,-1228.13C1084.77,-1207.54 1182.51,-1174.96 1240.25,-1155.72"></path> | ||
| + | <polygon fill="black" stroke="black" points="1013.42,-1231.33 1021.48,-1223.9 1018.16,-1229.75 1022.91,-1228.16 1022.91,-1228.16 1022.91,-1228.16 1018.16,-1229.75 1024.33,-1232.43 1013.42,-1231.33 1013.42,-1231.33"></polygon> | ||
| + | <text text-anchor="middle" x="1173.9" y="-1189.8" font-family="Times,serif" font-size="14.00">32x28x28</text> | ||
| + | </g> | ||
| + | </g> | ||
| + | </svg></html> | ||
2017년 6월 28일 (수) 12:59 판
- 17 Sep 2014
- abstract
We propose a deep convolutional neural network architecture codenamed "Inception", which was responsible for setting the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC 2014). The main hallmark of this architecture is the improved utilization of the computing resources inside the network. This was achieved by a carefully crafted design that allows for increasing the depth and width of the network while keeping the computational budget constant. To optimize quality, the architectural decisions were based on the Hebbian principle and the intuition of multi-scale processing. One particular incarnation used in our submission for ILSVRC 2014 is called GoogLeNet, a 22 layers deep network, the quality of which is assessed in the context of classification and detection.
- Hebbian principle?
graphical view
mxnet의 tutorial에 나오는 그림.