TensorFlow和sklearn的基于CIFAR-10数据集的前馈神经网络实现

# 每一步的训练损失和最终的训练准确率 Epoch: 0001 cost= 22957601.699999996 Epoch: 0002 cost= 10912663.210000005 Epoch: 0003 cost= 8384631.495000003 Epoch: 0004 cost= 6980127.890000000 Epoch: 0005 cost= 6080726.640000002 Epoch: 0006 cost= 5423471.174999995 Epoch: 0007 cost= 4893540.524999999 Epoch: 0008 cost= 4483884.300000001 Epoch: 0009 cost= 4177967.820000000 Epoch: 0010 cost= 3898801.660000001 Epoch: 0011 cost= 3696830.689999999 Epoch: 0012 cost= 3595567.402500000 Epoch: 0013 cost= 3312340.609999999 Epoch: 0014 cost= 2998908.442499999 Epoch: 0015 cost= 2770331.504999998 Epoch: 0016 cost= 2573391.447499999 Epoch: 0017 cost= 2541822.257500000 Epoch: 0018 cost= 2362719.862500000 Epoch: 0019 cost= 2258849.629999999 Epoch: 0020 cost= 2251333.480000000 Epoch: 0021 cost= 2193593.476250000 Epoch: 0022 cost= 2122618.111250000 Epoch: 0023 cost= 2133204.126250000 Epoch: 0024 cost= 1949459.681250000 Epoch: 0025 cost= 1746142.373750000 Epoch: 0026 cost= 1709734.492500000 Epoch: 0027 cost= 1637198.520000000 Epoch: 0028 cost= 1575988.816249999 Epoch: 0029 cost= 1470254.737500000 Epoch: 0030 cost= 1376262.001875000 Epoch: 0031 cost= 1321751.374375001 Epoch: 0032 cost= 1319322.046875000 Epoch: 0033 cost= 1246974.523750000 Epoch: 0034 cost= 1310781.723750000 Epoch: 0035 cost= 1269704.752499999 Epoch: 0036 cost= 1272608.278750000 Epoch: 0037 cost= 1234064.518750000 Epoch: 0038 cost= 1151180.445000000 Epoch: 0039 cost= 1067570.205625000 Epoch: 0040 cost= 950063.685000000 Epoch: 0041 cost= 882500.434375000 Epoch: 0042 cost= 817842.875000000 Epoch: 0043 cost= 814498.001250000 Epoch: 0044 cost= 851828.881875000 Epoch: 0045 cost= 913045.951250000 Epoch: 0046 cost= 969625.048750000 Epoch: 0047 cost= 991896.660000000 Epoch: 0048 cost= 916416.688125000 Epoch: 0049 cost= 794010.821875000 Epoch: 0050 cost= 702323.205000000 Epoch: 0051 cost= 649233.921562500 Epoch: 0052 cost= 630600.674687500 Epoch: 0053 cost= 653500.110625000 Epoch: 0054 cost= 674936.776250000 Epoch: 0055 cost= 652474.576250000 Epoch: 0056 cost= 676277.438437500 Epoch: 0057 cost= 746527.503750000 Epoch: 0058 cost= 847680.081562500 Epoch: 0059 cost= 729903.504375000 Epoch: 0060 cost= 640217.034375000 Epoch: 0061 cost= 542231.424687500 Epoch: 0062 cost= 486155.243437500 Epoch: 0063 cost= 497086.645312500 Epoch: 0064 cost= 513229.905312500 Epoch: 0065 cost= 552105.663437500 Epoch: 0066 cost= 564482.730625000 Epoch: 0067 cost= 588344.327812500 Epoch: 0068 cost= 574240.082812500 Epoch: 0069 cost= 493240.009062500 Epoch: 0070 cost= 450578.697187500 Epoch: 0071 cost= 413906.997656250 Epoch: 0072 cost= 368389.674843750 Epoch: 0073 cost= 370145.091718750 Epoch: 0074 cost= 389373.603437500 Epoch: 0075 cost= 408954.706250000 Epoch: 0076 cost= 404534.293437500 Epoch: 0077 cost= 392851.292031250 Epoch: 0078 cost= 396592.327968750 Epoch: 0079 cost= 405947.728750000 Epoch: 0080 cost= 399686.742343750 Epoch: 0081 cost= 419206.809531250 Epoch: 0082 cost= 437594.157500000 Epoch: 0083 cost= 428153.600000000 Epoch: 0084 cost= 391722.659062500 Epoch: 0085 cost= 361748.548437500 Epoch: 0086 cost= 331783.952968750 Epoch: 0087 cost= 307284.647500000 Epoch: 0088 cost= 279797.012656250 Epoch: 0089 cost= 249676.097500000 Epoch: 0090 cost= 231377.819531250 Epoch: 0091 cost= 215145.819062500 Epoch: 0092 cost= 215349.972421875 Epoch: 0093 cost= 219971.401406250 Epoch: 0094 cost= 207507.102343750 Epoch: 0095 cost= 212633.888906250 Epoch: 0096 cost= 215226.251953125 Epoch: 0097 cost= 212217.114453125 Epoch: 0098 cost= 229735.138359375 Epoch: 0099 cost= 221366.786953125 Epoch: 0100 cost= 206834.413203125 Epoch: 0101 cost= 205599.196484375 Epoch: 0102 cost= 199552.412421875 Epoch: 0103 cost= 175461.771015625 Epoch: 0104 cost= 168859.990859375 Epoch: 0105 cost= 156140.897578125 Epoch: 0106 cost= 156380.709296875 Epoch: 0107 cost= 150108.462968750 Epoch: 0108 cost= 152154.798281250 Epoch: 0109 cost= 160529.120312500 Epoch: 0110 cost= 159094.902890625 Epoch: 0111 cost= 160093.822656250 Epoch: 0112 cost= 169669.035468750 Epoch: 0113 cost= 179019.471796875 Epoch: 0114 cost= 179387.063046875 Epoch: 0115 cost= 192036.101015625 Epoch: 0116 cost= 207064.966484375 Epoch: 0117 cost= 201636.991953125 Epoch: 0118 cost= 213338.818125000 Epoch: 0119 cost= 202022.638281250 Epoch: 0120 cost= 195424.456953125 Epoch: 0121 cost= 165746.613671875 Epoch: 0122 cost= 163324.099375000 Epoch: 0123 cost= 169270.391406250 Epoch: 0124 cost= 154400.233203125 Epoch: 0125 cost= 144510.536992188 Epoch: 0126 cost= 155943.137265625 Epoch: 0127 cost= 142006.634921875 Epoch: 0128 cost= 150264.020351563 Epoch: 0129 cost= 155197.118007813 Epoch: 0130 cost= 138674.545703125 Epoch: 0131 cost= 139674.393593750 Epoch: 0132 cost= 168406.374687500 Epoch: 0133 cost= 145713.906093750 Epoch: 0134 cost= 121665.742304688 Epoch: 0135 cost= 117758.791210937 Epoch: 0136 cost= 108818.473359375 Epoch: 0137 cost= 117563.387304688 Epoch: 0138 cost= 118996.626093750 Epoch: 0139 cost= 116275.717304687 Epoch: 0140 cost= 116837.959531250 Epoch: 0141 cost= 124275.476679687 Epoch: 0142 cost= 122495.135507812 Epoch: 0143 cost= 116275.308750000 Epoch: 0144 cost= 112534.317929688 Epoch: 0145 cost= 115606.745898437 Epoch: 0146 cost= 116571.419140625 Epoch: 0147 cost= 98320.696718750 Epoch: 0148 cost= 116266.605742188 Epoch: 0149 cost= 108219.485156250 Epoch: 0150 cost= 122488.662773438 Epoch: 0151 cost= 115877.375351562 Epoch: 0152 cost= 113066.365429688 Epoch: 0153 cost= 108337.546796875 Epoch: 0154 cost= 113167.102890625 Epoch: 0155 cost= 112118.437109375 Epoch: 0156 cost= 100529.469179688 Epoch: 0157 cost= 112777.258789062 Epoch: 0158 cost= 107610.977343750 Epoch: 0159 cost= 111298.326835938 Epoch: 0160 cost= 110345.764375000 Epoch: 0161 cost= 114772.304843750 Epoch: 0162 cost= 111756.262421875 Epoch: 0163 cost= 125302.729062500 Epoch: 0164 cost= 118296.684335937 Epoch: 0165 cost= 119768.645273438 Epoch: 0166 cost= 121964.274140625 Epoch: 0167 cost= 134668.144960937 Epoch: 0168 cost= 123337.987734375 Epoch: 0169 cost= 115327.571445312 Epoch: 0170 cost= 109199.656171875 Epoch: 0171 cost= 101835.766835937 Epoch: 0172 cost= 89052.235322266 Epoch: 0173 cost= 84136.118750000 Epoch: 0174 cost= 85975.555996094 Epoch: 0175 cost= 75891.227187500 Epoch: 0176 cost= 85528.365332031 Epoch: 0177 cost= 75238.931152344 Epoch: 0178 cost= 69716.216015625 Epoch: 0179 cost= 76520.305312500 Epoch: 0180 cost= 69838.949785156 Epoch: 0181 cost= 64944.580937500 Epoch: 0182 cost= 61935.371289063 Epoch: 0183 cost= 62445.243437500 Epoch: 0184 cost= 62147.626875000 Epoch: 0185 cost= 62707.522363281 Epoch: 0186 cost= 69527.405800781 Epoch: 0187 cost= 68641.380859375 Epoch: 0188 cost= 63450.454355469 Epoch: 0189 cost= 66459.884414063 Epoch: 0190 cost= 64111.916113281 Epoch: 0191 cost= 60768.517578125 Epoch: 0192 cost= 67010.561699219 Epoch: 0193 cost= 62437.320625000 Epoch: 0194 cost= 64538.188808594 Epoch: 0195 cost= 60313.539062500 Epoch: 0196 cost= 63793.860664062 Epoch: 0197 cost= 59613.570644531 Epoch: 0198 cost= 63147.457207031 Epoch: 0199 cost= 60517.878125000 Epoch: 0200 cost= 60168.664628906 Epoch: 0201 cost= 65167.662304688 Epoch: 0202 cost= 59432.799492187 Epoch: 0203 cost= 62685.245468750 Epoch: 0204 cost= 64976.968906250 Epoch: 0205 cost= 65397.264414062 Epoch: 0206 cost= 62986.414140625 Epoch: 0207 cost= 65181.722500000 Epoch: 0208 cost= 65251.905312500 Epoch: 0209 cost= 62861.559843750 Epoch: 0210 cost= 65277.215683594 Epoch: 0211 cost= 70134.318144531 Epoch: 0212 cost= 76747.617324219 Epoch: 0213 cost= 69021.788789063 Epoch: 0214 cost= 66165.743886719 Epoch: 0215 cost= 68914.386064453 Epoch: 0216 cost= 78775.107070313 Epoch: 0217 cost= 78330.814121094 Epoch: 0218 cost= 68686.219882812 Epoch: 0219 cost= 67304.385976562 Epoch: 0220 cost= 68243.816464844 Epoch: 0221 cost= 64348.752382813