atch 264/269 - Train Accuracy: 0.9007, Validation Accuracy: 0.9301, Loss: 0.1083 Epoch 15 Batch 265/269 - Train Accuracy: 0.9180, Validation Accuracy: 0.9232, Loss: 0.0931 Epoch 15 Batch 266/269 - Train Accuracy: 0.9274, Validation Accuracy: 0.9278, Loss: 0.0904 Epoch 15 Batch 267/269 - Train Accuracy: 0.9262, Validation Accuracy: 0.9243, Loss: 0.1098 Epoch 16 Batch 1/269 - Train Accuracy: 0.9196, Validation Accuracy: 0.9316, Loss: 0.0981 Epoch 16 Batch 2/269 - Train Accuracy: 0.9223, Validation Accuracy: 0.9316, Loss: 0.0998 Epoch 16 Batch 3/269 - Train Accuracy: 0.9267, Validation Accuracy: 0.9285, Loss: 0.1013 Epoch 16 Batch 4/269 - Train Accuracy: 0.9037, Validation Accuracy: 0.9251, Loss: 0.1073 Epoch 16 Batch 5/269 - Train Accuracy: 0.9256, Validation Accuracy: 0.9277, Loss: 0.0975 Epoch 16 Batch 6/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9253, Loss: 0.0966 Epoch 16 Batch 7/269 - Train Accuracy: 0.9321, Validation Accuracy: 0.9293, Loss: 0.0922 Epoch 16 Batch 8/269 - Train Accuracy: 0.9366, Validation Accuracy: 0.9282, Loss: 0.1024 Epoch 16 Batch 9/269 - Train Accuracy: 0.9140, Validation Accuracy: 0.9262, Loss: 0.1045 Epoch 16 Batch 10/269 - Train Accuracy: 0.9239, Validation Accuracy: 0.9293, Loss: 0.0934 Epoch 16 Batch 11/269 - Train Accuracy: 0.9215, Validation Accuracy: 0.9270, Loss: 0.1053 Epoch 16 Batch 12/269 - Train Accuracy: 0.9178, Validation Accuracy: 0.9259, Loss: 0.1027 Epoch 16 Batch 13/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9301, Loss: 0.0865 Epoch 16 Batch 14/269 - Train Accuracy: 0.9163, Validation Accuracy: 0.9298, Loss: 0.0988 Epoch 16 Batch 15/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9302, Loss: 0.0818 Epoch 16 Batch 16/269 - Train Accuracy: 0.9170, Validation Accuracy: 0.9336, Loss: 0.0971 Epoch 16 Batch 17/269 - Train Accuracy: 0.9204, Validation Accuracy: 0.9324, Loss: 0.0829 Epoch 16 Batch 18/269 - Train Accuracy: 0.9167, Validation Accuracy: 0.9316, Loss: 0.0994 Epoch 16 Batch 19/269 - Train Accuracy: 0.9337, Validation Accuracy: 0.9280, Loss: 0.0870 Epoch 16 Batch 20/269 - Train Accuracy: 0.9265, Validation Accuracy: 0.9273, Loss: 0.0940 Epoch 16 Batch 21/269 - Train Accuracy: 0.9005, Validation Accuracy: 0.9282, Loss: 0.1062 Epoch 16 Batch 22/269 - Train Accuracy: 0.9376, Validation Accuracy: 0.9301, Loss: 0.0887 Epoch 16 Batch 23/269 - Train Accuracy: 0.9215, Validation Accuracy: 0.9285, Loss: 0.0999 Epoch 16 Batch 24/269 - Train Accuracy: 0.9187, Validation Accuracy: 0.9306, Loss: 0.0916 Epoch 16 Batch 25/269 - Train Accuracy: 0.9050, Validation Accuracy: 0.9289, Loss: 0.1013 Epoch 16 Batch 26/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9299, Loss: 0.0899 Epoch 16 Batch 27/269 - Train Accuracy: 0.9094, Validation Accuracy: 0.9338, Loss: 0.0912 Epoch 16 Batch 28/269 - Train Accuracy: 0.9071, Validation Accuracy: 0.9300, Loss: 0.1023 Epoch 16 Batch 29/269 - Train Accuracy: 0.9335, Validation Accuracy: 0.9308, Loss: 0.1044 Epoch 16 Batch 30/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9320, Loss: 0.0924 Epoch 16 Batch 31/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9334, Loss: 0.0963 Epoch 16 Batch 32/269 - Train Accuracy: 0.9378, Validation Accuracy: 0.9305, Loss: 0.0890 Epoch 16 Batch 33/269 - Train Accuracy: 0.9241, Validation Accuracy: 0.9289, Loss: 0.0889 Epoch 16 Batch 34/269 - Train Accuracy: 0.9252, Validation Accuracy: 0.9303, Loss: 0.0906 Epoch 16 Batch 35/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9243, Loss: 0.1035 Epoch 16 Batch 36/269 - Train Accuracy: 0.9083, Validation Accuracy: 0.9241, Loss: 0.0917 Epoch 16 Batch 37/269 - Train Accuracy: 0.9260, Validation Accuracy: 0.9290, Loss: 0.0943 Epoch 16 Batch 38/269 - Train Accuracy: 0.9262, Validation Accuracy: 0.9374, Loss: 0.0928 Epoch 16 Batch 39/269 - Train Accuracy: 0.9305, Validation Accuracy: 0.9377, Loss: 0.0981 Epoch 16 Batch 40/269 - Train Accuracy: 0.9219, Validation Accuracy: 0.9343, Loss: 0.0984 Epoch 16 Batch 41/269 - Train Accuracy: 0.9115, Validation Accuracy: 0.9314, Loss: 0.0962 Epoch 16 Batch 42/269 - Train Accuracy: 0.9284, Validation Accuracy: 0.9292, Loss: 0.0821 Epoch 16 Batch 43/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9318, Loss: 0.0985 Epoch 16 Batch 44/269 - Train Accuracy: 0.9223, Validation Accuracy: 0.9312, Loss: 0.0935 Epoch 16 Batch 45/269 - Train Accuracy: 0.9247, Validation Accuracy: 0.9338, Loss: 0.0955 Epoch 16 Batch 46/269 - Train Accuracy: 0.9229, Validation Accuracy: 0.9362, Loss: 0.0906 Epoch 16 Batch 47/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9362, Loss: 0.0859 Epoch 16 Batch 48/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9372, Loss: 0.0837 Epoch 16 Batch 49/269 - Train Accuracy: 0.9284, Validation Accuracy: 0.9349, Loss: 0.0906 Epoch 16 Batch 50/269 - Train Accuracy: 0.9118, Validation Accuracy: 0.9406, Loss: 0.1054 Epoch 16 Batch 51/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9393, Loss: 0.0955 Epoch 16 Batch 52/269 - Train Accuracy: 0.9173, Validation Accuracy: 0.9363, Loss: 0.0810 Epoch 16 Batch 53/269 - Train Accuracy: 0.9220, Validation Accuracy: 0.9379, Loss: 0.1039 Epoch 16 Batch 54/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9351, Loss: 0.0911 Epoch 16 Batch 55/269 - Train Accuracy: 0.9376, Validation Accuracy: 0.9320, Loss: 0.0869 Epoch 16 Batch 56/269 - Train Accuracy: 0.9196, Validation Accuracy: 0.9308, Loss: 0.0957 Epoch 16 Batch 57/269 - Train Accuracy: 0.9201, Validation Accuracy: 0.9290, Loss: 0.1079 Epoch 16 Batch 58/269 - Train Accuracy: 0.9303, Validation Accuracy: 0.9315, Loss: 0.0906 Epoch 16 Batch 59/269 - Train Accuracy: 0.9509, Validation Accuracy: 0.9354, Loss: 0.0746 Epoch 16 Batch 60/269 - Train Accuracy: 0.9223, Validation Accuracy: 0.9380, Loss: 0.0884 Epoch 16 Batch 61/269 - Train Accuracy: 0.9317, Validation Accuracy: 0.9375, Loss: 0.0882 Epoch 16 Batch 62/269 - Train Accuracy: 0.9217, Validation Accuracy: 0.9335, Loss: 0.0911 Epoch 16 Batch 63/269 - Train Accuracy: 0.9234, Validation Accuracy: 0.9350, Loss: 0.1068 Epoch 16 Batch 64/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9344, Loss: 0.0831 Epoch 16 Batch 65/269 - Train Accuracy: 0.9226, Validation Accuracy: 0.9346, Loss: 0.0895 Epoch 16 Batch 66/269 - Train Accuracy: 0.9128, Validation Accuracy: 0.9361, Loss: 0.0915 Epoch 16 Batch 67/269 - Train Accuracy: 0.9213, Validation Accuracy: 0.9330, Loss: 0.0950 Epoch 16 Batch 68/269 - Train Accuracy: 0.9207, Validation Accuracy: 0.9283, Loss: 0.0989 Epoch 16 Batch 69/269 - Train Accuracy: 0.9107, Validation Accuracy: 0.9323, Loss: 0.1104 Epoch 16 Batch 70/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9352, Loss: 0.0955 Epoch 16 Batch 71/269 - Train Accuracy: 0.9255, Validation Accuracy: 0.9381, Loss: 0.1030 Epoch 16 Batch 72/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9318, Loss: 0.1009 Epoch 16 Batch 73/269 - Train Accuracy: 0.9180, Validation Accuracy: 0.9323, Loss: 0.0996 Epoch 16 Batch 74/269 - Train Accuracy: 0.9398, Validation Accuracy: 0.9278, Loss: 0.0971 Epoch 16 Batch 75/269 - Train Accuracy: 0.9249, Validation Accuracy: 0.9259, Loss: 0.0980 Epoch 16 Batch 76/269 - Train Accuracy: 0.9178, Validation Accuracy: 0.9273, Loss: 0.0911 Epoch 16 Batch 77/269 - Train Accuracy: 0.9222, Validation Accuracy: 0.9250, Loss: 0.0887 Epoch 16 Batch 78/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9288, Loss: 0.0884 Epoch 16 Batch 79/269 - Train Accuracy: 0.9193, Validation Accuracy: 0.9300, Loss: 0.0859 Epoch 16 Batch 80/269 - Train Accuracy: 0.9267, Validation Accuracy: 0.9244, Loss: 0.0930 Epoch 16 Batch 81/269 - Train Accuracy: 0.9134, Validation Accuracy: 0.9261, Loss: 0.1030 Epoch 16 Batch 82/269 - Train Accuracy: 0.9392, Validation Accuracy: 0.9276, Loss: 0.0827 Epoch 16 Batch 83/269 - Train Accuracy: 0.9070, Validation Accuracy: 0.9290, Loss: 0.1031 Epoch 16 Batch 84/269 - Train Accuracy: 0.9354, Validation Accuracy: 0.9314, Loss: 0.0875 Epoch 16 Batch 85/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9290, Loss: 0.0900 Epoch 16 Batch 86/269 - Train Accuracy: 0.9227, Validation Accuracy: 0.9288, Loss: 0.0845 Epoch 16 Batch 87/269 - Train Accuracy: 0.9118, Validation Accuracy: 0.9272, Loss: 0.0949 Epoch 16 Batch 88/269 - Train Accuracy: 0.9043, Validation Accuracy: 0.9218, Loss: 0.0906 Epoch 16 Batch 89/269 - Train Accuracy: 0.9201, Validation Accuracy: 0.9229, Loss: 0.0962 Epoch 16 Batch 90/269 - Train Accuracy: 0.9259, Validation Accuracy: 0.9302, Loss: 0.1013 Epoch 16 Batch 91/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9287, Loss: 0.0894 Epoch 16 Batch 92/269 - Train Accuracy: 0.9382, Validation Accuracy: 0.9247, Loss: 0.0860 Epoch 16 Batch 93/269 - Train Accuracy: 0.9278, Validation Accuracy: 0.9269, Loss: 0.0895 Epoch 16 Batch 94/269 - Train Accuracy: 0.9165, Validation Accuracy: 0.9225, Loss: 0.1054 Epoch 16 Batch 95/269 - Train Accuracy: 0.9290, Validation Accuracy: 0.9239, Loss: 0.0880 Epoch 16 Batch 96/269 - Train Accuracy: 0.9156, Validation Accuracy: 0.9263, Loss: 0.0960 Epoch 16 Batch 97/269 - Train Accuracy: 0.9242, Validation Accuracy: 0.9275, Loss: 0.0955 Epoch 16 Batch 98/269 - Train Accuracy: 0.9307, Validation Accuracy: 0.9256, Loss: 0.0950 Epoch 16 Batch 99/269 - Train Accuracy: 0.9245, Validation Accuracy: 0.9292, Loss: 0.0909 Epoch 16 Batch 100/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9358, Loss: 0.0889 Epoch 16 Batch 101/269 - Train Accuracy: 0.9139, Validation Accuracy: 0.9311, Loss: 0.1036 Epoch 16 Batch 102/269 - Train Accuracy: 0.9285, Validation Accuracy: 0.9322, Loss: 0.0849 Epoch 16 Batch 103/269 - Train Accuracy: 0.9304, Validation Accuracy: 0.9310, Loss: 0.0978 Epoch 16 Batch 104/269 - Train Accuracy: 0.9189, Validation Accuracy: 0.9268, Loss: 0.0929 Epoch 16 Batch 105/269 - Train Accuracy: 0.9210, Validation Accuracy: 0.9326, Loss: 0.0901 Epoch 16 Batch 106/269 - Train Accuracy: 0.9374, Validation Accuracy: 0.9313, Loss: 0.0855 Epoch 16 Batch 107/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9325, Loss: 0.0915 Epoch 16 Batch 108/269 - Train Accuracy: 0.9388, Validation Accuracy: 0.9324, Loss: 0.0888 Epoch 16 Batch 109/269 - Train Accuracy: 0.9065, Validation Accuracy: 0.9243, Loss: 0.0993 Epoch 16 Batch 110/269 - Train Accuracy: 0.9189, Validation Accuracy: 0.9260, Loss: 0.0878 Epoch 16 Batch 111/269 - Train Accuracy: 0.9229, Validation Accuracy: 0.9322, Loss: 0.1009 Epoch 16 Batch 112/269 - Train Accuracy: 0.9270, Validation Accuracy: 0.9363, Loss: 0.0916 Epoch 16 Batch 113/269 - Train Accuracy: 0.9276, Validation Accuracy: 0.9372, Loss: 0.0914 Epoch 16 Batch 114/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9361, Loss: 0.0893 Epoch 16 Batch 115/269 - Train Accuracy: 0.9213, Validation Accuracy: 0.9318, Loss: 0.0926 Epoch 16 Batch 116/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9204, Loss: 0.0906 Epoch 16 Batch 117/269 - Train Accuracy: 0.9272, Validation Accuracy: 0.9190, Loss: 0.0928 Epoch 16 Batch 118/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9236, Loss: 0.0845 Epoch 16 Batch 119/269 - Train Accuracy: 0.9117, Validation Accuracy: 0.9261, Loss: 0.0981 Epoch 16 Batch 120/269 - Train Accuracy: 0.9256, Validation Accuracy: 0.9304, Loss: 0.0983 Epoch 16 Batch 121/269 - Train Accuracy: 0.9193, Validation Accuracy: 0.9337, Loss: 0.0876 Epoch 16 Batch 122/269 - Train Accuracy: 0.9270, Validation Accuracy: 0.9353, Loss: 0.0910 Epoch 16 Batch 123/269 - Train Accuracy: 0.9240, Validation Accuracy: 0.9290, Loss: 0.0861 Epoch 16 Batch 124/269 - Train Accuracy: 0.9233, Validation Accuracy: 0.9278, Loss: 0.0840 Epoch 16 Batch 125/269 - Train Accuracy: 0.9402, Validation Accuracy: 0.9305, Loss: 0.0848 Epoch 16 Batch 126/269 - Train Accuracy: 0.9165, Validation Accuracy: 0.9283, Loss: 0.0853 Epoch 16 Batch 127/269 - Train Accuracy: 0.9175, Validation Accuracy: 0.9312, Loss: 0.0927 Epoch 16 Batch 128/269 - Train Accuracy: 0.9209, Validation Accuracy: 0.9345, Loss: 0.0944 Epoch 16 Batch 129/269 - Train Accuracy: 0.9106, Validation Accuracy: 0.9296, Loss: 0.0891 Epoch 16 Batch 130/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9292, Loss: 0.0994 Epoch 16 Batch 131/269 - Train Accuracy: 0.9101, Validation Accuracy: 0.9329, Loss: 0.0918 Epoch 16 Batch 132/269 - Train Accuracy: 0.9129, Validation Accuracy: 0.9314, Loss: 0.0911 Epoch 16 Batch 133/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9334, Loss: 0.0873 Epoch 16 Batch 134/269 - Train Accuracy: 0.9205, Validation Accuracy: 0.9349, Loss: 0.0914 Epoch 16 Batch 135/269 - Train Accuracy: 0.9354, Validation Accuracy: 0.9336, Loss: 0.0927 Epoch 16 Batch 136/269 - Train Accuracy: 0.9041, Validation Accuracy: 0.9302, Loss: 0.0968 Epoch 16 Batch 137/269 - Train Accuracy: 0.9085, Validation Accuracy: 0.9295, Loss: 0.1030 Epoch 16 Batch 138/269 - Train Accuracy: 0.9242, Validation Accuracy: 0.9240, Loss: 0.0909 Epoch 16 Batch 139/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9269, Loss: 0.0895 Epoch 16 Batch 140/269 - Train Accuracy: 0.9219, Validation Accuracy: 0.9268, Loss: 0.0973 Epoch 16 Batch 141/269 - Train Accuracy: 0.9261, Validation Accuracy: 0.9307, Loss: 0.0929 Epoch 16 Batch 142/269 - Train Accuracy: 0.9263, Validation Accuracy: 0.9324, Loss: 0.0866 Epoch 16 Batch 143/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9286, Loss: 0.0808 Epoch 16 Batch 144/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9285, Loss: 0.0795 Epoch 16 Batch 145/269 - Train Accuracy: 0.9271, Validation Accuracy: 0.9271, Loss: 0.0896 Epoch 16 Batch 146/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9276, Loss: 0.0903 Epoch 16 Batch 147/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9280, Loss: 0.0950 Epoch 16 Batch 148/269 - Train Accuracy: 0.9209, Validation Accuracy: 0.9258, Loss: 0.0961 Epoch 16 Batch 149/269 - Train Accuracy: 0.9132, Validation Accuracy: 0.9211, Loss: 0.1016 Epoch 16 Batch 150/269 - Train Accuracy: 0.9270, Validation Accuracy: 0.9185, Loss: 0.0941 Epoch 16 Batch 151/269 - Train Accuracy: 0.9205, Validation Accuracy: 0.9194, Loss: 0.0969 Epoch 16 Batch 152/269 - Train Accuracy: 0.9321, Validation Accuracy: 0.9234, Loss: 0.0884 Epoch 16 Batch 153/269 - Train Accuracy: 0.9297, Validation Accuracy: 0.9308, Loss: 0.0893 Epoch 16 Batch 154/269 - Train Accuracy: 0.9347, Validation Accuracy: 0.9283, Loss: 0.0850 Epoch 16 Batch 155/269 - Train Accuracy: 0.9127, Validation Accuracy: 0.9244, Loss: 0.0859 Epoch 16 Batch 156/269 - Train Accuracy: 0.9219, Validation Accuracy: 0.9323, Loss: 0.0938 Epoch 16 Batch 157/269 - Train Accuracy: 0.9206, Validation Accuracy: 0.9315, Loss: 0.0852 Epoch 16 Batch 158/269 - Train Accuracy: 0.9201, Validation Accuracy: 0.9322, Loss: 0.0921 Epoch 16 Batch 159/269 - Train Accuracy: 0.9190, Validation Accuracy: 0.9296, Loss: 0.0944 Epoch 16 Batch 160/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9308, Loss: 0.0918 Epoch 16 Batch 161/269 - Train Accuracy: 0.9321, Validation Accuracy: 0.9330, Loss: 0.0860 Epoch 16 Batch 162/269 - Train Accuracy: 0.9339, Validation Accuracy: 0.9302, Loss: 0.0831 Epoch 16 Batch 163/269 - Train Accuracy: 0.9485, Validation Accuracy: 0.9279, Loss: 0.0910 Epoch 16 Batch 164/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9277, Loss: 0.0909 Epoch 16 Batch 165/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9280, Loss: 0.0896 Epoch 16 Batch 166/269 - Train Accuracy: 0.9267, Validation Accuracy: 0.9312, Loss: 0.0876 Epoch 16 Batch 167/269 - Train Accuracy: 0.9247, Validation Accuracy: 0.9335, Loss: 0.0859 Epoch 16 Batch 168/269 - Train Accuracy: 0.9212, Validation Accuracy: 0.9339, Loss: 0.0918 Epoch 16 Batch 169/269 - Train Accuracy: 0.9104, Validation Accuracy: 0.9387, Loss: 0.0891 Epoch 16 Batch 170/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9371, Loss: 0.0824 Epoch 16 Batch 171/269 - Train Accuracy: 0.9414, Validation Accuracy: 0.9331, Loss: 0.0890 Epoch 16 Batch 172/269 - Train Accuracy: 0.9237, Validation Accuracy: 0.9288, Loss: 0.0984 Epoch 16 Batch 173/269 - Train Accuracy: 0.9267, Validation Accuracy: 0.9284, Loss: 0.0835 Epoch 16 Batch 174/269 - Train Accuracy: 0.9351, Validation Accuracy: 0.9237, Loss: 0.0915 Epoch 16 Batch 175/269 - Train Accuracy: 0.9132, Validation Accuracy: 0.9240, Loss: 0.1034 Epoch 16 Batch 176/269 - Train Accuracy: 0.9072, Validation Accuracy: 0.9233, Loss: 0.1003 Epoch 16 Batch 177/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9287, Loss: 0.0865 Epoch 16 Batch 178/269 - Train Accuracy: 0.9336, Validation Accuracy: 0.9314, Loss: 0.0867 Epoch 16 Batch 179/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9323, Loss: 0.0875 Epoch 16 Batch 180/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9308, Loss: 0.0834 Epoch 16 Batch 181/269 - Train Accuracy: 0.9216, Validation Accuracy: 0.9276, Loss: 0.0908 Epoch 16 Batch 182/269 - Train Accuracy: 0.9255, Validation Accuracy: 0.9342, Loss: 0.0891 Epoch 16 Batch 183/269 - Train Accuracy: 0.9257, Validation Accuracy: 0.9382, Loss: 0.0748 Epoch 16 Batch 184/269 - Train Accuracy: 0.9234, Validation Accuracy: 0.9418, Loss: 0.0868 Epoch 16 Batch 185/269 - Train Accuracy: 0.9278, Validation Accuracy: 0.9405, Loss: 0.0848 Epoch 16 Batch 186/269 - Train Accuracy: 0.9308, Validation Accuracy: 0.9362, Loss: 0.0827 Epoch 16 Batch 187/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9325, Loss: 0.0863 Epoch 16 Batch 188/269 - Train Accuracy: 0.9207, Validation Accuracy: 0.9334, Loss: 0.0841 Epoch 16 Batch 189/269 - Train Accuracy: 0.9254, Validation Accuracy: 0.9321, Loss: 0.0856 Epoch 16 Batch 190/269 - Train Accuracy: 0.9263, Validation Accuracy: 0.9330, Loss: 0.0865 Epoch 16 Batch 191/269 - Train Accuracy: 0.9213, Validation Accuracy: 0.9341, Loss: 0.0902 Epoch 16 Batch 192/269 - Train Accuracy: 0.9293, Validation Accuracy: 0.9355, Loss: 0.0923 Epoch 16 Batch 193/269 - Train Accuracy: 0.9261, Validation Accuracy: 0.9356, Loss: 0.0867 Epoch 16 Batch 194/269 - Train Accuracy: 0.9142, Validation Accuracy: 0.9363, Loss: 0.0907 Epoch 16 Batch 195/269 - Train Accuracy: 0.9229, Validation Accuracy: 0.9331, Loss: 0.0852 Epoch 16 Batch 196/269 - Train Accuracy: 0.9249, Validation Accuracy: 0.9307, Loss: 0.0802 Epoch 16 Batch 197/269 - Train Accuracy: 0.9142, Validation Accuracy: 0.9289, Loss: 0.0882 Epoch 16 Batch 198/269 - Train Accuracy: 0.9276, Validation Accuracy: 0.9288, Loss: 0.0940 Epoch 16 Batch 199/269 - Train Accuracy: 0.9345, Validation Accuracy: 0.9232, Loss: 0.0908 Epoch 16 Batch 200/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9272, Loss: 0.0897 Epoch 16 Batch 201/269 - Train Accuracy: 0.9270, Validation Accuracy: 0.9277, Loss: 0.0950 Epoch 16 Batch 202/269 - Train Accuracy: 0.9286, Validation Accuracy: 0.9287, Loss: 0.0880 Epoch 16 Batch 203/269 - Train Accuracy: 0.9229, Validation Accuracy: 0.9317, Loss: 0.0963 Epoch 16 Batch 204/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9378, Loss: 0.0951 Epoch 16 Batch 205/269 - Train Accuracy: 0.9349, Validation Accuracy: 0.9397, Loss: 0.0853 Epoch 16 Batch 206/269 - Train Accuracy: 0.9219, Validation Accuracy: 0.9412, Loss: 0.0957 Epoch 16 Batch 207/269 - Train Accuracy: 0.9168, Validation Accuracy: 0.9419, Loss: 0.0851 Epoch 16 Batch 208/269 - Train Accuracy: 0.9197, Validation Accuracy: 0.9404, Loss: 0.0930 Epoch 16 Batch 209/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9387, Loss: 0.0825 Epoch 16 Batch 210/269 - Train Accuracy: 0.9327, Validation Accuracy: 0.9313, Loss: 0.0814 Epoch 16 Batch 211/269 - Train Accuracy: 0.9277, Validation Accuracy: 0.9346, Loss: 0.0945 Epoch 16 Batch 212/269 - Train Accuracy: 0.9190, Validation Accuracy: 0.9368, Loss: 0.0961 Epoch 16 Batch 213/269 - Train Accuracy: 0.9191, Validation Accuracy: 0.9362, Loss: 0.0835 Epoch 16 Batch 214/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9291, Loss: 0.0890 Epoch 16 Batch 215/269 - Train Accuracy: 0.9315, Validation Accuracy: 0.9328, Loss: 0.0854 Epoch 16 Batch 216/269 - Train Accuracy: 0.9203, Validation Accuracy: 0.9375, Loss: 0.1029 Epoch 16 Batch 217/269 - Train Accuracy: 0.9184, Validation Accuracy: 0.9366, Loss: 0.0903 Epoch 16 Batch 218/269 - Train Accuracy: 0.9330, Validation Accuracy: 0.9347, Loss: 0.0847 Epoch 16 Batch 219/269 - Train Accuracy: 0.9284, Validation Accuracy: 0.9392, Loss: 0.0931 Epoch 16 Batch 220/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9400, Loss: 0.0838 Epoch 16 Batch 221/269 - Train Accuracy: 0.9338, Validation Accuracy: 0.9411, Loss: 0.0881 Epoch 16 Batch 222/269 - Train Accuracy: 0.9391, Validation Accuracy: 0.9387, Loss: 0.0778 Epoch 16 Batch 223/269 - Train Accuracy: 0.9211, Validation Accuracy: 0.9363, Loss: 0.0913 Epoch 16 Batch 224/269 - Train Accuracy: 0.9209, Validation Accuracy: 0.9340, Loss: 0.1006 Epoch 16 Batch 225/269 - Train Accuracy: 0.9206, Validation Accuracy: 0.9291, Loss: 0.0848 Epoch 16 Batch 226/269 - Train Accuracy: 0.9191, Validation Accuracy: 0.9281, Loss: 0.0905 Epoch 16 Batch 227/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9311, Loss: 0.0971 Epoch 16 Batch 228/269 - Train Accuracy: 0.9247, Validation Accuracy: 0.9417, Loss: 0.0896 Epoch 16 Batch 229/269 - Train Accuracy: 0.9211, Validation Accuracy: 0.9405, Loss: 0.0855 Epoch 16 Batch 230/269 - Train Accuracy: 0.9352, Validation Accuracy: 0.9363, Loss: 0.0880 Epoch 16 Batch 231/269 - Train Accuracy: 0.9297, Validation Accuracy: 0.9285, Loss: 0.0918 Epoch 16 Batch 232/269 - Train Accuracy: 0.9168, Validation Accuracy: 0.9280, Loss: 0.0857 Epoch 16 Batch 233/269 - Train Accuracy: 0.9323, Validation Accuracy: 0.9299, Loss: 0.0934 Epoch 16 Batch 234/269 - Train Accuracy: 0.9290, Validation Accuracy: 0.9376, Loss: 0.0870 Epoch 16 Batch 235/269 - Train Accuracy: 0.9475, Validation Accuracy: 0.9356, Loss: 0.0803 Epoch 16 Batch 236/269 - Train Accuracy: 0.9174, Validation Accuracy: 0.9332, Loss: 0.0864 Epoch 16 Batch 237/269 - Train Accuracy: 0.9330, Validation Accuracy: 0.9361, Loss: 0.0821 Epoch 16 Batch 238/269 - Train Accuracy: 0.9233, Validation Accuracy: 0.9263, Loss: 0.0869 Epoch 16 Batch 239/269 - Train Accuracy: 0.9236, Validation Accuracy: 0.9247, Loss: 0.0889 Epoch 16 Batch 240/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9249, Loss: 0.0823 Epoch 16 Batch 241/269 - Train Accuracy: 0.9307, Validation Accuracy: 0.9242, Loss: 0.0968 Epoch 16 Batch 242/269 - Train Accuracy: 0.9411, Validation Accuracy: 0.9215, Loss: 0.0826 Epoch 16 Batch 243/269 - Train Accuracy: 0.9391, Validation Accuracy: 0.9268, Loss: 0.0790 Epoch 16 Batch 244/269 - Train Accuracy: 0.9217, Validation Accuracy: 0.9320, Loss: 0.0920 Epoch 16 Batch 245/269 - Train Accuracy: 0.9100, Validation Accuracy: 0.9322, Loss: 0.0859 Epoch 16 Batch 246/269 - Train Accuracy: 0.9239, Validation Accuracy: 0.9277, Loss: 0.0956 Epoch 16 Batch 247/269 - Train Accuracy: 0.9215, Validation Accuracy: 0.9263, Loss: 0.0890 Epoch 16 Batch 248/269 - Train Accuracy: 0.9279, Validation Accuracy: 0.9277, Loss: 0.0825 Epoch 16 Batch 249/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9400, Loss: 0.0803 Epoch 16 Batch 250/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9352, Loss: 0.0837 Epoch 16 Batch 251/269 - Train Accuracy: 0.9468, Validation Accuracy: 0.9368, Loss: 0.0841 Epoch 16 Batch 252/269 - Train Accuracy: 0.9340, Validation Accuracy: 0.9408, Loss: 0.0810 Epoch 16 Batch 253/269 - Train Accuracy: 0.9098, Validation Accuracy: 0.9333, Loss: 0.0951 Epoch 16 Batch 254/269 - Train Accuracy: 0.9244, Validation Accuracy: 0.9365, Loss: 0.0832 Epoch 16 Batch 255/269 - Train Accuracy: 0.9295, Validation Accuracy: 0.9332, Loss: 0.0887 Epoch 16 Batch 256/269 - Train Accuracy: 0.9249, Validation Accuracy: 0.9315, Loss: 0.0824 Epoch 16 Batch 257/269 - Train Accuracy: 0.9093, Validation Accuracy: 0.9297, Loss: 0.0906 Epoch 16 Batch 258/269 - Train Accuracy: 0.9247, Validation Accuracy: 0.9284, Loss: 0.0958 Epoch 16 Batch 259/269 - Train Accuracy: 0.9257, Validation Accuracy: 0.9277, Loss: 0.0865 Epoch 16 Batch 260/269 - Train Accuracy: 0.9206, Validation Accuracy: 0.9322, Loss: 0.0943 Epoch 16 Batch 261/269 - Train Accuracy: 0.9263, Validation Accuracy: 0.9341, Loss: 0.0910 Epoch 16 Batch 262/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9329, Loss: 0.0914 Epoch 16 Batch 263/269 - Train Accuracy: 0.9232, Validation Accuracy: 0.9378, Loss: 0.0891 Epoch 16 Batch 264/269 - Train Accuracy: 0.9081, Validation Accuracy: 0.9411, Loss: 0.0928 Epoch 16 Batch 265/269 - Train Accuracy: 0.9276, Validation Accuracy: 0.9398, Loss: 0.0865 Epoch 16 Batch 266/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9379, Loss: 0.0814 Epoch 16 Batch 267/269 - Train Accuracy: 0.9376, Validation Accuracy: 0.9331, Loss: 0.0932 Epoch 17 Batch 1/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9345, Loss: 0.0858 Epoch 17 Batch 2/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9324, Loss: 0.0891 Epoch 17 Batch 3/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9302, Loss: 0.0890 Epoch 17 Batch 4/269 - Train Accuracy: 0.9075, Validation Accuracy: 0.9299, Loss: 0.0917 Epoch 17 Batch 5/269 - Train Accuracy: 0.9317, Validation Accuracy: 0.9319, Loss: 0.0855 Epoch 17 Batch 6/269 - Train Accuracy: 0.9351, Validation Accuracy: 0.9294, Loss: 0.0825 Epoch 17 Batch 7/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9264, Loss: 0.0841 Epoch 17 Batch 8/269 - Train Accuracy: 0.9453, Validation Accuracy: 0.9265, Loss: 0.0863 Epoch 17 Batch 9/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9320, Loss: 0.0968 Epoch 17 Batch 10/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9333, Loss: 0.0846 Epoch 17 Batch 11/269 - Train Accuracy: 0.9299, Validation Accuracy: 0.9379, Loss: 0.0921 Epoch 17 Batch 12/269 - Train Accuracy: 0.9250, Validation Accuracy: 0.9375, Loss: 0.0969 Epoch 17 Batch 13/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9379, Loss: 0.0769 Epoch 17 Batch 14/269 - Train Accuracy: 0.9228, Validation Accuracy: 0.9342, Loss: 0.0790 Epoch 17 Batch 15/269 - Train Accuracy: 0.9421, Validation Accuracy: 0.9326, Loss: 0.0700 Epoch 17 Batch 16/269 - Train Accuracy: 0.9259, Validation Accuracy: 0.9305, Loss: 0.0956 Epoch 17 Batch 17/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9306, Loss: 0.0778 Epoch 17 Batch 18/269 - Train Accuracy: 0.9215, Validation Accuracy: 0.9287, Loss: 0.0857 Epoch 17 Batch 19/269 - Train Accuracy: 0.9376, Validation Accuracy: 0.9362, Loss: 0.0765 Epoch 17 Batch 20/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9322, Loss: 0.0866 Epoch 17 Batch 21/269 - Train Accuracy: 0.9076, Validation Accuracy: 0.9348, Loss: 0.0947 Epoch 17 Batch 22/269 - Train Accuracy: 0.9469, Validation Accuracy: 0.9332, Loss: 0.0781 Epoch 17 Batch 23/269 - Train Accuracy: 0.9144, Validation Accuracy: 0.9372, Loss: 0.0893 Epoch 17 Batch 24/269 - Train Accuracy: 0.9255, Validation Accuracy: 0.9355, Loss: 0.0831 Epoch 17 Batch 25/269 - Train Accuracy: 0.9198, Validation Accuracy: 0.9327, Loss: 0.0923 Epoch 17 Batch 26/269 - Train Accuracy: 0.9244, Validation Accuracy: 0.9358, Loss: 0.0846 Epoch 17 Batch 27/269 - Train Accuracy: 0.9193, Validation Accuracy: 0.9371, Loss: 0.0840 Epoch 17 Batch 28/269 - Train Accuracy: 0.9194, Validation Accuracy: 0.9395, Loss: 0.0967 Epoch 17 Batch 29/269 - Train Accuracy: 0.9382, Validation Accuracy: 0.9398, Loss: 0.0895 Epoch 17 Batch 30/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9399, Loss: 0.0815 Epoch 17 Batch 31/269 - Train Accuracy: 0.9348, Validation Accuracy: 0.9362, Loss: 0.0849 Epoch 17 Batch 32/269 - Train Accuracy: 0.9319, Validation Accuracy: 0.9351, Loss: 0.0807 Epoch 17 Batch 33/269 - Train Accuracy: 0.9319, Validation Accuracy: 0.9301, Loss: 0.0774 Epoch 17 Batch 34/269 - Train Accuracy: 0.9309, Validation Accuracy: 0.9291, Loss: 0.0817 Epoch 17 Batch 35/269 - Train Accuracy: 0.9315, Validation Accuracy: 0.9393, Loss: 0.0977 Epoch 17 Batch 36/269 - Train Accuracy: 0.9172, Validation Accuracy: 0.9395, Loss: 0.0862 Epoch 17 Batch 37/269 - Train Accuracy: 0.9411, Validation Accuracy: 0.9367, Loss: 0.0914 Epoch 17 Batch 38/269 - Train Accuracy: 0.9309, Validation Accuracy: 0.9356, Loss: 0.0863 Epoch 17 Batch 39/269 - Train Accuracy: 0.9384, Validation Accuracy: 0.9307, Loss: 0.0842 Epoch 17 Batch 40/269 - Train Accuracy: 0.9120, Validation Accuracy: 0.9285, Loss: 0.0893 Epoch 17 Batch 41/269 - Train Accuracy: 0.9143, Validation Accuracy: 0.9311, Loss: 0.0894 Epoch 17 Batch 42/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9299, Loss: 0.0766 Epoch 17 Batch 43/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9400, Loss: 0.0889 Epoch 17 Batch 44/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9426, Loss: 0.0850 Epoch 17 Batch 45/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9397, Loss: 0.0895 Epoch 17 Batch 46/269 - Train Accuracy: 0.9241, Validation Accuracy: 0.9430, Loss: 0.0828 Epoch 17 Batch 47/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9330, Loss: 0.0810 Epoch 17 Batch 48/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9272, Loss: 0.0836 Epoch 17 Batch 49/269 - Train Accuracy: 0.9413, Validation Accuracy: 0.9330, Loss: 0.0772 Epoch 17 Batch 50/269 - Train Accuracy: 0.9183, Validation Accuracy: 0.9373, Loss: 0.0910 Epoch 17 Batch 51/269 - Train Accuracy: 0.9380, Validation Accuracy: 0.9390, Loss: 0.0830 Epoch 17 Batch 52/269 - Train Accuracy: 0.9192, Validation Accuracy: 0.9386, Loss: 0.0742 Epoch 17 Batch 53/269 - Train Accuracy: 0.9252, Validation Accuracy: 0.9338, Loss: 0.0943 Epoch 17 Batch 54/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9325, Loss: 0.0844 Epoch 17 Batch 55/269 - Train Accuracy: 0.9368, Validation Accuracy: 0.9302, Loss: 0.0868 Epoch 17 Batch 56/269 - Train Accuracy: 0.9311, Validation Accuracy: 0.9355, Loss: 0.0863 Epoch 17 Batch 57/269 - Train Accuracy: 0.9208, Validation Accuracy: 0.9371, Loss: 0.0952 Epoch 17 Batch 58/269 - Train Accuracy: 0.9381, Validation Accuracy: 0.9381, Loss: 0.0829 Epoch 17 Batch 59/269 - Train Accuracy: 0.9611, Validation Accuracy: 0.9416, Loss: 0.0672 Epoch 17 Batch 60/269 - Train Accuracy: 0.9282, Validation Accuracy: 0.9444, Loss: 0.0787 Epoch 17 Batch 61/269 - Train Accuracy: 0.9370, Validation Accuracy: 0.9414, Loss: 0.0796 Epoch 17 Batch 62/269 - Train Accuracy: 0.9247, Validation Accuracy: 0.9373, Loss: 0.0829 Epoch 17 Batch 63/269 - Train Accuracy: 0.9203, Validation Accuracy: 0.9414, Loss: 0.0940 Epoch 17 Batch 64/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9415, Loss: 0.0781 Epoch 17 Batch 65/269 - Train Accuracy: 0.9237, Validation Accuracy: 0.9401, Loss: 0.0832 Epoch 17 Batch 66/269 - Train Accuracy: 0.9192, Validation Accuracy: 0.9419, Loss: 0.0880 Epoch 17 Batch 67/269 - Train Accuracy: 0.9214, Validation Accuracy: 0.9395, Loss: 0.0931 Epoch 17 Batch 68/269 - Train Accuracy: 0.9161, Validation Accuracy: 0.9357, Loss: 0.0920 Epoch 17 Batch 69/269 - Train Accuracy: 0.9199, Validation Accuracy: 0.9386, Loss: 0.1054 Epoch 17 Batch 70/269 - Train Accuracy: 0.9378, Validation Accuracy: 0.9391, Loss: 0.0877 Epoch 17 Batch 71/269 - Train Accuracy: 0.9327, Validation Accuracy: 0.9344, Loss: 0.0936 Epoch 17 Batch 72/269 - Train Accuracy: 0.9287, Validation Accuracy: 0.9354, Loss: 0.0941 Epoch 17 Batch 73/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9362, Loss: 0.0996 Epoch 17 Batch 74/269 - Train Accuracy: 0.9398, Validation Accuracy: 0.9348, Loss: 0.0772 Epoch 17 Batch 75/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9338, Loss: 0.0919 Epoch 17 Batch 76/269 - Train Accuracy: 0.9252, Validation Accuracy: 0.9361, Loss: 0.0878 Epoch 17 Batch 77/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9388, Loss: 0.0880 Epoch 17 Batch 78/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9364, Loss: 0.0903 Epoch 17 Batch 79/269 - Train Accuracy: 0.9186, Validation Accuracy: 0.9342, Loss: 0.0871 Epoch 17 Batch 80/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9350, Loss: 0.0848 Epoch 17 Batch 81/269 - Train Accuracy: 0.9169, Validation Accuracy: 0.9309, Loss: 0.0959 Epoch 17 Batch 82/269 - Train Accuracy: 0.9435, Validation Accuracy: 0.9256, Loss: 0.0737 Epoch 17 Batch 83/269 - Train Accuracy: 0.9153, Validation Accuracy: 0.9304, Loss: 0.1041 Epoch 17 Batch 84/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9352, Loss: 0.0840 Epoch 17 Batch 85/269 - Train Accuracy: 0.9281, Validation Accuracy: 0.9347, Loss: 0.0852 Epoch 17 Batch 86/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9340, Loss: 0.0847 Epoch 17 Batch 87/269 - Train Accuracy: 0.9285, Validation Accuracy: 0.9285, Loss: 0.0852 Epoch 17 Batch 88/269 - Train Accuracy: 0.9182, Validation Accuracy: 0.9324, Loss: 0.0927 Epoch 17 Batch 89/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9305, Loss: 0.0867 Epoch 17 Batch 90/269 - Train Accuracy: 0.9342, Validation Accuracy: 0.9370, Loss: 0.0865 Epoch 17 Batch 91/269 - Train Accuracy: 0.9432, Validation Accuracy: 0.9351, Loss: 0.0812 Epoch 17 Batch 92/269 - Train Accuracy: 0.9448, Validation Accuracy: 0.9353, Loss: 0.0747 Epoch 17 Batch 93/269 - Train Accuracy: 0.9394, Validation Accuracy: 0.9290, Loss: 0.0783 Epoch 17 Batch 94/269 - Train Accuracy: 0.9256, Validation Accuracy: 0.9330, Loss: 0.0974 Epoch 17 Batch 95/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9338, Loss: 0.0863 Epoch 17 Batch 96/269 - Train Accuracy: 0.9233, Validation Accuracy: 0.9355, Loss: 0.0835 Epoch 17 Batch 97/269 - Train Accuracy: 0.9257, Validation Accuracy: 0.9395, Loss: 0.0866 Epoch 17 Batch 98/269 - Train Accuracy: 0.9334, Validation Accuracy: 0.9421, Loss: 0.0838 Epoch 17 Batch 99/269 - Train Accuracy: 0.9305, Validation Accuracy: 0.9453, Loss: 0.0818 Epoch 17 Batch 100/269 - Train Accuracy: 0.9401, Validation Accuracy: 0.9416, Loss: 0.0902 Epoch 17 Batch 101/269 - Train Accuracy: 0.9210, Validation Accuracy: 0.9385, Loss: 0.0969 Epoch 17 Batch 102/269 - Train Accuracy: 0.9335, Validation Accuracy: 0.9370, Loss: 0.0812 Epoch 17 Batch 103/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9297, Loss: 0.0936 Epoch 17 Batch 104/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9371, Loss: 0.0823 Epoch 17 Batch 105/269 - Train Accuracy: 0.9233, Validation Accuracy: 0.9367, Loss: 0.0891 Epoch 17 Batch 106/269 - Train Accuracy: 0.9351, Validation Accuracy: 0.9402, Loss: 0.0780 Epoch 17 Batch 107/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9402, Loss: 0.0807 Epoch 17 Batch 108/269 - Train Accuracy: 0.9419, Validation Accuracy: 0.9388, Loss: 0.0809 Epoch 17 Batch 109/269 - Train Accuracy: 0.9152, Validation Accuracy: 0.9357, Loss: 0.0902 Epoch 17 Batch 110/269 - Train Accuracy: 0.9236, Validation Accuracy: 0.9389, Loss: 0.0793 Epoch 17 Batch 111/269 - Train Accuracy: 0.9257, Validation Accuracy: 0.9403, Loss: 0.0909 Epoch 17 Batch 112/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9392, Loss: 0.0842 Epoch 17 Batch 113/269 - Train Accuracy: 0.9250, Validation Accuracy: 0.9370, Loss: 0.0806 Epoch 17 Batch 114/269 - Train Accuracy: 0.9315, Validation Accuracy: 0.9327, Loss: 0.0833 Epoch 17 Batch 115/269 - Train Accuracy: 0.9283, Validation Accuracy: 0.9292, Loss: 0.0882 Epoch 17 Batch 116/269 - Train Accuracy: 0.9304, Validation Accuracy: 0.9265, Loss: 0.0863 Epoch 17 Batch 117/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9330, Loss: 0.0846 Epoch 17 Batch 118/269 - Train Accuracy: 0.9383, Validation Accuracy: 0.9415, Loss: 0.0770 Epoch 17 Batch 119/269 - Train Accuracy: 0.9136, Validation Accuracy: 0.9349, Loss: 0.0925 Epoch 17 Batch 120/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9373, Loss: 0.0877 Epoch 17 Batch 121/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9363, Loss: 0.0772 Epoch 17 Batch 122/269 - Train Accuracy: 0.9383, Validation Accuracy: 0.9376, Loss: 0.0777 Epoch 17 Batch 123/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9320, Loss: 0.0831 Epoch 17 Batch 124/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9328, Loss: 0.0751 Epoch 17 Batch 125/269 - Train Accuracy: 0.9451, Validation Accuracy: 0.9331, Loss: 0.0763 Epoch 17 Batch 126/269 - Train Accuracy: 0.9203, Validation Accuracy: 0.9332, Loss: 0.0836 Epoch 17 Batch 127/269 - Train Accuracy: 0.9281, Validation Accuracy: 0.9319, Loss: 0.0867 Epoch 17 Batch 128/269 - Train Accuracy: 0.9238, Validation Accuracy: 0.9332, Loss: 0.0852 Epoch 17 Batch 129/269 - Train Accuracy: 0.9182, Validation Accuracy: 0.9332, Loss: 0.0818 Epoch 17 Batch 130/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9316, Loss: 0.0916 Epoch 17 Batch 131/269 - Train Accuracy: 0.9185, Validation Accuracy: 0.9277, Loss: 0.0855 Epoch 17 Batch 132/269 - Train Accuracy: 0.9120, Validation Accuracy: 0.9273, Loss: 0.0904 Epoch 17 Batch 133/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9363, Loss: 0.0743 Epoch 17 Batch 134/269 - Train Accuracy: 0.9230, Validation Accuracy: 0.9410, Loss: 0.0825 Epoch 17 Batch 135/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9400, Loss: 0.0824 Epoch 17 Batch 136/269 - Train Accuracy: 0.9123, Validation Accuracy: 0.9393, Loss: 0.0944 Epoch 17 Batch 137/269 - Train Accuracy: 0.9099, Validation Accuracy: 0.9393, Loss: 0.0968 Epoch 17 Batch 138/269 - Train Accuracy: 0.9287, Validation Accuracy: 0.9371, Loss: 0.0814 Epoch 17 Batch 139/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9321, Loss: 0.0755 Epoch 17 Batch 140/269 - Train Accuracy: 0.9239, Validation Accuracy: 0.9297, Loss: 0.0893 Epoch 17 Batch 141/269 - Train Accuracy: 0.9279, Validation Accuracy: 0.9308, Loss: 0.0908 Epoch 17 Batch 142/269 - Train Accuracy: 0.9308, Validation Accuracy: 0.9304, Loss: 0.0776 Epoch 17 Batch 143/269 - Train Accuracy: 0.9339, Validation Accuracy: 0.9293, Loss: 0.0814 Epoch 17 Batch 144/269 - Train Accuracy: 0.9392, Validation Accuracy: 0.9279, Loss: 0.0715 Epoch 17 Batch 145/269 - Train Accuracy: 0.9287, Validation Accuracy: 0.9338, Loss: 0.0782 Epoch 17 Batch 146/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9406, Loss: 0.0811 Epoch 17 Batch 147/269 - Train Accuracy: 0.9360, Validation Accuracy: 0.9383, Loss: 0.0870 Epoch 17 Batch 148/269 - Train Accuracy: 0.9258, Validation Accuracy: 0.9285, Loss: 0.0822 Epoch 17 Batch 149/269 - Train Accuracy: 0.9156, Validation Accuracy: 0.9253, Loss: 0.0962 Epoch 17 Batch 150/269 - Train Accuracy: 0.9315, Validation Accuracy: 0.9292, Loss: 0.0879 Epoch 17 Batch 151/269 - Train Accuracy: 0.9196, Validation Accuracy: 0.9325, Loss: 0.0878 Epoch 17 Batch 152/269 - Train Accuracy: 0.9329, Validation Accuracy: 0.9311, Loss: 0.0844 Epoch 17 Batch 153/269 - Train Accuracy: 0.9335, Validation Accuracy: 0.9317, Loss: 0.0835 Epoch 17 Batch 154/269 - Train Accuracy: 0.9449, Validation Accuracy: 0.9271, Loss: 0.0847 Epoch 17 Batch 155/269 - Train Accuracy: 0.9208, Validation Accuracy: 0.9294, Loss: 0.0778 Epoch 17 Batch 156/269 - Train Accuracy: 0.9288, Validation Accuracy: 0.9352, Loss: 0.0868 Epoch 17 Batch 157/269 - Train Accuracy: 0.9098, Validation Accuracy: 0.9307, Loss: 0.0805 Epoch 17 Batch 158/269 - Train Accuracy: 0.9303, Validation Accuracy: 0.9291, Loss: 0.0846 Epoch 17 Batch 159/269 - Train Accuracy: 0.9259, Validation Accuracy: 0.9317, Loss: 0.0885 Epoch 17 Batch 160/269 - Train Accuracy: 0.9342, Validation Accuracy: 0.9339, Loss: 0.0851 Epoch 17 Batch 161/269 - Train Accuracy: 0.9387, Validation Accuracy: 0.9347, Loss: 0.0843 Epoch 17 Batch 162/269 - Train Accuracy: 0.9347, Validation Accuracy: 0.9355, Loss: 0.0831 Epoch 17 Batch 163/269 - Train Accuracy: 0.9450, Validation Accuracy: 0.9347, Loss: 0.0862 Epoch 17 Batch 164/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9266, Loss: 0.0846 Epoch 17 Batch 165/269 - Train Accuracy: 0.9342, Validation Accuracy: 0.9321, Loss: 0.0813 Epoch 17 Batch 166/269 - Train Accuracy: 0.9339, Validation Accuracy: 0.9272, Loss: 0.0847 Epoch 17 Batch 167/269 - Train Accuracy: 0.9267, Validation Accuracy: 0.9292, Loss: 0.0818 Epoch 17 Batch 168/269 - Train Accuracy: 0.9301, Validation Accuracy: 0.9284, Loss: 0.0870 Epoch 17 Batch 169/269 - Train Accuracy: 0.9202, Validation Accuracy: 0.9334, Loss: 0.0819 Epoch 17 Batch 170/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9347, Loss: 0.0743 Epoch 17 Batch 171/269 - Train Accuracy: 0.9469, Validation Accuracy: 0.9377, Loss: 0.0836 Epoch 17 Batch 172/269 - Train Accuracy: 0.9243, Validation Accuracy: 0.9384, Loss: 0.0941 Epoch 17 Batch 173/269 - Train Accuracy: 0.9313, Validation Accuracy: 0.9318, Loss: 0.0803 Epoch 17 Batch 174/269 - Train Accuracy: 0.9342, Validation Accuracy: 0.9338, Loss: 0.0847 Epoch 17 Batch 175/269 - Train Accuracy: 0.9174, Validation Accuracy: 0.9380, Loss: 0.0983 Epoch 17 Batch 176/269 - Train Accuracy: 0.9093, Validation Accuracy: 0.9366, Loss: 0.0956 Epoch 17 Batch 177/269 - Train Accuracy: 0.9411, Validation Accuracy: 0.9344, Loss: 0.0771 Epoch 17 Batch 178/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9373, Loss: 0.0830 Epoch 17 Batch 179/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9407, Loss: 0.0833 Epoch 17 Batch 180/269 - Train Accuracy: 0.9349, Validation Accuracy: 0.9419, Loss: 0.0792 Epoch 17 Batch 181/269 - Train Accuracy: 0.9308, Validation Accuracy: 0.9418, Loss: 0.0862 Epoch 17 Batch 182/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9424, Loss: 0.0836 Epoch 17 Batch 183/269 - Train Accuracy: 0.9435, Validation Accuracy: 0.9380, Loss: 0.0711 Epoch 17 Batch 184/269 - Train Accuracy: 0.9306, Validation Accuracy: 0.9382, Loss: 0.0811 Epoch 17 Batch 185/269 - Train Accuracy: 0.9389, Validation Accuracy: 0.9384, Loss: 0.0823 Epoch 17 Batch 186/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9353, Loss: 0.0768 Epoch 17 Batch 187/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9358, Loss: 0.0786 Epoch 17 Batch 188/269 - Train Accuracy: 0.9292, Validation Accuracy: 0.9350, Loss: 0.0803 Epoch 17 Batch 189/269 - Train Accuracy: 0.9363, Validation Accuracy: 0.9399, Loss: 0.0725 Epoch 17 Batch 190/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9342, Loss: 0.0731 Epoch 17 Batch 191/269 - Train Accuracy: 0.9084, Validation Accuracy: 0.9335, Loss: 0.0814 Epoch 17 Batch 192/269 - Train Accuracy: 0.9266, Validation Accuracy: 0.9359, Loss: 0.0809 Epoch 17 Batch 193/269 - Train Accuracy: 0.9262, Validation Accuracy: 0.9377, Loss: 0.0789 Epoch 17 Batch 194/269 - Train Accuracy: 0.9169, Validation Accuracy: 0.9393, Loss: 0.0854 Epoch 17 Batch 195/269 - Train Accuracy: 0.9182, Validation Accuracy: 0.9307, Loss: 0.0804 Epoch 17 Batch 196/269 - Train Accuracy: 0.9222, Validation Accuracy: 0.9316, Loss: 0.0833 Epoch 17 Batch 197/269 - Train Accuracy: 0.9195, Validation Accuracy: 0.9367, Loss: 0.0867 Epoch 17 Batch 198/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9406, Loss: 0.0888 Epoch 17 Batch 199/269 - Train Accuracy: 0.9357, Validation Accuracy: 0.9393, Loss: 0.0875 Epoch 17 Batch 200/269 - Train Accuracy: 0.9297, Validation Accuracy: 0.9359, Loss: 0.0805 Epoch 17 Batch 201/269 - Train Accuracy: 0.9264, Validation Accuracy: 0.9292, Loss: 0.0824 Epoch 17 Batch 202/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9291, Loss: 0.0825 Epoch 17 Batch 203/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9309, Loss: 0.0878 Epoch 17 Batch 204/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9489, Loss: 0.0864 Epoch 17 Batch 205/269 - Train Accuracy: 0.9384, Validation Accuracy: 0.9399, Loss: 0.0827 Epoch 17 Batch 206/269 - Train Accuracy: 0.9230, Validation Accuracy: 0.9393, Loss: 0.0869 Epoch 17 Batch 207/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9439, Loss: 0.0849 Epoch 17 Batch 208/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9347, Loss: 0.0884 Epoch 17 Batch 209/269 - Train Accuracy: 0.9414, Validation Accuracy: 0.9343, Loss: 0.0740 Epoch 17 Batch 210/269 - Train Accuracy: 0.9430, Validation Accuracy: 0.9348, Loss: 0.0759 Epoch 17 Batch 211/269 - Train Accuracy: 0.9283, Validation Accuracy: 0.9385, Loss: 0.0884 Epoch 17 Batch 212/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9382, Loss: 0.0877 Epoch 17 Batch 213/269 - Train Accuracy: 0.9261, Validation Accuracy: 0.9440, Loss: 0.0834 Epoch 17 Batch 214/269 - Train Accuracy: 0.9360, Validation Accuracy: 0.9420, Loss: 0.0813 Epoch 17 Batch 215/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9371, Loss: 0.0823 Epoch 17 Batch 216/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9348, Loss: 0.0940 Epoch 17 Batch 217/269 - Train Accuracy: 0.9146, Validation Accuracy: 0.9325, Loss: 0.0822 Epoch 17 Batch 218/269 - Train Accuracy: 0.9334, Validation Accuracy: 0.9342, Loss: 0.0797 Epoch 17 Batch 219/269 - Train Accuracy: 0.9398, Validation Accuracy: 0.9410, Loss: 0.0837 Epoch 17 Batch 220/269 - Train Accuracy: 0.9383, Validation Accuracy: 0.9372, Loss: 0.0778 Epoch 17 Batch 221/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9394, Loss: 0.0847 Epoch 17 Batch 222/269 - Train Accuracy: 0.9408, Validation Accuracy: 0.9372, Loss: 0.0748 Epoch 17 Batch 223/269 - Train Accuracy: 0.9212, Validation Accuracy: 0.9398, Loss: 0.0783 Epoch 17 Batch 224/269 - Train Accuracy: 0.9325, Validation Accuracy: 0.9402, Loss: 0.0873 Epoch 17 Batch 225/269 - Train Accuracy: 0.9250, Validation Accuracy: 0.9421, Loss: 0.0748 Epoch 17 Batch 226/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9375, Loss: 0.0839 Epoch 17 Batch 227/269 - Train Accuracy: 0.9412, Validation Accuracy: 0.9379, Loss: 0.0919 Epoch 17 Batch 228/269 - Train Accuracy: 0.9373, Validation Accuracy: 0.9311, Loss: 0.0800 Epoch 17 Batch 229/269 - Train Accuracy: 0.9246, Validation Accuracy: 0.9343, Loss: 0.0817 Epoch 17 Batch 230/269 - Train Accuracy: 0.9335, Validation Accuracy: 0.9303, Loss: 0.0823 Epoch 17 Batch 231/269 - Train Accuracy: 0.9295, Validation Accuracy: 0.9354, Loss: 0.0838 Epoch 17 Batch 232/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9364, Loss: 0.0829 Epoch 17 Batch 233/269 - Train Accuracy: 0.9376, Validation Accuracy: 0.9341, Loss: 0.0813 Epoch 17 Batch 234/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9340, Loss: 0.0817 Epoch 17 Batch 235/269 - Train Accuracy: 0.9573, Validation Accuracy: 0.9427, Loss: 0.0700 Epoch 17 Batch 236/269 - Train Accuracy: 0.9327, Validation Accuracy: 0.9390, Loss: 0.0735 Epoch 17 Batch 237/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9432, Loss: 0.0737 Epoch 17 Batch 238/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9411, Loss: 0.0798 Epoch 17 Batch 239/269 - Train Accuracy: 0.9304, Validation Accuracy: 0.9403, Loss: 0.0762 Epoch 17 Batch 240/269 - Train Accuracy: 0.9357, Validation Accuracy: 0.9391, Loss: 0.0731 Epoch 17 Batch 241/269 - Train Accuracy: 0.9272, Validation Accuracy: 0.9383, Loss: 0.0910 Epoch 17 Batch 242/269 - Train Accuracy: 0.9466, Validation Accuracy: 0.9363, Loss: 0.0760 Epoch 17 Batch 243/269 - Train Accuracy: 0.9370, Validation Accuracy: 0.9355, Loss: 0.0727 Epoch 17 Batch 244/269 - Train Accuracy: 0.9263, Validation Accuracy: 0.9351, Loss: 0.0778 Epoch 17 Batch 245/269 - Train Accuracy: 0.9211, Validation Accuracy: 0.9403, Loss: 0.0811 Epoch 17 Batch 246/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9410, Loss: 0.0840 Epoch 17 Batch 247/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9435, Loss: 0.0782 Epoch 17 Batch 248/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9457, Loss: 0.0789 Epoch 17 Batch 249/269 - Train Accuracy: 0.9340, Validation Accuracy: 0.9411, Loss: 0.0713 Epoch 17 Batch 250/269 - Train Accuracy: 0.9378, Validation Accuracy: 0.9448, Loss: 0.0793 Epoch 17 Batch 251/269 - Train Accuracy: 0.9479, Validation Accuracy: 0.9434, Loss: 0.0722 Epoch 17 Batch 252/269 - Train Accuracy: 0.9366, Validation Accuracy: 0.9474, Loss: 0.0722 Epoch 17 Batch 253/269 - Train Accuracy: 0.9153, Validation Accuracy: 0.9423, Loss: 0.0846 Epoch 17 Batch 254/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9355, Loss: 0.0778 Epoch 17 Batch 255/269 - Train Accuracy: 0.9347, Validation Accuracy: 0.9354, Loss: 0.0805 Epoch 17 Batch 256/269 - Train Accuracy: 0.9369, Validation Accuracy: 0.9393, Loss: 0.0859 Epoch 17 Batch 257/269 - Train Accuracy: 0.9120, Validation Accuracy: 0.9392, Loss: 0.0881 Epoch 17 Batch 258/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9341, Loss: 0.0845 Epoch 17 Batch 259/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9376, Loss: 0.0786 Epoch 17 Batch 260/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9395, Loss: 0.0886 Epoch 17 Batch 261/269 - Train Accuracy: 0.9305, Validation Accuracy: 0.9432, Loss: 0.0831 Epoch 17 Batch 262/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9422, Loss: 0.0848 Epoch 17 Batch 263/269 - Train Accuracy: 0.9299, Validation Accuracy: 0.9372, Loss: 0.0825 Epoch 17 Batch 264/269 - Train Accuracy: 0.9147, Validation Accuracy: 0.9386, Loss: 0.0901 Epoch 17 Batch 265/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9364, Loss: 0.0839 Epoch 17 Batch 266/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9370, Loss: 0.0772 Epoch 17 Batch 267/269 - Train Accuracy: 0.9390, Validation Accuracy: 0.9412, Loss: 0.0870 Epoch 18 Batch 1/269 - Train Accuracy: 0.9236, Validation Accuracy: 0.9393, Loss: 0.0789 Epoch 18 Batch 2/269 - Train Accuracy: 0.9389, Validation Accuracy: 0.9407, Loss: 0.0835 Epoch 18 Batch 3/269 - Train Accuracy: 0.9412, Validation Accuracy: 0.9404, Loss: 0.0833 Epoch 18 Batch 4/269 - Train Accuracy: 0.9169, Validation Accuracy: 0.9385, Loss: 0.0812 Epoch 18 Batch 5/269 - Train Accuracy: 0.9387, Validation Accuracy: 0.9381, Loss: 0.0826 Epoch 18 Batch 6/269 - Train Accuracy: 0.9484, Validation Accuracy: 0.9384, Loss: 0.0796 Epoch 18 Batch 7/269 - Train Accuracy: 0.9431, Validation Accuracy: 0.9348, Loss: 0.0765 Epoch 18 Batch 8/269 - Train Accuracy: 0.9461, Validation Accuracy: 0.9313, Loss: 0.0819 Epoch 18 Batch 9/269 - Train Accuracy: 0.9278, Validation Accuracy: 0.9376, Loss: 0.0849 Epoch 18 Batch 10/269 - Train Accuracy: 0.9426, Validation Accuracy: 0.9279, Loss: 0.0750 Epoch 18 Batch 11/269 - Train Accuracy: 0.9323, Validation Accuracy: 0.9290, Loss: 0.0846 Epoch 18 Batch 12/269 - Train Accuracy: 0.9245, Validation Accuracy: 0.9284, Loss: 0.0853 Epoch 18 Batch 13/269 - Train Accuracy: 0.9447, Validation Accuracy: 0.9420, Loss: 0.0722 Epoch 18 Batch 14/269 - Train Accuracy: 0.9222, Validation Accuracy: 0.9488, Loss: 0.0827 Epoch 18 Batch 15/269 - Train Accuracy: 0.9481, Validation Accuracy: 0.9458, Loss: 0.0658 Epoch 18 Batch 16/269 - Train Accuracy: 0.9242, Validation Accuracy: 0.9411, Loss: 0.0889 Epoch 18 Batch 17/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9317, Loss: 0.0801 Epoch 18 Batch 18/269 - Train Accuracy: 0.9276, Validation Accuracy: 0.9319, Loss: 0.0835 Epoch 18 Batch 19/269 - Train Accuracy: 0.9403, Validation Accuracy: 0.9367, Loss: 0.0696 Epoch 18 Batch 20/269 - Train Accuracy: 0.9366, Validation Accuracy: 0.9391, Loss: 0.0796 Epoch 18 Batch 21/269 - Train Accuracy: 0.9164, Validation Accuracy: 0.9406, Loss: 0.0959 Epoch 18 Batch 22/269 - Train Accuracy: 0.9450, Validation Accuracy: 0.9401, Loss: 0.0767 Epoch 18 Batch 23/269 - Train Accuracy: 0.9303, Validation Accuracy: 0.9396, Loss: 0.0833 Epoch 18 Batch 24/269 - Train Accuracy: 0.9261, Validation Accuracy: 0.9347, Loss: 0.0775 Epoch 18 Batch 25/269 - Train Accuracy: 0.9228, Validation Accuracy: 0.9341, Loss: 0.0883 Epoch 18 Batch 26/269 - Train Accuracy: 0.9302, Validation Accuracy: 0.9389, Loss: 0.0765 Epoch 18 Batch 27/269 - Train Accuracy: 0.9180, Validation Accuracy: 0.9371, Loss: 0.0759 Epoch 18 Batch 28/269 - Train Accuracy: 0.9182, Validation Accuracy: 0.9356, Loss: 0.0843 Epoch 18 Batch 29/269 - Train Accuracy: 0.9396, Validation Accuracy: 0.9387, Loss: 0.0863 Epoch 18 Batch 30/269 - Train Accuracy: 0.9266, Validation Accuracy: 0.9310, Loss: 0.0829 Epoch 18 Batch 31/269 - Train Accuracy: 0.9439, Validation Accuracy: 0.9342, Loss: 0.0840 Epoch 18 Batch 32/269 - Train Accuracy: 0.9459, Validation Accuracy: 0.9372, Loss: 0.0751 Epoch 18 Batch 33/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9397, Loss: 0.0724 Epoch 18 Batch 34/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9349, Loss: 0.0771 Epoch 18 Batch 35/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9416, Loss: 0.0929 Epoch 18 Batch 36/269 - Train Accuracy: 0.9199, Validation Accuracy: 0.9375, Loss: 0.0823 Epoch 18 Batch 37/269 - Train Accuracy: 0.9384, Validation Accuracy: 0.9355, Loss: 0.0827 Epoch 18 Batch 38/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9415, Loss: 0.0759 Epoch 18 Batch 39/269 - Train Accuracy: 0.9444, Validation Accuracy: 0.9448, Loss: 0.0759 Epoch 18 Batch 40/269 - Train Accuracy: 0.9222, Validation Accuracy: 0.9442, Loss: 0.0907 Epoch 18 Batch 41/269 - Train Accuracy: 0.9232, Validation Accuracy: 0.9412, Loss: 0.0838 Epoch 18 Batch 42/269 - Train Accuracy: 0.9442, Validation Accuracy: 0.9395, Loss: 0.0778 Epoch 18 Batch 43/269 - Train Accuracy: 0.9363, Validation Accuracy: 0.9394, Loss: 0.0836 Epoch 18 Batch 44/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9392, Loss: 0.0817 Epoch 18 Batch 45/269 - Train Accuracy: 0.9271, Validation Accuracy: 0.9402, Loss: 0.0842 Epoch 18 Batch 46/269 - Train Accuracy: 0.9418, Validation Accuracy: 0.9426, Loss: 0.0738 Epoch 18 Batch 47/269 - Train Accuracy: 0.9433, Validation Accuracy: 0.9460, Loss: 0.0692 Epoch 18 Batch 48/269 - Train Accuracy: 0.9423, Validation Accuracy: 0.9426, Loss: 0.0770 Epoch 18 Batch 49/269 - Train Accuracy: 0.9440, Validation Accuracy: 0.9392, Loss: 0.0736 Epoch 18 Batch 50/269 - Train Accuracy: 0.9213, Validation Accuracy: 0.9361, Loss: 0.0879 Epoch 18 Batch 51/269 - Train Accuracy: 0.9365, Validation Accuracy: 0.9370, Loss: 0.0781 Epoch 18 Batch 52/269 - Train Accuracy: 0.9254, Validation Accuracy: 0.9360, Loss: 0.0672 Epoch 18 Batch 53/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9371, Loss: 0.0840 Epoch 18 Batch 54/269 - Train Accuracy: 0.9386, Validation Accuracy: 0.9332, Loss: 0.0775 Epoch 18 Batch 55/269 - Train Accuracy: 0.9461, Validation Accuracy: 0.9363, Loss: 0.0762 Epoch 18 Batch 56/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9341, Loss: 0.0803 Epoch 18 Batch 57/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9367, Loss: 0.0850 Epoch 18 Batch 58/269 - Train Accuracy: 0.9465, Validation Accuracy: 0.9393, Loss: 0.0805 Epoch 18 Batch 59/269 - Train Accuracy: 0.9552, Validation Accuracy: 0.9409, Loss: 0.0633 Epoch 18 Batch 60/269 - Train Accuracy: 0.9363, Validation Accuracy: 0.9395, Loss: 0.0721 Epoch 18 Batch 61/269 - Train Accuracy: 0.9334, Validation Accuracy: 0.9440, Loss: 0.0693 Epoch 18 Batch 62/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9425, Loss: 0.0783 Epoch 18 Batch 63/269 - Train Accuracy: 0.9342, Validation Accuracy: 0.9418, Loss: 0.0895 Epoch 18 Batch 64/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9406, Loss: 0.0717 Epoch 18 Batch 65/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9363, Loss: 0.0779 Epoch 18 Batch 66/269 - Train Accuracy: 0.9255, Validation Accuracy: 0.9420, Loss: 0.0807 Epoch 18 Batch 67/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9424, Loss: 0.0857 Epoch 18 Batch 68/269 - Train Accuracy: 0.9180, Validation Accuracy: 0.9355, Loss: 0.0824 Epoch 18 Batch 69/269 - Train Accuracy: 0.9193, Validation Accuracy: 0.9321, Loss: 0.0911 Epoch 18 Batch 70/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9333, Loss: 0.0873 Epoch 18 Batch 71/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9388, Loss: 0.0920 Epoch 18 Batch 72/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9465, Loss: 0.0870 Epoch 18 Batch 73/269 - Train Accuracy: 0.9328, Validation Accuracy: 0.9458, Loss: 0.0848 Epoch 18 Batch 74/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9358, Loss: 0.0752 Epoch 18 Batch 75/269 - Train Accuracy: 0.9330, Validation Accuracy: 0.9325, Loss: 0.0827 Epoch 18 Batch 76/269 - Train Accuracy: 0.9278, Validation Accuracy: 0.9353, Loss: 0.0805 Epoch 18 Batch 77/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9371, Loss: 0.0794 Epoch 18 Batch 78/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9473, Loss: 0.0739 Epoch 18 Batch 79/269 - Train Accuracy: 0.9279, Validation Accuracy: 0.9441, Loss: 0.0755 Epoch 18 Batch 80/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9432, Loss: 0.0766 Epoch 18 Batch 81/269 - Train Accuracy: 0.9320, Validation Accuracy: 0.9415, Loss: 0.0917 Epoch 18 Batch 82/269 - Train Accuracy: 0.9489, Validation Accuracy: 0.9386, Loss: 0.0666 Epoch 18 Batch 83/269 - Train Accuracy: 0.9140, Validation Accuracy: 0.9387, Loss: 0.0911 Epoch 18 Batch 84/269 - Train Accuracy: 0.9447, Validation Accuracy: 0.9368, Loss: 0.0772 Epoch 18 Batch 85/269 - Train Accuracy: 0.9402, Validation Accuracy: 0.9400, Loss: 0.0743 Epoch 18 Batch 86/269 - Train Accuracy: 0.9374, Validation Accuracy: 0.9370, Loss: 0.0724 Epoch 18 Batch 87/269 - Train Accuracy: 0.9241, Validation Accuracy: 0.9394, Loss: 0.0832 Epoch 18 Batch 88/269 - Train Accuracy: 0.9207, Validation Accuracy: 0.9324, Loss: 0.0835 Epoch 18 Batch 89/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9387, Loss: 0.0774 Epoch 18 Batch 90/269 - Train Accuracy: 0.9450, Validation Accuracy: 0.9413, Loss: 0.0800 Epoch 18 Batch 91/269 - Train Accuracy: 0.9462, Validation Accuracy: 0.9422, Loss: 0.0760 Epoch 18 Batch 92/269 - Train Accuracy: 0.9413, Validation Accuracy: 0.9384, Loss: 0.0712 Epoch 18 Batch 93/269 - Train Accuracy: 0.9393, Validation Accuracy: 0.9353, Loss: 0.0727 Epoch 18 Batch 94/269 - Train Accuracy: 0.9379, Validation Accuracy: 0.9356, Loss: 0.0911 Epoch 18 Batch 95/269 - Train Accuracy: 0.9409, Validation Accuracy: 0.9321, Loss: 0.0775 Epoch 18 Batch 96/269 - Train Accuracy: 0.9210, Validation Accuracy: 0.9375, Loss: 0.0802 Epoch 18 Batch 97/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9390, Loss: 0.0842 Epoch 18 Batch 98/269 - Train Accuracy: 0.9432, Validation Accuracy: 0.9361, Loss: 0.0765 Epoch 18 Batch 99/269 - Train Accuracy: 0.9367, Validation Accuracy: 0.9427, Loss: 0.0756 Epoch 18 Batch 100/269 - Train Accuracy: 0.9409, Validation Accuracy: 0.9420, Loss: 0.0779 Epoch 18 Batch 101/269 - Train Accuracy: 0.9319, Validation Accuracy: 0.9422, Loss: 0.0897 Epoch 18 Batch 102/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9392, Loss: 0.0741 Epoch 18 Batch 103/269 - Train Accuracy: 0.9404, Validation Accuracy: 0.9331, Loss: 0.0862 Epoch 18 Batch 104/269 - Train Accuracy: 0.9346, Validation Accuracy: 0.9378, Loss: 0.0794 Epoch 18 Batch 105/269 - Train Accuracy: 0.9315, Validation Accuracy: 0.9441, Loss: 0.0775 Epoch 18 Batch 106/269 - Train Accuracy: 0.9441, Validation Accuracy: 0.9497, Loss: 0.0761 Epoch 18 Batch 107/269 - Train Accuracy: 0.9425, Validation Accuracy: 0.9501, Loss: 0.0764 Epoch 18 Batch 108/269 - Train Accuracy: 0.9509, Validation Accuracy: 0.9463, Loss: 0.0777 Epoch 18 Batch 109/269 - Train Accuracy: 0.9203, Validation Accuracy: 0.9450, Loss: 0.0803 Epoch 18 Batch 110/269 - Train Accuracy: 0.9337, Validation Accuracy: 0.9477, Loss: 0.0700 Epoch 18 Batch 111/269 - Train Accuracy: 0.9279, Validation Accuracy: 0.9421, Loss: 0.0882 Epoch 18 Batch 112/269 - Train Accuracy: 0.9330, Validation Accuracy: 0.9409, Loss: 0.0778 Epoch 18 Batch 113/269 - Train Accuracy: 0.9348, Validation Accuracy: 0.9421, Loss: 0.0782 Epoch 18 Batch 114/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9412, Loss: 0.0743 Epoch 18 Batch 115/269 - Train Accuracy: 0.9343, Validation Accuracy: 0.9365, Loss: 0.0798 Epoch 18 Batch 116/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9287, Loss: 0.0776 Epoch 18 Batch 117/269 - Train Accuracy: 0.9353, Validation Accuracy: 0.9282, Loss: 0.0754 Epoch 18 Batch 118/269 - Train Accuracy: 0.9426, Validation Accuracy: 0.9357, Loss: 0.0738 Epoch 18 Batch 119/269 - Train Accuracy: 0.9215, Validation Accuracy: 0.9436, Loss: 0.0906 Epoch 18 Batch 120/269 - Train Accuracy: 0.9303, Validation Accuracy: 0.9444, Loss: 0.0765 Epoch 18 Batch 121/269 - Train Accuracy: 0.9190, Validation Accuracy: 0.9442, Loss: 0.0787 Epoch 18 Batch 122/269 - Train Accuracy: 0.9472, Validation Accuracy: 0.9331, Loss: 0.0777 Epoch 18 Batch 123/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9290, Loss: 0.0753 Epoch 18 Batch 124/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9443, Loss: 0.0736 Epoch 18 Batch 125/269 - Train Accuracy: 0.9435, Validation Accuracy: 0.9437, Loss: 0.0706 Epoch 18 Batch 126/269 - Train Accuracy: 0.9205, Validation Accuracy: 0.9466, Loss: 0.0811 Epoch 18 Batch 127/269 - Train Accuracy: 0.9400, Validation Accuracy: 0.9443, Loss: 0.0792 Epoch 18 Batch 128/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9445, Loss: 0.0808 Epoch 18 Batch 129/269 - Train Accuracy: 0.9181, Validation Accuracy: 0.9359, Loss: 0.0819 Epoch 18 Batch 130/269 - Train Accuracy: 0.9471, Validation Accuracy: 0.9339, Loss: 0.0817 Epoch 18 Batch 131/269 - Train Accuracy: 0.9284, Validation Accuracy: 0.9395, Loss: 0.0831 Epoch 18 Batch 132/269 - Train Accuracy: 0.9228, Validation Accuracy: 0.9448, Loss: 0.0804 Epoch 18 Batch 133/269 - Train Accuracy: 0.9413, Validation Accuracy: 0.9468, Loss: 0.0696 Epoch 18 Batch 134/269 - Train Accuracy: 0.9214, Validation Accuracy: 0.9454, Loss: 0.0854 Epoch 18 Batch 135/269 - Train Accuracy: 0.9444, Validation Accuracy: 0.9432, Loss: 0.0815 Epoch 18 Batch 136/269 - Train Accuracy: 0.9103, Validation Accuracy: 0.9406, Loss: 0.0823 Epoch 18 Batch 137/269 - Train Accuracy: 0.9227, Validation Accuracy: 0.9439, Loss: 0.0879 Epoch 18 Batch 138/269 - Train Accuracy: 0.9378, Validation Accuracy: 0.9461, Loss: 0.0735 Epoch 18 Batch 139/269 - Train Accuracy: 0.9488, Validation Accuracy: 0.9421, Loss: 0.0737 Epoch 18 Batch 140/269 - Train Accuracy: 0.9304, Validation Accuracy: 0.9411, Loss: 0.0880 Epoch 18 Batch 141/269 - Train Accuracy: 0.9268, Validation Accuracy: 0.9375, Loss: 0.0833 Epoch 18 Batch 142/269 - Train Accuracy: 0.9261, Validation Accuracy: 0.9324, Loss: 0.0739 Epoch 18 Batch 143/269 - Train Accuracy: 0.9359, Validation Accuracy: 0.9313, Loss: 0.0709 Epoch 18 Batch 144/269 - Train Accuracy: 0.9417, Validation Accuracy: 0.9299, Loss: 0.0637 Epoch 18 Batch 145/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9361, Loss: 0.0755 Epoch 18 Batch 146/269 - Train Accuracy: 0.9411, Validation Accuracy: 0.9390, Loss: 0.0718 Epoch 18 Batch 147/269 - Train Accuracy: 0.9353, Validation Accuracy: 0.9397, Loss: 0.0856 Epoch 18 Batch 148/269 - Train Accuracy: 0.9317, Validation Accuracy: 0.9416, Loss: 0.0816 Epoch 18 Batch 149/269 - Train Accuracy: 0.9169, Validation Accuracy: 0.9434, Loss: 0.0925 Epoch 18 Batch 150/269 - Train Accuracy: 0.9406, Validation Accuracy: 0.9445, Loss: 0.0789 Epoch 18 Batch 151/269 - Train Accuracy: 0.9345, Validation Accuracy: 0.9458, Loss: 0.0768 Epoch 18 Batch 152/269 - Train Accuracy: 0.9352, Validation Accuracy: 0.9440, Loss: 0.0764 Epoch 18 Batch 153/269 - Train Accuracy: 0.9389, Validation Accuracy: 0.9464, Loss: 0.0708 Epoch 18 Batch 154/269 - Train Accuracy: 0.9488, Validation Accuracy: 0.9401, Loss: 0.0759 Epoch 18 Batch 155/269 - Train Accuracy: 0.9382, Validation Accuracy: 0.9403, Loss: 0.0773 Epoch 18 Batch 156/269 - Train Accuracy: 0.9352, Validation Accuracy: 0.9367, Loss: 0.0851 Epoch 18 Batch 157/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9370, Loss: 0.0729 Epoch 18 Batch 158/269 - Train Accuracy: 0.9264, Validation Accuracy: 0.9347, Loss: 0.0793 Epoch 18 Batch 159/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9441, Loss: 0.0828 Epoch 18 Batch 160/269 - Train Accuracy: 0.9230, Validation Accuracy: 0.9446, Loss: 0.0706 Epoch 18 Batch 161/269 - Train Accuracy: 0.9319, Validation Accuracy: 0.9457, Loss: 0.0769 Epoch 18 Batch 162/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9454, Loss: 0.0768 Epoch 18 Batch 163/269 - Train Accuracy: 0.9412, Validation Accuracy: 0.9399, Loss: 0.0813 Epoch 18 Batch 164/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9327, Loss: 0.0774 Epoch 18 Batch 165/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9360, Loss: 0.0743 Epoch 18 Batch 166/269 - Train Accuracy: 0.9400, Validation Accuracy: 0.9433, Loss: 0.0757 Epoch 18 Batch 167/269 - Train Accuracy: 0.9359, Validation Accuracy: 0.9400, Loss: 0.0766 Epoch 18 Batch 168/269 - Train Accuracy: 0.9364, Validation Accuracy: 0.9392, Loss: 0.0765 Epoch 18 Batch 169/269 - Train Accuracy: 0.9183, Validation Accuracy: 0.9404, Loss: 0.0752 Epoch 18 Batch 170/269 - Train Accuracy: 0.9231, Validation Accuracy: 0.9408, Loss: 0.0776 Epoch 18 Batch 171/269 - Train Accuracy: 0.9490, Validation Accuracy: 0.9428, Loss: 0.0821 Epoch 18 Batch 172/269 - Train Accuracy: 0.9236, Validation Accuracy: 0.9434, Loss: 0.0859 Epoch 18 Batch 173/269 - Train Accuracy: 0.9384, Validation Accuracy: 0.9404, Loss: 0.0683 Epoch 18 Batch 174/269 - Train Accuracy: 0.9478, Validation Accuracy: 0.9390, Loss: 0.0781 Epoch 18 Batch 175/269 - Train Accuracy: 0.9199, Validation Accuracy: 0.9376, Loss: 0.0902 Epoch 18 Batch 176/269 - Train Accuracy: 0.9116, Validation Accuracy: 0.9418, Loss: 0.0822 Epoch 18 Batch 177/269 - Train Accuracy: 0.9404, Validation Accuracy: 0.9378, Loss: 0.0790 Epoch 18 Batch 178/269 - Train Accuracy: 0.9377, Validation Accuracy: 0.9426, Loss: 0.0715 Epoch 18 Batch 179/269 - Train Accuracy: 0.9223, Validation Accuracy: 0.9430, Loss: 0.0760 Epoch 18 Batch 180/269 - Train Accuracy: 0.9467, Validation Accuracy: 0.9383, Loss: 0.0766 Epoch 18 Batch 181/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9456, Loss: 0.0776 Epoch 18 Batch 182/269 - Train Accuracy: 0.9269, Validation Accuracy: 0.9431, Loss: 0.0778 Epoch 18 Batch 183/269 - Train Accuracy: 0.9452, Validation Accuracy: 0.9368, Loss: 0.0664 Epoch 18 Batch 184/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9331, Loss: 0.0765 Epoch 18 Batch 185/269 - Train Accuracy: 0.9374, Validation Accuracy: 0.9370, Loss: 0.0794 Epoch 18 Batch 186/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9371, Loss: 0.0730 Epoch 18 Batch 187/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9326, Loss: 0.0748 Epoch 18 Batch 188/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9362, Loss: 0.0773 Epoch 18 Batch 189/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9381, Loss: 0.0736 Epoch 18 Batch 190/269 - Train Accuracy: 0.9323, Validation Accuracy: 0.9327, Loss: 0.0715 Epoch 18 Batch 191/269 - Train Accuracy: 0.9225, Validation Accuracy: 0.9332, Loss: 0.0739 Epoch 18 Batch 192/269 - Train Accuracy: 0.9356, Validation Accuracy: 0.9413, Loss: 0.0770 Epoch 18 Batch 193/269 - Train Accuracy: 0.9365, Validation Accuracy: 0.9442, Loss: 0.0742 Epoch 18 Batch 194/269 - Train Accuracy: 0.9228, Validation Accuracy: 0.9388, Loss: 0.0805 Epoch 18 Batch 195/269 - Train Accuracy: 0.9295, Validation Accuracy: 0.9351, Loss: 0.0733 Epoch 18 Batch 196/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9354, Loss: 0.0748 Epoch 18 Batch 197/269 - Train Accuracy: 0.9254, Validation Accuracy: 0.9394, Loss: 0.0817 Epoch 18 Batch 198/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9400, Loss: 0.0833 Epoch 18 Batch 199/269 - Train Accuracy: 0.9438, Validation Accuracy: 0.9355, Loss: 0.0775 Epoch 18 Batch 200/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9276, Loss: 0.0726 Epoch 18 Batch 201/269 - Train Accuracy: 0.9407, Validation Accuracy: 0.9315, Loss: 0.0781 Epoch 18 Batch 202/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9399, Loss: 0.0778 Epoch 18 Batch 203/269 - Train Accuracy: 0.9272, Validation Accuracy: 0.9412, Loss: 0.0839 Epoch 18 Batch 204/269 - Train Accuracy: 0.9388, Validation Accuracy: 0.9415, Loss: 0.0757 Epoch 18 Batch 205/269 - Train Accuracy: 0.9394, Validation Accuracy: 0.9446, Loss: 0.0743 Epoch 18 Batch 206/269 - Train Accuracy: 0.9191, Validation Accuracy: 0.9447, Loss: 0.0854 Epoch 18 Batch 207/269 - Train Accuracy: 0.9255, Validation Accuracy: 0.9421, Loss: 0.0797 Epoch 18 Batch 208/269 - Train Accuracy: 0.9313, Validation Accuracy: 0.9442, Loss: 0.0826 Epoch 18 Batch 209/269 - Train Accuracy: 0.9459, Validation Accuracy: 0.9431, Loss: 0.0710 Epoch 18 Batch 210/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9431, Loss: 0.0743 Epoch 18 Batch 211/269 - Train Accuracy: 0.9290, Validation Accuracy: 0.9418, Loss: 0.0817 Epoch 18 Batch 212/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9416, Loss: 0.0807 Epoch 18 Batch 213/269 - Train Accuracy: 0.9354, Validation Accuracy: 0.9433, Loss: 0.0745 Epoch 18 Batch 214/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9459, Loss: 0.0764 Epoch 18 Batch 215/269 - Train Accuracy: 0.9341, Validation Accuracy: 0.9438, Loss: 0.0765 Epoch 18 Batch 216/269 - Train Accuracy: 0.9358, Validation Accuracy: 0.9431, Loss: 0.0869 Epoch 18 Batch 217/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9379, Loss: 0.0856 Epoch 18 Batch 218/269 - Train Accuracy: 0.9306, Validation Accuracy: 0.9385, Loss: 0.0738 Epoch 18 Batch 219/269 - Train Accuracy: 0.9405, Validation Accuracy: 0.9374, Loss: 0.0785 Epoch 18 Batch 220/269 - Train Accuracy: 0.9377, Validation Accuracy: 0.9374, Loss: 0.0730 Epoch 18 Batch 221/269 - Train Accuracy: 0.9321, Validation Accuracy: 0.9343, Loss: 0.0790 Epoch 18 Batch 222/269 - Train Accuracy: 0.9466, Validation Accuracy: 0.9351, Loss: 0.0702 Epoch 18 Batch 223/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9401, Loss: 0.0760 Epoch 18 Batch 224/269 - Train Accuracy: 0.9337, Validation Accuracy: 0.9408, Loss: 0.0861 Epoch 18 Batch 225/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9406, Loss: 0.0745 Epoch 18 Batch 226/269 - Train Accuracy: 0.9384, Validation Accuracy: 0.9449, Loss: 0.0794 Epoch 18 Batch 227/269 - Train Accuracy: 0.9419, Validation Accuracy: 0.9387, Loss: 0.0917 Epoch 18 Batch 228/269 - Train Accuracy: 0.9357, Validation Accuracy: 0.9372, Loss: 0.0700 Epoch 18 Batch 229/269 - Train Accuracy: 0.9299, Validation Accuracy: 0.9405, Loss: 0.0736 Epoch 18 Batch 230/269 - Train Accuracy: 0.9369, Validation Accuracy: 0.9453, Loss: 0.0747 Epoch 18 Batch 231/269 - Train Accuracy: 0.9282, Validation Accuracy: 0.9453, Loss: 0.0764 Epoch 18 Batch 232/269 - Train Accuracy: 0.9368, Validation Accuracy: 0.9506, Loss: 0.0818 Epoch 18 Batch 233/269 - Train Accuracy: 0.9461, Validation Accuracy: 0.9507, Loss: 0.0777 Epoch 18 Batch 234/269 - Train Accuracy: 0.9410, Validation Accuracy: 0.9448, Loss: 0.0738 Epoch 18 Batch 235/269 - Train Accuracy: 0.9631, Validation Accuracy: 0.9464, Loss: 0.0671 Epoch 18 Batch 236/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9479, Loss: 0.0726 Epoch 18 Batch 237/269 - Train Accuracy: 0.9374, Validation Accuracy: 0.9444, Loss: 0.0730 Epoch 18 Batch 238/269 - Train Accuracy: 0.9389, Validation Accuracy: 0.9450, Loss: 0.0741 Epoch 18 Batch 239/269 - Train Accuracy: 0.9256, Validation Accuracy: 0.9371, Loss: 0.0796 Epoch 18 Batch 240/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9372, Loss: 0.0755 Epoch 18 Batch 241/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9355, Loss: 0.0877 Epoch 18 Batch 242/269 - Train Accuracy: 0.9488, Validation Accuracy: 0.9379, Loss: 0.0713 Epoch 18 Batch 243/269 - Train Accuracy: 0.9375, Validation Accuracy: 0.9425, Loss: 0.0693 Epoch 18 Batch 244/269 - Train Accuracy: 0.9281, Validation Accuracy: 0.9446, Loss: 0.0766 Epoch 18 Batch 245/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9447, Loss: 0.0784 Epoch 18 Batch 246/269 - Train Accuracy: 0.9264, Validation Accuracy: 0.9403, Loss: 0.0805 Epoch 18 Batch 247/269 - Train Accuracy: 0.9417, Validation Accuracy: 0.9421, Loss: 0.0750 Epoch 18 Batch 248/269 - Train Accuracy: 0.9379, Validation Accuracy: 0.9390, Loss: 0.0699 Epoch 18 Batch 249/269 - Train Accuracy: 0.9325, Validation Accuracy: 0.9398, Loss: 0.0670 Epoch 18 Batch 250/269 - Train Accuracy: 0.9496, Validation Accuracy: 0.9486, Loss: 0.0741 Epoch 18 Batch 251/269 - Train Accuracy: 0.9571, Validation Accuracy: 0.9439, Loss: 0.0679 Epoch 18 Batch 252/269 - Train Accuracy: 0.9439, Validation Accuracy: 0.9427, Loss: 0.0673 Epoch 18 Batch 253/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9424, Loss: 0.0796 Epoch 18 Batch 254/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9474, Loss: 0.0722 Epoch 18 Batch 255/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9403, Loss: 0.0766 Epoch 18 Batch 256/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9434, Loss: 0.0774 Epoch 18 Batch 257/269 - Train Accuracy: 0.9167, Validation Accuracy: 0.9427, Loss: 0.0826 Epoch 18 Batch 258/269 - Train Accuracy: 0.9308, Validation Accuracy: 0.9433, Loss: 0.0819 Epoch 18 Batch 259/269 - Train Accuracy: 0.9408, Validation Accuracy: 0.9429, Loss: 0.0729 Epoch 18 Batch 260/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9420, Loss: 0.0803 Epoch 18 Batch 261/269 - Train Accuracy: 0.9434, Validation Accuracy: 0.9407, Loss: 0.0808 Epoch 18 Batch 262/269 - Train Accuracy: 0.9398, Validation Accuracy: 0.9399, Loss: 0.0813 Epoch 18 Batch 263/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9391, Loss: 0.0791 Epoch 18 Batch 264/269 - Train Accuracy: 0.9106, Validation Accuracy: 0.9451, Loss: 0.0817 Epoch 18 Batch 265/269 - Train Accuracy: 0.9323, Validation Accuracy: 0.9446, Loss: 0.0743 Epoch 18 Batch 266/269 - Train Accuracy: 0.9335, Validation Accuracy: 0.9455, Loss: 0.0677 Epoch 18 Batch 267/269 - Train Accuracy: 0.9437, Validation Accuracy: 0.9417, Loss: 0.0811 Epoch 19 Batch 1/269 - Train Accuracy: 0.9278, Validation Accuracy: 0.9441, Loss: 0.0754 Epoch 19 Batch 2/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9463, Loss: 0.0767 Epoch 19 Batch 3/269 - Train Accuracy: 0.9441, Validation Accuracy: 0.9457, Loss: 0.0761 Epoch 19 Batch 4/269 - Train Accuracy: 0.9172, Validation Accuracy: 0.9424, Loss: 0.0757 Epoch 19 Batch 5/269 - Train Accuracy: 0.9327, Validation Accuracy: 0.9462, Loss: 0.0794 Epoch 19 Batch 6/269 - Train Accuracy: 0.9489, Validation Accuracy: 0.9450, Loss: 0.0719 Epoch 19 Batch 7/269 - Train Accuracy: 0.9409, Validation Accuracy: 0.9461, Loss: 0.0739 Epoch 19 Batch 8/269 - Train Accuracy: 0.9540, Validation Accuracy: 0.9477, Loss: 0.0773 Epoch 19 Batch 9/269 - Train Accuracy: 0.9307, Validation Accuracy: 0.9436, Loss: 0.0823 Epoch 19 Batch 10/269 - Train Accuracy: 0.9374, Validation Accuracy: 0.9426, Loss: 0.0746 Epoch 19 Batch 11/269 - Train Accuracy: 0.9336, Validation Accuracy: 0.9382, Loss: 0.0855 Epoch 19 Batch 12/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9419, Loss: 0.0826 Epoch 19 Batch 13/269 - Train Accuracy: 0.9407, Validation Accuracy: 0.9405, Loss: 0.0637 Epoch 19 Batch 14/269 - Train Accuracy: 0.9262, Validation Accuracy: 0.9407, Loss: 0.0737 Epoch 19 Batch 15/269 - Train Accuracy: 0.9514, Validation Accuracy: 0.9438, Loss: 0.0648 Epoch 19 Batch 16/269 - Train Accuracy: 0.9294, Validation Accuracy: 0.9434, Loss: 0.0829 Epoch 19 Batch 17/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9415, Loss: 0.0683 Epoch 19 Batch 18/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9415, Loss: 0.0767 Epoch 19 Batch 19/269 - Train Accuracy: 0.9496, Validation Accuracy: 0.9385, Loss: 0.0707 Epoch 19 Batch 20/269 - Train Accuracy: 0.9390, Validation Accuracy: 0.9400, Loss: 0.0731 Epoch 19 Batch 21/269 - Train Accuracy: 0.9192, Validation Accuracy: 0.9436, Loss: 0.0843 Epoch 19 Batch 22/269 - Train Accuracy: 0.9436, Validation Accuracy: 0.9434, Loss: 0.0698 Epoch 19 Batch 23/269 - Train Accuracy: 0.9398, Validation Accuracy: 0.9448, Loss: 0.0800 Epoch 19 Batch 24/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9347, Loss: 0.0755 Epoch 19 Batch 25/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9282, Loss: 0.0875 Epoch 19 Batch 26/269 - Train Accuracy: 0.9301, Validation Accuracy: 0.9403, Loss: 0.0763 Epoch 19 Batch 27/269 - Train Accuracy: 0.9265, Validation Accuracy: 0.9462, Loss: 0.0664 Epoch 19 Batch 28/269 - Train Accuracy: 0.9269, Validation Accuracy: 0.9456, Loss: 0.0868 Epoch 19 Batch 29/269 - Train Accuracy: 0.9410, Validation Accuracy: 0.9404, Loss: 0.0783 Epoch 19 Batch 30/269 - Train Accuracy: 0.9364, Validation Accuracy: 0.9407, Loss: 0.0778 Epoch 19 Batch 31/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9388, Loss: 0.0693 Epoch 19 Batch 32/269 - Train Accuracy: 0.9437, Validation Accuracy: 0.9414, Loss: 0.0729 Epoch 19 Batch 33/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9456, Loss: 0.0677 Epoch 19 Batch 34/269 - Train Accuracy: 0.9406, Validation Accuracy: 0.9446, Loss: 0.0791 Epoch 19 Batch 35/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9436, Loss: 0.0839 Epoch 19 Batch 36/269 - Train Accuracy: 0.9279, Validation Accuracy: 0.9441, Loss: 0.0776 Epoch 19 Batch 37/269 - Train Accuracy: 0.9423, Validation Accuracy: 0.9395, Loss: 0.0751 Epoch 19 Batch 38/269 - Train Accuracy: 0.9368, Validation Accuracy: 0.9457, Loss: 0.0750 Epoch 19 Batch 39/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9465, Loss: 0.0773 Epoch 19 Batch 40/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9474, Loss: 0.0768 Epoch 19 Batch 41/269 - Train Accuracy: 0.9235, Validation Accuracy: 0.9461, Loss: 0.0781 Epoch 19 Batch 42/269 - Train Accuracy: 0.9474, Validation Accuracy: 0.9403, Loss: 0.0657 Epoch 19 Batch 43/269 - Train Accuracy: 0.9382, Validation Accuracy: 0.9357, Loss: 0.0753 Epoch 19 Batch 44/269 - Train Accuracy: 0.9303, Validation Accuracy: 0.9341, Loss: 0.0754 Epoch 19 Batch 45/269 - Train Accuracy: 0.9347, Validation Accuracy: 0.9363, Loss: 0.0763 Epoch 19 Batch 46/269 - Train Accuracy: 0.9390, Validation Accuracy: 0.9409, Loss: 0.0749 Epoch 19 Batch 47/269 - Train Accuracy: 0.9475, Validation Accuracy: 0.9433, Loss: 0.0664 Epoch 19 Batch 48/269 - Train Accuracy: 0.9433, Validation Accuracy: 0.9431, Loss: 0.0728 Epoch 19 Batch 49/269 - Train Accuracy: 0.9334, Validation Accuracy: 0.9385, Loss: 0.0697 Epoch 19 Batch 50/269 - Train Accuracy: 0.9104, Validation Accuracy: 0.9360, Loss: 0.0877 Epoch 19 Batch 51/269 - Train Accuracy: 0.9350, Validation Accuracy: 0.9419, Loss: 0.0775 Epoch 19 Batch 52/269 - Train Accuracy: 0.9182, Validation Accuracy: 0.9425, Loss: 0.0670 Epoch 19 Batch 53/269 - Train Accuracy: 0.9291, Validation Accuracy: 0.9422, Loss: 0.0790 Epoch 19 Batch 54/269 - Train Accuracy: 0.9462, Validation Accuracy: 0.9435, Loss: 0.0730 Epoch 19 Batch 55/269 - Train Accuracy: 0.9461, Validation Accuracy: 0.9432, Loss: 0.0728 Epoch 19 Batch 56/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9445, Loss: 0.0736 Epoch 19 Batch 57/269 - Train Accuracy: 0.9285, Validation Accuracy: 0.9426, Loss: 0.0831 Epoch 19 Batch 58/269 - Train Accuracy: 0.9345, Validation Accuracy: 0.9438, Loss: 0.0717 Epoch 19 Batch 59/269 - Train Accuracy: 0.9575, Validation Accuracy: 0.9408, Loss: 0.0629 Epoch 19 Batch 60/269 - Train Accuracy: 0.9367, Validation Accuracy: 0.9462, Loss: 0.0707 Epoch 19 Batch 61/269 - Train Accuracy: 0.9391, Validation Accuracy: 0.9434, Loss: 0.0661 Epoch 19 Batch 62/269 - Train Accuracy: 0.9311, Validation Accuracy: 0.9490, Loss: 0.0730 Epoch 19 Batch 63/269 - Train Accuracy: 0.9403, Validation Accuracy: 0.9439, Loss: 0.0830 Epoch 19 Batch 64/269 - Train Accuracy: 0.9433, Validation Accuracy: 0.9448, Loss: 0.0688 Epoch 19 Batch 65/269 - Train Accuracy: 0.9234, Validation Accuracy: 0.9406, Loss: 0.0759 Epoch 19 Batch 66/269 - Train Accuracy: 0.9239, Validation Accuracy: 0.9459, Loss: 0.0809 Epoch 19 Batch 67/269 - Train Accuracy: 0.9250, Validation Accuracy: 0.9442, Loss: 0.0843 Epoch 19 Batch 68/269 - Train Accuracy: 0.9300, Validation Accuracy: 0.9441, Loss: 0.0830 Epoch 19 Batch 69/269 - Train Accuracy: 0.9274, Validation Accuracy: 0.9387, Loss: 0.0902 Epoch 19 Batch 70/269 - Train Accuracy: 0.9448, Validation Accuracy: 0.9398, Loss: 0.0785 Epoch 19 Batch 71/269 - Train Accuracy: 0.9338, Validation Accuracy: 0.9413, Loss: 0.0809 Epoch 19 Batch 72/269 - Train Accuracy: 0.9319, Validation Accuracy: 0.9438, Loss: 0.0792 Epoch 19 Batch 73/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9399, Loss: 0.0840 Epoch 19 Batch 74/269 - Train Accuracy: 0.9381, Validation Accuracy: 0.9385, Loss: 0.0692 Epoch 19 Batch 75/269 - Train Accuracy: 0.9373, Validation Accuracy: 0.9442, Loss: 0.0769 Epoch 19 Batch 76/269 - Train Accuracy: 0.9322, Validation Accuracy: 0.9448, Loss: 0.0740 Epoch 19 Batch 77/269 - Train Accuracy: 0.9351, Validation Accuracy: 0.9479, Loss: 0.0725 Epoch 19 Batch 78/269 - Train Accuracy: 0.9468, Validation Accuracy: 0.9447, Loss: 0.0759 Epoch 19 Batch 79/269 - Train Accuracy: 0.9330, Validation Accuracy: 0.9461, Loss: 0.0712 Epoch 19 Batch 80/269 - Train Accuracy: 0.9417, Validation Accuracy: 0.9434, Loss: 0.0747 Epoch 19 Batch 81/269 - Train Accuracy: 0.9281, Validation Accuracy: 0.9466, Loss: 0.0835 Epoch 19 Batch 82/269 - Train Accuracy: 0.9474, Validation Accuracy: 0.9447, Loss: 0.0620 Epoch 19 Batch 83/269 - Train Accuracy: 0.9228, Validation Accuracy: 0.9444, Loss: 0.0831 Epoch 19 Batch 84/269 - Train Accuracy: 0.9391, Validation Accuracy: 0.9434, Loss: 0.0727 Epoch 19 Batch 85/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9410, Loss: 0.0727 Epoch 19 Batch 86/269 - Train Accuracy: 0.9289, Validation Accuracy: 0.9374, Loss: 0.0664 Epoch 19 Batch 87/269 - Train Accuracy: 0.9237, Validation Accuracy: 0.9357, Loss: 0.0765 Epoch 19 Batch 88/269 - Train Accuracy: 0.9218, Validation Accuracy: 0.9389, Loss: 0.0728 Epoch 19 Batch 89/269 - Train Accuracy: 0.9420, Validation Accuracy: 0.9442, Loss: 0.0751 Epoch 19 Batch 90/269 - Train Accuracy: 0.9456, Validation Accuracy: 0.9431, Loss: 0.0739 Epoch 19 Batch 91/269 - Train Accuracy: 0.9496, Validation Accuracy: 0.9442, Loss: 0.0698 Epoch 19 Batch 92/269 - Train Accuracy: 0.9459, Validation Accuracy: 0.9448, Loss: 0.0697 Epoch 19 Batch 93/269 - Train Accuracy: 0.9470, Validation Accuracy: 0.9422, Loss: 0.0703 Epoch 19 Batch 94/269 - Train Accuracy: 0.9273, Validation Accuracy: 0.9443, Loss: 0.0826 Epoch 19 Batch 95/269 - Train Accuracy: 0.9488, Validation Accuracy: 0.9466, Loss: 0.0663 Epoch 19 Batch 96/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9455, Loss: 0.0797 Epoch 19 Batch 97/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9468, Loss: 0.0821 Epoch 19 Batch 98/269 - Train Accuracy: 0.9430, Validation Accuracy: 0.9415, Loss: 0.0726 Epoch 19 Batch 99/269 - Train Accuracy: 0.9400, Validation Accuracy: 0.9367, Loss: 0.0698 Epoch 19 Batch 100/269 - Train Accuracy: 0.9410, Validation Accuracy: 0.9441, Loss: 0.0746 Epoch 19 Batch 101/269 - Train Accuracy: 0.9323, Validation Accuracy: 0.9447, Loss: 0.0844 Epoch 19 Batch 102/269 - Train Accuracy: 0.9406, Validation Accuracy: 0.9482, Loss: 0.0749 Epoch 19 Batch 103/269 - Train Accuracy: 0.9486, Validation Accuracy: 0.9502, Loss: 0.0789 Epoch 19 Batch 104/269 - Train Accuracy: 0.9418, Validation Accuracy: 0.9488, Loss: 0.0689 Epoch 19 Batch 105/269 - Train Accuracy: 0.9337, Validation Accuracy: 0.9466, Loss: 0.0771 Epoch 19 Batch 106/269 - Train Accuracy: 0.9504, Validation Accuracy: 0.9478, Loss: 0.0713 Epoch 19 Batch 107/269 - Train Accuracy: 0.9472, Validation Accuracy: 0.9438, Loss: 0.0744 Epoch 19 Batch 108/269 - Train Accuracy: 0.9515, Validation Accuracy: 0.9409, Loss: 0.0717 Epoch 19 Batch 109/269 - Train Accuracy: 0.9254, Validation Accuracy: 0.9460, Loss: 0.0747 Epoch 19 Batch 110/269 - Train Accuracy: 0.9359, Validation Accuracy: 0.9440, Loss: 0.0658 Epoch 19 Batch 111/269 - Train Accuracy: 0.9370, Validation Accuracy: 0.9432, Loss: 0.0794 Epoch 19 Batch 112/269 - Train Accuracy: 0.9364, Validation Accuracy: 0.9442, Loss: 0.0772 Epoch 19 Batch 113/269 - Train Accuracy: 0.9370, Validation Accuracy: 0.9433, Loss: 0.0738 Epoch 19 Batch 114/269 - Train Accuracy: 0.9379, Validation Accuracy: 0.9383, Loss: 0.0770 Epoch 19 Batch 115/269 - Train Accuracy: 0.9380, Validation Accuracy: 0.9403, Loss: 0.0732 Epoch 19 Batch 116/269 - Train Accuracy: 0.9345, Validation Accuracy: 0.9408, Loss: 0.0771 Epoch 19 Batch 117/269 - Train Accuracy: 0.9352, Validation Accuracy: 0.9447, Loss: 0.0677 Epoch 19 Batch 118/269 - Train Accuracy: 0.9458, Validation Accuracy: 0.9426, Loss: 0.0689 Epoch 19 Batch 119/269 - Train Accuracy: 0.9203, Validation Accuracy: 0.9432, Loss: 0.0797 Epoch 19 Batch 120/269 - Train Accuracy: 0.9326, Validation Accuracy: 0.9442, Loss: 0.0795 Epoch 19 Batch 121/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9417, Loss: 0.0676 Epoch 19 Batch 122/269 - Train Accuracy: 0.9462, Validation Accuracy: 0.9403, Loss: 0.0714 Epoch 19 Batch 123/269 - Train Accuracy: 0.9353, Validation Accuracy: 0.9368, Loss: 0.0754 Epoch 19 Batch 124/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9379, Loss: 0.0691 Epoch 19 Batch 125/269 - Train Accuracy: 0.9472, Validation Accuracy: 0.9403, Loss: 0.0686 Epoch 19 Batch 126/269 - Train Accuracy: 0.9213, Validation Accuracy: 0.9403, Loss: 0.0727 Epoch 19 Batch 127/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9450, Loss: 0.0821 Epoch 19 Batch 128/269 - Train Accuracy: 0.9383, Validation Accuracy: 0.9365, Loss: 0.0736 Epoch 19 Batch 129/269 - Train Accuracy: 0.9216, Validation Accuracy: 0.9367, Loss: 0.0761 Epoch 19 Batch 130/269 - Train Accuracy: 0.9500, Validation Accuracy: 0.9434, Loss: 0.0805 Epoch 19 Batch 131/269 - Train Accuracy: 0.9306, Validation Accuracy: 0.9421, Loss: 0.0769 Epoch 19 Batch 132/269 - Train Accuracy: 0.9168, Validation Accuracy: 0.9347, Loss: 0.0792 Epoch 19 Batch 133/269 - Train Accuracy: 0.9424, Validation Accuracy: 0.9324, Loss: 0.0673 Epoch 19 Batch 134/269 - Train Accuracy: 0.9269, Validation Accuracy: 0.9339, Loss: 0.0724 Epoch 19 Batch 135/269 - Train Accuracy: 0.9420, Validation Accuracy: 0.9388, Loss: 0.0814 Epoch 19 Batch 136/269 - Train Accuracy: 0.9104, Validation Accuracy: 0.9415, Loss: 0.0831 Epoch 19 Batch 137/269 - Train Accuracy: 0.9220, Validation Accuracy: 0.9397, Loss: 0.0853 Epoch 19 Batch 138/269 - Train Accuracy: 0.9352, Validation Accuracy: 0.9411, Loss: 0.0720 Epoch 19 Batch 139/269 - Train Accuracy: 0.9448, Validation Accuracy: 0.9428, Loss: 0.0677 Epoch 19 Batch 140/269 - Train Accuracy: 0.9346, Validation Accuracy: 0.9458, Loss: 0.0803 Epoch 19 Batch 141/269 - Train Accuracy: 0.9332, Validation Accuracy: 0.9420, Loss: 0.0844 Epoch 19 Batch 142/269 - Train Accuracy: 0.9324, Validation Accuracy: 0.9441, Loss: 0.0722 Epoch 19 Batch 143/269 - Train Accuracy: 0.9440, Validation Accuracy: 0.9420, Loss: 0.0678 Epoch 19 Batch 144/269 - Train Accuracy: 0.9521, Validation Accuracy: 0.9374, Loss: 0.0650 Epoch 19 Batch 145/269 - Train Accuracy: 0.9375, Validation Accuracy: 0.9418, Loss: 0.0705 Epoch 19 Batch 146/269 - Train Accuracy: 0.9365, Validation Accuracy: 0.9429, Loss: 0.0689 Epoch 19 Batch 147/269 - Train Accuracy: 0.9372, Validation Accuracy: 0.9472, Loss: 0.0800 Epoch 19 Batch 148/269 - Train Accuracy: 0.9408, Validation Accuracy: 0.9436, Loss: 0.0701 Epoch 19 Batch 149/269 - Train Accuracy: 0.9254, Validation Accuracy: 0.9458, Loss: 0.0843 Epoch 19 Batch 150/269 - Train Accuracy: 0.9426, Validation Accuracy: 0.9430, Loss: 0.0778 Epoch 19 Batch 151/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9385, Loss: 0.0702 Epoch 19 Batch 152/269 - Train Accuracy: 0.9365, Validation Accuracy: 0.9427, Loss: 0.0759 Epoch 19 Batch 153/269 - Train Accuracy: 0.9493, Validation Accuracy: 0.9476, Loss: 0.0720 Epoch 19 Batch 154/269 - Train Accuracy: 0.9458, Validation Accuracy: 0.9468, Loss: 0.0688 Epoch 19 Batch 155/269 - Train Accuracy: 0.9333, Validation Accuracy: 0.9447, Loss: 0.0698 Epoch 19 Batch 156/269 - Train Accuracy: 0.9354, Validation Accuracy: 0.9437, Loss: 0.0813 Epoch 19 Batch 157/269 - Train Accuracy: 0.9280, Validation Accuracy: 0.9427, Loss: 0.0683 Epoch 19 Batch 158/269 - Train Accuracy: 0.9305, Validation Accuracy: 0.9401, Loss: 0.0751 Epoch 19 Batch 159/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9459, Loss: 0.0760 Epoch 19 Batch 160/269 - Train Accuracy: 0.9361, Validation Accuracy: 0.9392, Loss: 0.0723 Epoch 19 Batch 161/269 - Train Accuracy: 0.9435, Validation Accuracy: 0.9396, Loss: 0.0687 Epoch 19 Batch 162/269 - Train Accuracy: 0.9408, Validation Accuracy: 0.9405, Loss: 0.0704 Epoch 19 Batch 163/269 - Train Accuracy: 0.9457, Validation Accuracy: 0.9329, Loss: 0.0715 Epoch 19 Batch 164/269 - Train Accuracy: 0.9405, Validation Accuracy: 0.9336, Loss: 0.0699 Epoch 19 Batch 165/269 - Train Accuracy: 0.9381, Validation Accuracy: 0.9398, Loss: 0.0743 Epoch 19 Batch 166/269 - Train Accuracy: 0.9453, Validation Accuracy: 0.9409, Loss: 0.0748 Epoch 19 Batch 167/269 - Train Accuracy: 0.9450, Validation Accuracy: 0.9450, Loss: 0.0674 Epoch 19 Batch 168/269 - Train Accuracy: 0.9442, Validation Accuracy: 0.9446, Loss: 0.0747 Epoch 19 Batch 169/269 - Train Accuracy: 0.9285, Validation Accuracy: 0.9437, Loss: 0.0711 Epoch 19 Batch 170/269 - Train Accuracy: 0.9318, Validation Accuracy: 0.9456, Loss: 0.0740 Epoch 19 Batch 171/269 - Train Accuracy: 0.9531, Validation Accuracy: 0.9467, Loss: 0.0736 Epoch 19 Batch 172/269 - Train Accuracy: 0.9344, Validation Accuracy: 0.9473, Loss: 0.0825 Epoch 19 Batch 173/269 - Train Accuracy: 0.9450, Validation Accuracy: 0.9422, Loss: 0.0642 Epoch 19 Batch 174/269 - Train Accuracy: 0.9515, Validation Accuracy: 0.9442, Loss: 0.0756 Epoch 19 Batch 175/269 - Train Accuracy: 0.9184, Validation Accuracy: 0.9447, Loss: 0.0840 Epoch 19 Batch 176/269 - Train Accuracy: 0.9224, Validation Accuracy: 0.9437, Loss: 0.0829 Epoch 19 Batch 177/269 - Train Accuracy: 0.9521, Validation Accuracy: 0.9450, Loss: 0.0690 Epoch 19 Batch 178/269 - Train Accuracy: 0.9390, Validation Accuracy: 0.9442, Loss: 0.0681 Epoch 19 Batch 179/269 - Train Accuracy: 0.9248, Validation Accuracy: 0.9446, Loss: 0.0728 Epoch 19 Batch 180/269 - Train Accuracy: 0.9408, Validation Accuracy: 0.9443, Loss: 0.0714 Epoch 19 Batch 181/269 - Train Accuracy: 0.9355, Validation Accuracy: 0.9474, Loss: 0.0813 Epoch 19 Batch 182/269 - Train Accuracy: 0.9338, Validation Accuracy: 0.9444, Loss: 0.0705 Epoch 19 Batch 183/269 - Train Accuracy: 0.9465, Validation Accuracy: 0.9497, Loss: 0.0616 Epoch 19 Batch 184/269 - Train Accuracy: 0.9409, Validation Accuracy: 0.9431, Loss: 0.0694 Epoch 19 Batch 185/269 - Train Accuracy: 0.9406, Validation Accuracy: 0.9437, Loss: 0.0682 Epoch 19 Batch 186/269 - Train Accuracy: 0.9393, Validation Accuracy: 0.9437, Loss: 0.0665 Epoch 19 Batch 187/269 - Train Accuracy: 0.9364, Validation Accuracy: 0.9450, Loss: 0.0715 Epoch 19 Batch 188/269 - Train Accuracy: 0.9380, Validation Accuracy: 0.9464, Loss: 0.0711 Epoch 19 Batch 189/269 - Train Accuracy: 0.9360, Validation Accuracy: 0.9466, Loss: 0.0654 Epoch 19 Batch 190/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9478, Loss: 0.0688 Epoch 19 Batch 191/269 - Train Accuracy: 0.9296, Validation Accuracy: 0.9444, Loss: 0.0684 Epoch 19 Batch 192/269 - Train Accuracy: 0.9432, Validation Accuracy: 0.9471, Loss: 0.0729 Epoch 19 Batch 193/269 - Train Accuracy: 0.9410, Validation Accuracy: 0.9468, Loss: 0.0693 Epoch 19 Batch 194/269 - Train Accuracy: 0.9253, Validation Accuracy: 0.9490, Loss: 0.0715 Epoch 19 Batch 195/269 - Train Accuracy: 0.9363, Validation Accuracy: 0.9452, Loss: 0.0700 Epoch 19 Batch 196/269 - Train Accuracy: 0.9336, Validation Accuracy: 0.9470, Loss: 0.0701 Epoch 19 Batch 197/269 - Train Accuracy: 0.9350, Validation Accuracy: 0.9458, Loss: 0.0736 Epoch 19 Batch 198/269 - Train Accuracy: 0.9441, Validation Accuracy: 0.9463, Loss: 0.0748 Epoch 19 Batch 199/269 - Train Accuracy: 0.9461, Validation Accuracy: 0.9376, Loss: 0.0711 Epoch 19 Batch 200/269 - Train Accuracy: 0.9348, Validation Accuracy: 0.9358, Loss: 0.0719 Epoch 19 Batch 201/269 - Train Accuracy: 0.9429, Validation Accuracy: 0.9436, Loss: 0.0722 Epoch 19 Batch 202/269 - Train Accuracy: 0.9314, Validation Accuracy: 0.9466, Loss: 0.0721 Epoch 19 Batch 203/269 - Train Accuracy: 0.9282, Validation Accuracy: 0.9508, Loss: 0.0812 Epoch 19 Batch 204/269 - Train Accuracy: 0.9428, Validation Accuracy: 0.9498, Loss: 0.0747 Epoch 19 Batch 205/269 - Train Accuracy: 0.9387, Validation Accuracy: 0.9513, Loss: 0.0722 Epoch 19 Batch 206/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9498, Loss: 0.0768 Epoch 19 Batch 207/269 - Train Accuracy: 0.9316, Validation Accuracy: 0.9518, Loss: 0.0697 Epoch 19 Batch 208/269 - Train Accuracy: 0.9357, Validation Accuracy: 0.9490, Loss: 0.0806 Epoch 19 Batch 209/269 - Train Accuracy: 0.9465, Validation Accuracy: 0.9457, Loss: 0.0633 Epoch 19 Batch 210/269 - Train Accuracy: 0.9427, Validation Accuracy: 0.9490, Loss: 0.0729 Epoch 19 Batch 211/269 - Train Accuracy: 0.9345, Validation Accuracy: 0.9458, Loss: 0.0783 Epoch 19 Batch 212/269 - Train Accuracy: 0.9381, Validation Accuracy: 0.9450, Loss: 0.0811 Epoch 19 Batch 213/269 - Train Accuracy: 0.9378, Validation Accuracy: 0.9431, Loss: 0.0674 Epoch 19 Batch 214/269 - Train Accuracy: 0.9400, Validation Accuracy: 0.9434, Loss: 0.0697 Epoch 19 Batch 215/269 - Train Accuracy: 0.9350, Validation Accuracy: 0.9417, Loss: 0.0699 Epoch 19 Batch 216/269 - Train Accuracy: 0.9362, Validation Accuracy: 0.9434, Loss: 0.0823 Epoch 19 Batch 217/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9479, Loss: 0.0767 Epoch 19 Batch 218/269 - Train Accuracy: 0.9487, Validation Accuracy: 0.9482, Loss: 0.0711 Epoch 19 Batch 219/269 - Train Accuracy: 0.9502, Validation Accuracy: 0.9486, Loss: 0.0750 Epoch 19 Batch 220/269 - Train Accuracy: 0.9409, Validation Accuracy: 0.9510, Loss: 0.0676 Epoch 19 Batch 221/269 - Train Accuracy: 0.9416, Validation Accuracy: 0.9455, Loss: 0.0759 Epoch 19 Batch 222/269 - Train Accuracy: 0.9483, Validation Accuracy: 0.9467, Loss: 0.0683 Epoch 19 Batch 223/269 - Train Accuracy: 0.9275, Validation Accuracy: 0.9454, Loss: 0.0715 Epoch 19 Batch 224/269 - Train Accuracy: 0.9392, Validation Accuracy: 0.9445, Loss: 0.0830 Epoch 19 Batch 225/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9462, Loss: 0.0620 Epoch 19 Batch 226/269 - Train Accuracy: 0.9430, Validation Accuracy: 0.9464, Loss: 0.0716 Epoch 19 Batch 227/269 - Train Accuracy: 0.9504, Validation Accuracy: 0.9474, Loss: 0.0840 Epoch 19 Batch 228/269 - Train Accuracy: 0.9430, Validation Accuracy: 0.9450, Loss: 0.0670 Epoch 19 Batch 229/269 - Train Accuracy: 0.9369, Validation Accuracy: 0.9441, Loss: 0.0677 Epoch 19 Batch 230/269 - Train Accuracy: 0.9395, Validation Accuracy: 0.9473, Loss: 0.0708 Epoch 19 Batch 231/269 - Train Accuracy: 0.9388, Validation Accuracy: 0.9490, Loss: 0.0735 Epoch 19 Batch 232/269 - Train Accuracy: 0.9399, Validation Accuracy: 0.9445, Loss: 0.0741 Epoch 19 Batch 233/269 - Train Accuracy: 0.9432, Validation Accuracy: 0.9440, Loss: 0.0745 Epoch 19 Batch 234/269 - Train Accuracy: 0.9432, Validation Accuracy: 0.9471, Loss: 0.0727 Epoch 19 Batch 235/269 - Train Accuracy: 0.9670, Validation Accuracy: 0.9532, Loss: 0.0581 Epoch 19 Batch 236/269 - Train Accuracy: 0.9339, Validation Accuracy: 0.9522, Loss: 0.0711 Epoch 19 Batch 237/269 - Train Accuracy: 0.9417, Validation Accuracy: 0.9497, Loss: 0.0655 Epoch 19 Batch 238/269 - Train Accuracy: 0.9497, Validation Accuracy: 0.9525, Loss: 0.0718 Epoch 19 Batch 239/269 - Train Accuracy: 0.9385, Validation Accuracy: 0.9395, Loss: 0.0690 Epoch 19 Batch 240/269 - Train Accuracy: 0.9487, Validation Accuracy: 0.9505, Loss: 0.0655 Epoch 19 Batch 241/269 - Train Accuracy: 0.9469, Validation Accuracy: 0.9512, Loss: 0.0788 Epoch 19 Batch 242/269 - Train Accuracy: 0.9564, Validation Accuracy: 0.9435, Loss: 0.0727 Epoch 19 Batch 243/269 - Train Accuracy: 0.9430, Validation Accuracy: 0.9417, Loss: 0.0685 Epoch 19 Batch 244/269 - Train Accuracy: 0.9443, Validation Accuracy: 0.9476, Loss: 0.0735 Epoch 19 Batch 245/269 - Train Accuracy: 0.9159, Validation Accuracy: 0.9462, Loss: 0.0736 Epoch 19 Batch 246/269 - Train Accuracy: 0.9396, Validation Accuracy: 0.9508, Loss: 0.0769 Epoch 19 Batch 247/269 - Train Accuracy: 0.9380, Validation Accuracy: 0.9522, Loss: 0.0683 Epoch 19 Batch 248/269 - Train Accuracy: 0.9496, Validation Accuracy: 0.9448, Loss: 0.0664 Epoch 19 Batch 249/269 - Train Accuracy: 0.9385, Validation Accuracy: 0.9440, Loss: 0.0643 Epoch 19 Batch 250/269 - Train Accuracy: 0.9446, Validation Accuracy: 0.9455, Loss: 0.0664 Epoch 19 Batch 251/269 - Train Accuracy: 0.9627, Validation Accuracy: 0.9458, Loss: 0.0707 Epoch 19 Batch 252/269 - Train Accuracy: 0.9431, Validation Accuracy: 0.9443, Loss: 0.0660 Epoch 19 Batch 253/269 - Train Accuracy: 0.9249, Validation Accuracy: 0.9422, Loss: 0.0738 Epoch 19 Batch 254/269 - Train Accuracy: 0.9387, Validation Accuracy: 0.9410, Loss: 0.0740 Epoch 19 Batch 255/269 - Train Accuracy: 0.9491, Validation Accuracy: 0.9399, Loss: 0.0733 Epoch 19 Batch 256/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9411, Loss: 0.0736 Epoch 19 Batch 257/269 - Train Accuracy: 0.9331, Validation Accuracy: 0.9371, Loss: 0.0772 Epoch 19 Batch 258/269 - Train Accuracy: 0.9386, Validation Accuracy: 0.9377, Loss: 0.0769 Epoch 19 Batch 259/269 - Train Accuracy: 0.9422, Validation Accuracy: 0.9496, Loss: 0.0689 Epoch 19 Batch 260/269 - Train Accuracy: 0.9371, Validation Accuracy: 0.9524, Loss: 0.0765 Epoch 19 Batch 261/269 - Train Accuracy: 0.9393, Validation Accuracy: 0.9502, Loss: 0.0726 Epoch 19 Batch 262/269 - Train Accuracy: 0.9382, Validation Accuracy: 0.9490, Loss: 0.0733 Epoch 19 Batch 263/269 - Train Accuracy: 0.9363, Validation Accuracy: 0.9485, Loss: 0.0752 Epoch 19 Batch 264/269 - Train Accuracy: 0.9257, Validation Accuracy: 0.9484, Loss: 0.0772 Epoch 19 Batch 265/269 - Train Accuracy: 0.9433, Validation Accuracy: 0.9465, Loss: 0.0692 Epoch 19 Batch 266/269 - Train Accuracy: 0.9312, Validation Accuracy: 0.9504, Loss: 0.0662 Epoch 19 Batch 267/269 - Train Accuracy: 0.9482, Validation Accuracy: 0.9510, Loss: 0.0777 Model Trained and Saved
Save the batch_size
and save_path
parameters for inference.
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Save parameters for checkpoint
helper.save_params(save_path)
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import tensorflow as tf
import numpy as np
import helper
import problem_unittests as tests
_, (source_vocab_to_int, target_vocab_to_int), (source_int_to_vocab, target_int_to_vocab) = helper.load_preprocess()
load_path = helper.load_params()
To feed a sentence into the model for translation, you first need to preprocess it. Implement the function sentence_to_seq()
to preprocess new sentences.
vocab_to_int
<UNK>
word id.def sentence_to_seq(sentence, vocab_to_int):
"""
Convert a sentence to a sequence of ids
:param sentence: String
:param vocab_to_int: Dictionary to go from the words to an id
:return: List of word ids
"""
# TODO: Implement Function
ids = []
for word in sentence.split():
if word in vocab_to_int:
print(vocab_to_int[word])
ids.append(vocab_to_int[word])
else:
ids.append(vocab_to_int['<UNK>'])
return ids
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_sentence_to_seq(sentence_to_seq)
3 6 5 4 Tests Passed
This will translate translate_sentence
from English to French.
translate_sentence = 'he saw a old yellow truck .'
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
translate_sentence = sentence_to_seq(translate_sentence, source_vocab_to_int)
loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
# Load saved model
loader = tf.train.import_meta_graph(load_path + '.meta')
loader.restore(sess, load_path)
input_data = loaded_graph.get_tensor_by_name('input:0')
logits = loaded_graph.get_tensor_by_name('predictions:0')
target_sequence_length = loaded_graph.get_tensor_by_name('target_sequence_length:0')
source_sequence_length = loaded_graph.get_tensor_by_name('source_sequence_length:0')
keep_prob = loaded_graph.get_tensor_by_name('keep_prob:0')
translate_logits = sess.run(logits, {input_data: [translate_sentence]*batch_size,
target_sequence_length: [len(translate_sentence)*2]*batch_size,
source_sequence_length: [len(translate_sentence)]*batch_size,
keep_prob: 1.0})[0]
print('Input')
print(' Word Ids: {}'.format([i for i in translate_sentence]))
print(' English Words: {}'.format([source_int_to_vocab[i] for i in translate_sentence]))
print('\nPrediction')
print(' Word Ids: {}'.format([i for i in translate_logits]))
print(' French Words: {}'.format(" ".join([target_int_to_vocab[i] for i in translate_logits])))
35 9 8 77 215 158 181 INFO:tensorflow:Restoring parameters from checkpoints/dev Input Word Ids: [35, 9, 8, 77, 215, 158, 181] English Words: ['he', 'saw', 'a', 'old', 'yellow', 'truck', '.'] Prediction Word Ids: [306, 201, 109, 208, 255, 336, 51, 179, 1] French Words: il a vu un vieux camion jaune . <EOS>
You might notice that some sentences translate better than others. Since the dataset you're using only has a vocabulary of 227 English words of the thousands that you use, you're only going to see good results using these words. For this project, you don't need a perfect translation. However, if you want to create a better translation model, you'll need better data.
You can train on the WMT10 French-English corpus. This dataset has more vocabulary and richer in topics discussed. However, this will take you days to train, so make sure you've a GPU and the neural network is performing well on dataset we provided. Just make sure you play with the WMT10 corpus after you've submitted this project.
When submitting this project, make sure to run all the cells before saving the notebook. Save the notebook file as "dlnd_language_translation.ipynb" and save it as a HTML file under "File" -> "Download as". Include the "helper.py" and "problem_unittests.py" files in your submission.