python main.py /usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:138: UserWarning: CUDA initialization: CUDA driver initialization failed, you might not have a CUDA gpu. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0 Message sent successfully! Namespace(batch_size=128, lr=0.01, epochs=20, analyze=False) SEED 42 Files already downloaded and verified Files already downloaded and verified [sgd][none][epoch 1] train_loss=2.0053, train_acc=0.2661, test_acc=0.3923 [sgd][none][epoch 2] train_loss=1.5552, train_acc=0.4410, test_acc=0.4985 [sgd][none][epoch 3] train_loss=1.3659, train_acc=0.5116, test_acc=0.5425 [sgd][none][epoch 4] train_loss=1.2634, train_acc=0.5483, test_acc=0.5884 [sgd][none][epoch 5] train_loss=1.1752, train_acc=0.5810, test_acc=0.5867 [sgd][none][epoch 6] train_loss=1.0963, train_acc=0.6116, test_acc=0.6368 [sgd][none][epoch 7] train_loss=1.0310, train_acc=0.6359, test_acc=0.6424 [sgd][none][epoch 8] train_loss=0.9726, train_acc=0.6574, test_acc=0.6589 [sgd][none][epoch 9] train_loss=0.9323, train_acc=0.6723, test_acc=0.6647 [sgd][none][epoch 10] train_loss=0.8843, train_acc=0.6885, test_acc=0.6754 [sgd][none][epoch 11] train_loss=0.8454, train_acc=0.7028, test_acc=0.6839 [sgd][none][epoch 12] train_loss=0.8084, train_acc=0.7146, test_acc=0.6844 [sgd][none][epoch 13] train_loss=0.7736, train_acc=0.7275, test_acc=0.6905 [sgd][none][epoch 14] train_loss=0.7405, train_acc=0.7391, test_acc=0.6847 [sgd][none][epoch 15] train_loss=0.7178, train_acc=0.7473, test_acc=0.7029 [sgd][none][epoch 16] train_loss=0.6816, train_acc=0.7612, test_acc=0.6944 [sgd][none][epoch 17] train_loss=0.6591, train_acc=0.7693, test_acc=0.6946 [sgd][none][epoch 18] train_loss=0.6324, train_acc=0.7770, test_acc=0.7046 [sgd][none][epoch 19] train_loss=0.6078, train_acc=0.7846, test_acc=0.7003 [sgd][none][epoch 20] train_loss=0.5815, train_acc=0.7935, test_acc=0.7013 Files already downloaded and verified Files already downloaded and verified [sgd][standard][epoch 1] train_loss=2.0359, train_acc=0.2552, test_acc=0.3902 [sgd][standard][epoch 2] train_loss=1.7088, train_acc=0.3825, test_acc=0.4608 [sgd][standard][epoch 3] train_loss=1.5394, train_acc=0.4392, test_acc=0.5077 [sgd][standard][epoch 4] train_loss=1.4547, train_acc=0.4723, test_acc=0.5314 [sgd][standard][epoch 5] train_loss=1.3847, train_acc=0.5011, test_acc=0.5736 [sgd][standard][epoch 6] train_loss=1.3219, train_acc=0.5217, test_acc=0.5886 [sgd][standard][epoch 7] train_loss=1.2655, train_acc=0.5445, test_acc=0.6200 [sgd][standard][epoch 8] train_loss=1.2301, train_acc=0.5609, test_acc=0.6150 [sgd][standard][epoch 9] train_loss=1.1942, train_acc=0.5754, test_acc=0.6317 [sgd][standard][epoch 10] train_loss=1.1679, train_acc=0.5827, test_acc=0.6496 [sgd][standard][epoch 11] train_loss=1.1530, train_acc=0.5874, test_acc=0.6523 [sgd][standard][epoch 12] train_loss=1.1209, train_acc=0.5995, test_acc=0.6542 [sgd][standard][epoch 13] train_loss=1.1006, train_acc=0.6071, test_acc=0.6636 [sgd][standard][epoch 14] train_loss=1.0869, train_acc=0.6130, test_acc=0.6743 [sgd][standard][epoch 15] train_loss=1.0667, train_acc=0.6217, test_acc=0.6889 [sgd][standard][epoch 16] train_loss=1.0647, train_acc=0.6233, test_acc=0.6859 [sgd][standard][epoch 17] train_loss=1.0438, train_acc=0.6297, test_acc=0.6906 [sgd][standard][epoch 18] train_loss=1.0385, train_acc=0.6304, test_acc=0.6939 [sgd][standard][epoch 19] train_loss=1.0160, train_acc=0.6405, test_acc=0.6895 [sgd][standard][epoch 20] train_loss=1.0132, train_acc=0.6407, test_acc=0.6791 Files already downloaded and verified Files already downloaded and verified [sgd][aggressive][epoch 1] train_loss=2.0499, train_acc=0.2434, test_acc=0.3315 [sgd][aggressive][epoch 2] train_loss=1.7751, train_acc=0.3580, test_acc=0.4525 [sgd][aggressive][epoch 3] train_loss=1.6295, train_acc=0.4092, test_acc=0.4708 [sgd][aggressive][epoch 4] train_loss=1.5567, train_acc=0.4379, test_acc=0.5272 [sgd][aggressive][epoch 5] train_loss=1.5069, train_acc=0.4563, test_acc=0.5268 [sgd][aggressive][epoch 6] train_loss=1.4473, train_acc=0.4804, test_acc=0.5427 [sgd][aggressive][epoch 7] train_loss=1.4167, train_acc=0.4912, test_acc=0.5828 [sgd][aggressive][epoch 8] train_loss=1.3933, train_acc=0.5006, test_acc=0.5861 [sgd][aggressive][epoch 9] train_loss=1.3540, train_acc=0.5145, test_acc=0.6093 [sgd][aggressive][epoch 10] train_loss=1.3268, train_acc=0.5279, test_acc=0.6262 [sgd][aggressive][epoch 11] train_loss=1.2946, train_acc=0.5374, test_acc=0.6210 [sgd][aggressive][epoch 12] train_loss=1.2794, train_acc=0.5441, test_acc=0.6339 [sgd][aggressive][epoch 13] train_loss=1.2606, train_acc=0.5517, test_acc=0.6379 [sgd][aggressive][epoch 14] train_loss=1.2452, train_acc=0.5571, test_acc=0.6558 [sgd][aggressive][epoch 15] train_loss=1.2263, train_acc=0.5650, test_acc=0.6631 [sgd][aggressive][epoch 16] train_loss=1.2119, train_acc=0.5681, test_acc=0.6508 [sgd][aggressive][epoch 17] train_loss=1.2090, train_acc=0.5702, test_acc=0.6643 [sgd][aggressive][epoch 18] train_loss=1.1906, train_acc=0.5780, test_acc=0.6507 [sgd][aggressive][epoch 19] train_loss=1.1747, train_acc=0.5831, test_acc=0.6728 [sgd][aggressive][epoch 20] train_loss=1.1603, train_acc=0.5882, test_acc=0.6703 Files already downloaded and verified Files already downloaded and verified [adam][none][epoch 1] train_loss=1.7651, train_acc=0.3486, test_acc=0.4452 [adam][none][epoch 2] train_loss=1.4773, train_acc=0.4608, test_acc=0.4928 [adam][none][epoch 3] train_loss=1.4246, train_acc=0.4883, test_acc=0.5095 [adam][none][epoch 4] train_loss=1.3900, train_acc=0.4974, test_acc=0.5366 [adam][none][epoch 5] train_loss=1.3695, train_acc=0.5090, test_acc=0.5367 [adam][none][epoch 6] train_loss=1.3548, train_acc=0.5146, test_acc=0.5403 [adam][none][epoch 7] train_loss=1.3448, train_acc=0.5149, test_acc=0.5363 [adam][none][epoch 8] train_loss=1.3417, train_acc=0.5190, test_acc=0.5294 [adam][none][epoch 9] train_loss=1.3385, train_acc=0.5203, test_acc=0.5552 [adam][none][epoch 10] train_loss=1.3314, train_acc=0.5228, test_acc=0.5559 [adam][none][epoch 11] train_loss=1.3147, train_acc=0.5289, test_acc=0.5765 [adam][none][epoch 12] train_loss=1.3206, train_acc=0.5280, test_acc=0.5784 [adam][none][epoch 13] train_loss=1.3099, train_acc=0.5291, test_acc=0.5604 [adam][none][epoch 14] train_loss=1.3168, train_acc=0.5275, test_acc=0.5766 [adam][none][epoch 15] train_loss=1.3134, train_acc=0.5308, test_acc=0.5413 [adam][none][epoch 16] train_loss=1.3288, train_acc=0.5251, test_acc=0.5474 [adam][none][epoch 17] train_loss=1.3214, train_acc=0.5305, test_acc=0.5339 [adam][none][epoch 18] train_loss=1.3235, train_acc=0.5274, test_acc=0.5621 [adam][none][epoch 19] train_loss=1.3163, train_acc=0.5307, test_acc=0.5786 [adam][none][epoch 20] train_loss=1.3079, train_acc=0.5337, test_acc=0.5658 Files already downloaded and verified Files already downloaded and verified [adam][standard][epoch 1] train_loss=2.0309, train_acc=0.2476, test_acc=0.3421 [adam][standard][epoch 2] train_loss=1.7958, train_acc=0.3385, test_acc=0.3857 [adam][standard][epoch 3] train_loss=1.7349, train_acc=0.3550, test_acc=0.4019 [adam][standard][epoch 4] train_loss=1.7112, train_acc=0.3655, test_acc=0.4141 [adam][standard][epoch 5] train_loss=1.6914, train_acc=0.3727, test_acc=0.4395 [adam][standard][epoch 6] train_loss=1.6767, train_acc=0.3770, test_acc=0.3837 [adam][standard][epoch 7] train_loss=1.6701, train_acc=0.3838, test_acc=0.4161 [adam][standard][epoch 8] train_loss=1.6569, train_acc=0.3897, test_acc=0.4351 [adam][standard][epoch 9] train_loss=1.6578, train_acc=0.3908, test_acc=0.4555 [adam][standard][epoch 10] train_loss=1.6537, train_acc=0.3912, test_acc=0.4293 [adam][standard][epoch 11] train_loss=1.6380, train_acc=0.4010, test_acc=0.4145 [adam][standard][epoch 12] train_loss=1.6417, train_acc=0.3960, test_acc=0.3761 [adam][standard][epoch 13] train_loss=1.6474, train_acc=0.3965, test_acc=0.4443 [adam][standard][epoch 14] train_loss=1.6316, train_acc=0.4004, test_acc=0.4553 [adam][standard][epoch 15] train_loss=1.6246, train_acc=0.4048, test_acc=0.4794 [adam][standard][epoch 16] train_loss=1.6243, train_acc=0.4045, test_acc=0.4646 [adam][standard][epoch 17] train_loss=1.6160, train_acc=0.4067, test_acc=0.4644 [adam][standard][epoch 18] train_loss=1.6250, train_acc=0.4038, test_acc=0.4734 [adam][standard][epoch 19] train_loss=1.6166, train_acc=0.4085, test_acc=0.3933 [adam][standard][epoch 20] train_loss=1.6181, train_acc=0.4059, test_acc=0.4394 Files already downloaded and verified Files already downloaded and verified [adam][aggressive][epoch 1] train_loss=1.9924, train_acc=0.2727, test_acc=0.3942 [adam][aggressive][epoch 2] train_loss=1.7828, train_acc=0.3478, test_acc=0.4111 [adam][aggressive][epoch 3] train_loss=1.7247, train_acc=0.3694, test_acc=0.4465 [adam][aggressive][epoch 4] train_loss=1.6994, train_acc=0.3762, test_acc=0.4365 [adam][aggressive][epoch 5] train_loss=1.6984, train_acc=0.3784, test_acc=0.4367 [adam][aggressive][epoch 6] train_loss=1.6805, train_acc=0.3851, test_acc=0.4524 [adam][aggressive][epoch 7] train_loss=1.6757, train_acc=0.3902, test_acc=0.4264 [adam][aggressive][epoch 8] train_loss=1.6852, train_acc=0.3837, test_acc=0.4287 [adam][aggressive][epoch 9] train_loss=1.6674, train_acc=0.3918, test_acc=0.4576 [adam][aggressive][epoch 10] train_loss=1.6614, train_acc=0.3929, test_acc=0.4195 [adam][aggressive][epoch 11] train_loss=1.6710, train_acc=0.3891, test_acc=0.4564 [adam][aggressive][epoch 12] train_loss=1.6781, train_acc=0.3856, test_acc=0.3965 [adam][aggressive][epoch 13] train_loss=1.6682, train_acc=0.3879, test_acc=0.3940 [adam][aggressive][epoch 14] train_loss=1.6546, train_acc=0.3930, test_acc=0.4598 [adam][aggressive][epoch 15] train_loss=1.6645, train_acc=0.3913, test_acc=0.4527 [adam][aggressive][epoch 16] train_loss=1.6632, train_acc=0.3918, test_acc=0.4523 [adam][aggressive][epoch 17] train_loss=1.6621, train_acc=0.3942, test_acc=0.4648 [adam][aggressive][epoch 18] train_loss=1.6693, train_acc=0.3915, test_acc=0.4499 [adam][aggressive][epoch 19] train_loss=1.6572, train_acc=0.3933, test_acc=0.4209 [adam][aggressive][epoch 20] train_loss=1.6555, train_acc=0.3930, test_acc=0.4500 SEED 123 Files already downloaded and verified Files already downloaded and verified [sgd][none][epoch 1] train_loss=1.9336, train_acc=0.2973, test_acc=0.4190 [sgd][none][epoch 2] train_loss=1.5059, train_acc=0.4574, test_acc=0.4962 [sgd][none][epoch 3] train_loss=1.3496, train_acc=0.5174, test_acc=0.5525 [sgd][none][epoch 4] train_loss=1.2513, train_acc=0.5546, test_acc=0.5781 [sgd][none][epoch 5] train_loss=1.1647, train_acc=0.5883, test_acc=0.6106 [sgd][none][epoch 6] train_loss=1.0901, train_acc=0.6127, test_acc=0.6397 [sgd][none][epoch 7] train_loss=1.0262, train_acc=0.6359, test_acc=0.6398 [sgd][none][epoch 8] train_loss=0.9832, train_acc=0.6515, test_acc=0.6642 [sgd][none][epoch 9] train_loss=0.9299, train_acc=0.6718, test_acc=0.6715 [sgd][none][epoch 10] train_loss=0.8931, train_acc=0.6846, test_acc=0.6734 [sgd][none][epoch 11] train_loss=0.8506, train_acc=0.6991, test_acc=0.6856 [sgd][none][epoch 12] train_loss=0.8163, train_acc=0.7120, test_acc=0.6771 [sgd][none][epoch 13] train_loss=0.7825, train_acc=0.7232, test_acc=0.6900 [sgd][none][epoch 14] train_loss=0.7470, train_acc=0.7376, test_acc=0.6945 [sgd][none][epoch 15] train_loss=0.7195, train_acc=0.7479, test_acc=0.6951 [sgd][none][epoch 16] train_loss=0.6972, train_acc=0.7545, test_acc=0.6973 [sgd][none][epoch 17] train_loss=0.6697, train_acc=0.7627, test_acc=0.6851 [sgd][none][epoch 18] train_loss=0.6414, train_acc=0.7776, test_acc=0.6949 [sgd][none][epoch 19] train_loss=0.6034, train_acc=0.7887, test_acc=0.6954 [sgd][none][epoch 20] train_loss=0.5873, train_acc=0.7941, test_acc=0.7002 Files already downloaded and verified Files already downloaded and verified [sgd][standard][epoch 1] train_loss=2.0545, train_acc=0.2484, test_acc=0.3766 [sgd][standard][epoch 2] train_loss=1.7023, train_acc=0.3811, test_acc=0.4511 [sgd][standard][epoch 3] train_loss=1.5391, train_acc=0.4401, test_acc=0.5054 [sgd][standard][epoch 4] train_loss=1.4802, train_acc=0.4615, test_acc=0.5222 [sgd][standard][epoch 5] train_loss=1.4121, train_acc=0.4886, test_acc=0.5524 [sgd][standard][epoch 6] train_loss=1.3602, train_acc=0.5106, test_acc=0.5765 [sgd][standard][epoch 7] train_loss=1.3003, train_acc=0.5304, test_acc=0.5892 [sgd][standard][epoch 8] train_loss=1.2587, train_acc=0.5499, test_acc=0.6125 [sgd][standard][epoch 9] train_loss=1.2182, train_acc=0.5647, test_acc=0.6210 [sgd][standard][epoch 10] train_loss=1.1902, train_acc=0.5738, test_acc=0.6269 [sgd][standard][epoch 11] train_loss=1.1583, train_acc=0.5865, test_acc=0.6385 [sgd][standard][epoch 12] train_loss=1.1428, train_acc=0.5913, test_acc=0.6493 [sgd][standard][epoch 13] train_loss=1.1167, train_acc=0.6027, test_acc=0.6567 [sgd][standard][epoch 14] train_loss=1.1067, train_acc=0.6082, test_acc=0.6520 [sgd][standard][epoch 15] train_loss=1.0920, train_acc=0.6126, test_acc=0.6679 [sgd][standard][epoch 16] train_loss=1.0732, train_acc=0.6178, test_acc=0.6692 [sgd][standard][epoch 17] train_loss=1.0547, train_acc=0.6266, test_acc=0.6852 [sgd][standard][epoch 18] train_loss=1.0448, train_acc=0.6293, test_acc=0.6878 [sgd][standard][epoch 19] train_loss=1.0325, train_acc=0.6332, test_acc=0.7026 [sgd][standard][epoch 20] train_loss=1.0181, train_acc=0.6410, test_acc=0.6951 Files already downloaded and verified Files already downloaded and verified [sgd][aggressive][epoch 1] train_loss=2.0804, train_acc=0.2300, test_acc=0.3649 [sgd][aggressive][epoch 2] train_loss=1.7951, train_acc=0.3517, test_acc=0.4536 [sgd][aggressive][epoch 3] train_loss=1.6375, train_acc=0.4064, test_acc=0.4924 [sgd][aggressive][epoch 4] train_loss=1.5572, train_acc=0.4352, test_acc=0.5132 [sgd][aggressive][epoch 5] train_loss=1.5133, train_acc=0.4531, test_acc=0.5399 [sgd][aggressive][epoch 6] train_loss=1.4705, train_acc=0.4701, test_acc=0.5457 [sgd][aggressive][epoch 7] train_loss=1.4199, train_acc=0.4887, test_acc=0.5757 [sgd][aggressive][epoch 8] train_loss=1.3825, train_acc=0.5033, test_acc=0.5862 [sgd][aggressive][epoch 9] train_loss=1.3494, train_acc=0.5169, test_acc=0.6043 [sgd][aggressive][epoch 10] train_loss=1.3266, train_acc=0.5264, test_acc=0.6032 [sgd][aggressive][epoch 11] train_loss=1.2990, train_acc=0.5361, test_acc=0.6181 [sgd][aggressive][epoch 12] train_loss=1.2720, train_acc=0.5476, test_acc=0.6288 [sgd][aggressive][epoch 13] train_loss=1.2523, train_acc=0.5540, test_acc=0.6344 [sgd][aggressive][epoch 14] train_loss=1.2364, train_acc=0.5605, test_acc=0.6526 [sgd][aggressive][epoch 15] train_loss=1.2198, train_acc=0.5675, test_acc=0.6531 [sgd][aggressive][epoch 16] train_loss=1.2122, train_acc=0.5668, test_acc=0.6472 [sgd][aggressive][epoch 17] train_loss=1.1860, train_acc=0.5809, test_acc=0.6590 [sgd][aggressive][epoch 18] train_loss=1.1860, train_acc=0.5799, test_acc=0.6720 [sgd][aggressive][epoch 19] train_loss=1.1793, train_acc=0.5787, test_acc=0.6784 [sgd][aggressive][epoch 20] train_loss=1.1562, train_acc=0.5907, test_acc=0.6766 Files already downloaded and verified Files already downloaded and verified [adam][none][epoch 1] train_loss=1.8579, train_acc=0.3239, test_acc=0.4313 [adam][none][epoch 2] train_loss=1.6378, train_acc=0.4044, test_acc=0.4396 [adam][none][epoch 3] train_loss=1.5882, train_acc=0.4174, test_acc=0.4484 [adam][none][epoch 4] train_loss=1.5531, train_acc=0.4360, test_acc=0.4586 [adam][none][epoch 5] train_loss=1.5475, train_acc=0.4318, test_acc=0.4727 [adam][none][epoch 6] train_loss=1.5150, train_acc=0.4496, test_acc=0.4750 [adam][none][epoch 7] train_loss=1.5142, train_acc=0.4444, test_acc=0.4691 [adam][none][epoch 8] train_loss=1.5065, train_acc=0.4478, test_acc=0.4814 [adam][none][epoch 9] train_loss=1.4982, train_acc=0.4532, test_acc=0.4788 [adam][none][epoch 10] train_loss=1.4954, train_acc=0.4547, test_acc=0.4955 [adam][none][epoch 11] train_loss=1.4775, train_acc=0.4600, test_acc=0.5074 [adam][none][epoch 12] train_loss=1.4788, train_acc=0.4620, test_acc=0.4806 [adam][none][epoch 13] train_loss=1.4817, train_acc=0.4599, test_acc=0.4875 [adam][none][epoch 14] train_loss=1.4779, train_acc=0.4611, test_acc=0.5107 [adam][none][epoch 15] train_loss=1.4713, train_acc=0.4660, test_acc=0.4893 [adam][none][epoch 16] train_loss=1.4835, train_acc=0.4611, test_acc=0.4853 [adam][none][epoch 17] train_loss=1.4730, train_acc=0.4616, test_acc=0.4960 [adam][none][epoch 18] train_loss=1.4708, train_acc=0.4648, test_acc=0.4778 [adam][none][epoch 19] train_loss=1.4695, train_acc=0.4686, test_acc=0.5112 [adam][none][epoch 20] train_loss=1.4658, train_acc=0.4660, test_acc=0.4857 Files already downloaded and verified Files already downloaded and verified [adam][standard][epoch 1] train_loss=2.0278, train_acc=0.2494, test_acc=0.3251 [adam][standard][epoch 2] train_loss=1.8144, train_acc=0.3310, test_acc=0.4045 [adam][standard][epoch 3] train_loss=1.7265, train_acc=0.3622, test_acc=0.4111 [adam][standard][epoch 4] train_loss=1.6720, train_acc=0.3814, test_acc=0.4100 [adam][standard][epoch 5] train_loss=1.6580, train_acc=0.3885, test_acc=0.4350 [adam][standard][epoch 6] train_loss=1.6298, train_acc=0.3997, test_acc=0.4597 [adam][standard][epoch 7] train_loss=1.6190, train_acc=0.4032, test_acc=0.4422 [adam][standard][epoch 8] train_loss=1.6199, train_acc=0.4080, test_acc=0.4565 [adam][standard][epoch 9] train_loss=1.6146, train_acc=0.4075, test_acc=0.4629 [adam][standard][epoch 10] train_loss=1.6216, train_acc=0.4045, test_acc=0.4081 [adam][standard][epoch 11] train_loss=1.6055, train_acc=0.4083, test_acc=0.4358 [adam][standard][epoch 12] train_loss=1.6176, train_acc=0.4069, test_acc=0.4722 [adam][standard][epoch 13] train_loss=1.5999, train_acc=0.4124, test_acc=0.4715 [adam][standard][epoch 14] train_loss=1.5934, train_acc=0.4140, test_acc=0.4626 [adam][standard][epoch 15] train_loss=1.5934, train_acc=0.4137, test_acc=0.4468 [adam][standard][epoch 16] train_loss=1.5965, train_acc=0.4130, test_acc=0.4670 [adam][standard][epoch 17] train_loss=1.6136, train_acc=0.4071, test_acc=0.4527 [adam][standard][epoch 18] train_loss=1.5965, train_acc=0.4156, test_acc=0.4593 [adam][standard][epoch 19] train_loss=1.5915, train_acc=0.4165, test_acc=0.4642 [adam][standard][epoch 20] train_loss=1.5891, train_acc=0.4160, test_acc=0.4536 Files already downloaded and verified Files already downloaded and verified [adam][aggressive][epoch 1] train_loss=2.0048, train_acc=0.2625, test_acc=0.3807 [adam][aggressive][epoch 2] train_loss=1.8032, train_acc=0.3402, test_acc=0.4277 [adam][aggressive][epoch 3] train_loss=1.7539, train_acc=0.3595, test_acc=0.4400 [adam][aggressive][epoch 4] train_loss=1.7228, train_acc=0.3677, test_acc=0.4412 [adam][aggressive][epoch 5] train_loss=1.7074, train_acc=0.3770, test_acc=0.4460 [adam][aggressive][epoch 6] train_loss=1.6873, train_acc=0.3853, test_acc=0.4534 [adam][aggressive][epoch 7] train_loss=1.6828, train_acc=0.3875, test_acc=0.4678 [adam][aggressive][epoch 8] train_loss=1.6679, train_acc=0.3955, test_acc=0.4569 [adam][aggressive][epoch 9] train_loss=1.6778, train_acc=0.3893, test_acc=0.4535 [adam][aggressive][epoch 10] train_loss=1.6620, train_acc=0.3933, test_acc=0.4733 [adam][aggressive][epoch 11] train_loss=1.6635, train_acc=0.3955, test_acc=0.4761 [adam][aggressive][epoch 12] train_loss=1.6477, train_acc=0.3989, test_acc=0.4825 [adam][aggressive][epoch 13] train_loss=1.6429, train_acc=0.4028, test_acc=0.4554 [adam][aggressive][epoch 14] train_loss=1.6476, train_acc=0.4008, test_acc=0.4971 [adam][aggressive][epoch 15] train_loss=1.6472, train_acc=0.3994, test_acc=0.4897 [adam][aggressive][epoch 16] train_loss=1.6327, train_acc=0.4031, test_acc=0.4766 [adam][aggressive][epoch 17] train_loss=1.6346, train_acc=0.4026, test_acc=0.4602 [adam][aggressive][epoch 18] train_loss=1.6377, train_acc=0.4003, test_acc=0.4795 [adam][aggressive][epoch 19] train_loss=1.6307, train_acc=0.4048, test_acc=0.4869 [adam][aggressive][epoch 20] train_loss=1.6381, train_acc=0.4030, test_acc=0.4542 SEED 999 Files already downloaded and verified Files already downloaded and verified [sgd][none][epoch 1] train_loss=1.9614, train_acc=0.2839, test_acc=0.4046 [sgd][none][epoch 2] train_loss=1.5448, train_acc=0.4462, test_acc=0.4981 [sgd][none][epoch 3] train_loss=1.3840, train_acc=0.5048, test_acc=0.5481 [sgd][none][epoch 4] train_loss=1.2757, train_acc=0.5418, test_acc=0.5712 [sgd][none][epoch 5] train_loss=1.1857, train_acc=0.5770, test_acc=0.5998 [sgd][none][epoch 6] train_loss=1.1045, train_acc=0.6085, test_acc=0.6177 [sgd][none][epoch 7] train_loss=1.0466, train_acc=0.6309, test_acc=0.6266 [sgd][none][epoch 8] train_loss=0.9939, train_acc=0.6514, test_acc=0.6429 [sgd][none][epoch 9] train_loss=0.9526, train_acc=0.6655, test_acc=0.6542 [sgd][none][epoch 10] train_loss=0.9012, train_acc=0.6840, test_acc=0.6643 [sgd][none][epoch 11] train_loss=0.8650, train_acc=0.6964, test_acc=0.6760 [sgd][none][epoch 12] train_loss=0.8224, train_acc=0.7095, test_acc=0.6767 [sgd][none][epoch 13] train_loss=0.7874, train_acc=0.7230, test_acc=0.6790 [sgd][none][epoch 14] train_loss=0.7571, train_acc=0.7337, test_acc=0.6858 [sgd][none][epoch 15] train_loss=0.7221, train_acc=0.7464, test_acc=0.6937 [sgd][none][epoch 16] train_loss=0.6927, train_acc=0.7568, test_acc=0.6978 [sgd][none][epoch 17] train_loss=0.6688, train_acc=0.7631, test_acc=0.7009 [sgd][none][epoch 18] train_loss=0.6569, train_acc=0.7690, test_acc=0.6999 [sgd][none][epoch 19] train_loss=0.6169, train_acc=0.7803, test_acc=0.6992 [sgd][none][epoch 20] train_loss=0.5989, train_acc=0.7879, test_acc=0.6961 Files already downloaded and verified Files already downloaded and verified [sgd][standard][epoch 1] train_loss=2.0310, train_acc=0.2551, test_acc=0.3568 [sgd][standard][epoch 2] train_loss=1.7172, train_acc=0.3778, test_acc=0.4514 [sgd][standard][epoch 3] train_loss=1.5605, train_acc=0.4315, test_acc=0.4787 [sgd][standard][epoch 4] train_loss=1.4770, train_acc=0.4596, test_acc=0.5318 [sgd][standard][epoch 5] train_loss=1.4138, train_acc=0.4877, test_acc=0.5538 [sgd][standard][epoch 6] train_loss=1.3561, train_acc=0.5129, test_acc=0.5827 [sgd][standard][epoch 7] train_loss=1.3055, train_acc=0.5291, test_acc=0.6042 [sgd][standard][epoch 8] train_loss=1.2567, train_acc=0.5527, test_acc=0.6148 [sgd][standard][epoch 9] train_loss=1.2256, train_acc=0.5610, test_acc=0.6215 [sgd][standard][epoch 10] train_loss=1.1950, train_acc=0.5733, test_acc=0.6431 [sgd][standard][epoch 11] train_loss=1.1655, train_acc=0.5847, test_acc=0.6515 [sgd][standard][epoch 12] train_loss=1.1399, train_acc=0.5936, test_acc=0.6378 [sgd][standard][epoch 13] train_loss=1.1240, train_acc=0.6021, test_acc=0.6656 [sgd][standard][epoch 14] train_loss=1.1052, train_acc=0.6086, test_acc=0.6585 [sgd][standard][epoch 15] train_loss=1.0886, train_acc=0.6120, test_acc=0.6714 [sgd][standard][epoch 16] train_loss=1.0744, train_acc=0.6197, test_acc=0.6851 [sgd][standard][epoch 17] train_loss=1.0608, train_acc=0.6246, test_acc=0.6838 [sgd][standard][epoch 18] train_loss=1.0403, train_acc=0.6299, test_acc=0.6894 [sgd][standard][epoch 19] train_loss=1.0399, train_acc=0.6298, test_acc=0.6966 [sgd][standard][epoch 20] train_loss=1.0233, train_acc=0.6382, test_acc=0.6896 Files already downloaded and verified Files already downloaded and verified [sgd][aggressive][epoch 1] train_loss=2.0627, train_acc=0.2416, test_acc=0.3478 [sgd][aggressive][epoch 2] train_loss=1.7933, train_acc=0.3513, test_acc=0.4216 [sgd][aggressive][epoch 3] train_loss=1.6581, train_acc=0.3992, test_acc=0.4786 [sgd][aggressive][epoch 4] train_loss=1.5639, train_acc=0.4357, test_acc=0.5008 [sgd][aggressive][epoch 5] train_loss=1.5055, train_acc=0.4540, test_acc=0.5423 [sgd][aggressive][epoch 6] train_loss=1.4502, train_acc=0.4790, test_acc=0.5579 [sgd][aggressive][epoch 7] train_loss=1.4208, train_acc=0.4934, test_acc=0.5692 [sgd][aggressive][epoch 8] train_loss=1.3702, train_acc=0.5092, test_acc=0.5956 [sgd][aggressive][epoch 9] train_loss=1.3449, train_acc=0.5183, test_acc=0.6007 [sgd][aggressive][epoch 10] train_loss=1.3101, train_acc=0.5339, test_acc=0.6170 [sgd][aggressive][epoch 11] train_loss=1.2958, train_acc=0.5399, test_acc=0.6201 [sgd][aggressive][epoch 12] train_loss=1.2760, train_acc=0.5451, test_acc=0.6332 [sgd][aggressive][epoch 13] train_loss=1.2568, train_acc=0.5538, test_acc=0.6380 [sgd][aggressive][epoch 14] train_loss=1.2407, train_acc=0.5593, test_acc=0.6393 [sgd][aggressive][epoch 15] train_loss=1.2321, train_acc=0.5595, test_acc=0.6450 [sgd][aggressive][epoch 16] train_loss=1.2164, train_acc=0.5673, test_acc=0.6538 [sgd][aggressive][epoch 17] train_loss=1.2027, train_acc=0.5725, test_acc=0.6540 [sgd][aggressive][epoch 18] train_loss=1.1870, train_acc=0.5768, test_acc=0.6696 [sgd][aggressive][epoch 19] train_loss=1.1842, train_acc=0.5796, test_acc=0.6555 [sgd][aggressive][epoch 20] train_loss=1.1647, train_acc=0.5845, test_acc=0.6630 Files already downloaded and verified Files already downloaded and verified [adam][none][epoch 1] train_loss=1.8653, train_acc=0.3280, test_acc=0.3995 [adam][none][epoch 2] train_loss=1.6121, train_acc=0.4129, test_acc=0.4098 [adam][none][epoch 3] train_loss=1.5402, train_acc=0.4404, test_acc=0.4697 [adam][none][epoch 4] train_loss=1.5276, train_acc=0.4490, test_acc=0.4802 [adam][none][epoch 5] train_loss=1.4979, train_acc=0.4543, test_acc=0.4818 [adam][none][epoch 6] train_loss=1.4916, train_acc=0.4601, test_acc=0.4988 [adam][none][epoch 7] train_loss=1.4729, train_acc=0.4647, test_acc=0.4972 [adam][none][epoch 8] train_loss=1.4770, train_acc=0.4638, test_acc=0.4687 [adam][none][epoch 9] train_loss=1.4653, train_acc=0.4690, test_acc=0.4816 [adam][none][epoch 10] train_loss=1.4635, train_acc=0.4718, test_acc=0.4935 [adam][none][epoch 11] train_loss=1.4643, train_acc=0.4703, test_acc=0.4782 [adam][none][epoch 12] train_loss=1.4603, train_acc=0.4717, test_acc=0.4873 [adam][none][epoch 13] train_loss=1.4479, train_acc=0.4763, test_acc=0.4706 [adam][none][epoch 14] train_loss=1.4543, train_acc=0.4767, test_acc=0.5077 [adam][none][epoch 15] train_loss=1.4511, train_acc=0.4727, test_acc=0.5074 [adam][none][epoch 16] train_loss=1.4691, train_acc=0.4710, test_acc=0.5053 [adam][none][epoch 17] train_loss=1.4495, train_acc=0.4772, test_acc=0.5045 [adam][none][epoch 18] train_loss=1.4601, train_acc=0.4717, test_acc=0.5149 [adam][none][epoch 19] train_loss=1.4620, train_acc=0.4741, test_acc=0.5031 [adam][none][epoch 20] train_loss=1.4535, train_acc=0.4741, test_acc=0.5189 Files already downloaded and verified Files already downloaded and verified [adam][standard][epoch 1] train_loss=1.9290, train_acc=0.2975, test_acc=0.4071 [adam][standard][epoch 2] train_loss=1.7239, train_acc=0.3633, test_acc=0.3631 [adam][standard][epoch 3] train_loss=1.6749, train_acc=0.3821, test_acc=0.4274 [adam][standard][epoch 4] train_loss=1.6455, train_acc=0.3956, test_acc=0.4514 [adam][standard][epoch 5] train_loss=1.6245, train_acc=0.4029, test_acc=0.4313 [adam][standard][epoch 6] train_loss=1.6053, train_acc=0.4100, test_acc=0.4484 [adam][standard][epoch 7] train_loss=1.6106, train_acc=0.4080, test_acc=0.4302 [adam][standard][epoch 8] train_loss=1.5953, train_acc=0.4148, test_acc=0.4639 [adam][standard][epoch 9] train_loss=1.5825, train_acc=0.4168, test_acc=0.4662 [adam][standard][epoch 10] train_loss=1.5836, train_acc=0.4205, test_acc=0.4595 [adam][standard][epoch 11] train_loss=1.5734, train_acc=0.4241, test_acc=0.4862 [adam][standard][epoch 12] train_loss=1.5816, train_acc=0.4209, test_acc=0.4603 [adam][standard][epoch 13] train_loss=1.5812, train_acc=0.4215, test_acc=0.4889 [adam][standard][epoch 14] train_loss=1.5848, train_acc=0.4202, test_acc=0.4823 [adam][standard][epoch 15] train_loss=1.5768, train_acc=0.4227, test_acc=0.4809 [adam][standard][epoch 16] train_loss=1.5763, train_acc=0.4241, test_acc=0.4911 [adam][standard][epoch 17] train_loss=1.5560, train_acc=0.4306, test_acc=0.4727 [adam][standard][epoch 18] train_loss=1.5524, train_acc=0.4348, test_acc=0.4581 [adam][standard][epoch 19] train_loss=1.5581, train_acc=0.4291, test_acc=0.4822 [adam][standard][epoch 20] train_loss=1.5584, train_acc=0.4282, test_acc=0.4934 Files already downloaded and verified Files already downloaded and verified [adam][aggressive][epoch 1] train_loss=2.0259, train_acc=0.2653, test_acc=0.3501 [adam][aggressive][epoch 2] train_loss=1.8678, train_acc=0.3130, test_acc=0.3679 [adam][aggressive][epoch 3] train_loss=1.8263, train_acc=0.3308, test_acc=0.3729 [adam][aggressive][epoch 4] train_loss=1.8109, train_acc=0.3348, test_acc=0.3847 [adam][aggressive][epoch 5] train_loss=1.7937, train_acc=0.3411, test_acc=0.3855 [adam][aggressive][epoch 6] train_loss=1.7862, train_acc=0.3438, test_acc=0.3771 [adam][aggressive][epoch 7] train_loss=1.7757, train_acc=0.3419, test_acc=0.3899 [adam][aggressive][epoch 8] train_loss=1.7809, train_acc=0.3414, test_acc=0.3915 [adam][aggressive][epoch 9] train_loss=1.7794, train_acc=0.3387, test_acc=0.3913 [adam][aggressive][epoch 10] train_loss=1.7733, train_acc=0.3430, test_acc=0.3706 [adam][aggressive][epoch 11] train_loss=1.7688, train_acc=0.3444, test_acc=0.3919 [adam][aggressive][epoch 12] train_loss=1.7673, train_acc=0.3452, test_acc=0.4055 [adam][aggressive][epoch 13] train_loss=1.7586, train_acc=0.3477, test_acc=0.4183 [adam][aggressive][epoch 14] train_loss=1.7682, train_acc=0.3431, test_acc=0.3904 [adam][aggressive][epoch 15] train_loss=1.7510, train_acc=0.3507, test_acc=0.3796 [adam][aggressive][epoch 16] train_loss=1.7584, train_acc=0.3480, test_acc=0.3948 [adam][aggressive][epoch 17] train_loss=1.7581, train_acc=0.3510, test_acc=0.4044 [adam][aggressive][epoch 18] train_loss=1.7501, train_acc=0.3506, test_acc=0.4180 [adam][aggressive][epoch 19] train_loss=1.7574, train_acc=0.3461, test_acc=0.4032 [adam][aggressive][epoch 20] train_loss=1.7578, train_acc=0.3469, test_acc=0.4039 saved results to results.json anova on test accuracy: sum_sq df F PR(>F) C(optimizer) 0.201909 1.0 366.885184 2.308516e-10 C(augmentation) 0.010412 2.0 9.459614 3.417556e-03 C(optimizer):C(augmentation) 0.002980 2.0 2.707481 1.070415e-01 Residual 0.006604 12.0 NaN NaN saved plot to test_acc_comparison.png Message sent successfully! python main.py --analyze /usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:138: UserWarning: CUDA initialization: CUDA driver initialization failed, you might not have a CUDA gpu. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0 Message sent successfully! Namespace(batch_size=128, lr=0.01, epochs=20, analyze=True) SEED 42 Files already downloaded and verified Files already downloaded and verified [sgd][none][epoch 1] train_loss=2.0053, train_acc=0.2661, test_acc=0.3923 [sgd][none][epoch 2] train_loss=1.5552, train_acc=0.4410, test_acc=0.4985 [sgd][none][epoch 3] train_loss=1.3659, train_acc=0.5116, test_acc=0.5425 [sgd][none][epoch 4] train_loss=1.2634, train_acc=0.5483, test_acc=0.5884 [sgd][none][epoch 5] train_loss=1.1752, train_acc=0.5810, test_acc=0.5867 [sgd][none][epoch 6] train_loss=1.0963, train_acc=0.6116, test_acc=0.6368 [sgd][none][epoch 7] train_loss=1.0310, train_acc=0.6359, test_acc=0.6424 [sgd][none][epoch 8] train_loss=0.9726, train_acc=0.6574, test_acc=0.6589 [sgd][none][epoch 9] train_loss=0.9323, train_acc=0.6723, test_acc=0.6647 [sgd][none][epoch 10] train_loss=0.8843, train_acc=0.6885, test_acc=0.6754 [sgd][none][epoch 11] train_loss=0.8454, train_acc=0.7028, test_acc=0.6839 [sgd][none][epoch 12] train_loss=0.8084, train_acc=0.7146, test_acc=0.6844 [sgd][none][epoch 13] train_loss=0.7736, train_acc=0.7275, test_acc=0.6905 [sgd][none][epoch 14] train_loss=0.7405, train_acc=0.7391, test_acc=0.6847 [sgd][none][epoch 15] train_loss=0.7178, train_acc=0.7473, test_acc=0.7029