python main.py
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:138: UserWarning: CUDA initialization: CUDA driver initialization failed, you might not have a CUDA gpu. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.)
  return torch._C._cuda_getDeviceCount() > 0
Message sent successfully!
Namespace(batch_size=128, lr=0.01, epochs=20, analyze=False)
SEED 42
Files already downloaded and verified
Files already downloaded and verified
[sgd][none][epoch 1] train_loss=2.0053, train_acc=0.2661, test_acc=0.3923
[sgd][none][epoch 2] train_loss=1.5552, train_acc=0.4410, test_acc=0.4985
[sgd][none][epoch 3] train_loss=1.3659, train_acc=0.5116, test_acc=0.5425
[sgd][none][epoch 4] train_loss=1.2634, train_acc=0.5483, test_acc=0.5884
[sgd][none][epoch 5] train_loss=1.1752, train_acc=0.5810, test_acc=0.5867
[sgd][none][epoch 6] train_loss=1.0963, train_acc=0.6116, test_acc=0.6368
[sgd][none][epoch 7] train_loss=1.0310, train_acc=0.6359, test_acc=0.6424
[sgd][none][epoch 8] train_loss=0.9726, train_acc=0.6574, test_acc=0.6589
[sgd][none][epoch 9] train_loss=0.9323, train_acc=0.6723, test_acc=0.6647
[sgd][none][epoch 10] train_loss=0.8843, train_acc=0.6885, test_acc=0.6754
[sgd][none][epoch 11] train_loss=0.8454, train_acc=0.7028, test_acc=0.6839
[sgd][none][epoch 12] train_loss=0.8084, train_acc=0.7146, test_acc=0.6844
[sgd][none][epoch 13] train_loss=0.7736, train_acc=0.7275, test_acc=0.6905
[sgd][none][epoch 14] train_loss=0.7405, train_acc=0.7391, test_acc=0.6847
[sgd][none][epoch 15] train_loss=0.7178, train_acc=0.7473, test_acc=0.7029
[sgd][none][epoch 16] train_loss=0.6816, train_acc=0.7612, test_acc=0.6944
[sgd][none][epoch 17] train_loss=0.6591, train_acc=0.7693, test_acc=0.6946
[sgd][none][epoch 18] train_loss=0.6324, train_acc=0.7770, test_acc=0.7046
[sgd][none][epoch 19] train_loss=0.6078, train_acc=0.7846, test_acc=0.7003
[sgd][none][epoch 20] train_loss=0.5815, train_acc=0.7935, test_acc=0.7013
Files already downloaded and verified
Files already downloaded and verified
[sgd][standard][epoch 1] train_loss=2.0359, train_acc=0.2552, test_acc=0.3902
[sgd][standard][epoch 2] train_loss=1.7088, train_acc=0.3825, test_acc=0.4608
[sgd][standard][epoch 3] train_loss=1.5394, train_acc=0.4392, test_acc=0.5077
[sgd][standard][epoch 4] train_loss=1.4547, train_acc=0.4723, test_acc=0.5314
[sgd][standard][epoch 5] train_loss=1.3847, train_acc=0.5011, test_acc=0.5736
[sgd][standard][epoch 6] train_loss=1.3219, train_acc=0.5217, test_acc=0.5886
[sgd][standard][epoch 7] train_loss=1.2655, train_acc=0.5445, test_acc=0.6200
[sgd][standard][epoch 8] train_loss=1.2301, train_acc=0.5609, test_acc=0.6150
[sgd][standard][epoch 9] train_loss=1.1942, train_acc=0.5754, test_acc=0.6317
[sgd][standard][epoch 10] train_loss=1.1679, train_acc=0.5827, test_acc=0.6496
[sgd][standard][epoch 11] train_loss=1.1530, train_acc=0.5874, test_acc=0.6523
[sgd][standard][epoch 12] train_loss=1.1209, train_acc=0.5995, test_acc=0.6542
[sgd][standard][epoch 13] train_loss=1.1006, train_acc=0.6071, test_acc=0.6636
[sgd][standard][epoch 14] train_loss=1.0869, train_acc=0.6130, test_acc=0.6743
[sgd][standard][epoch 15] train_loss=1.0667, train_acc=0.6217, test_acc=0.6889
[sgd][standard][epoch 16] train_loss=1.0647, train_acc=0.6233, test_acc=0.6859
[sgd][standard][epoch 17] train_loss=1.0438, train_acc=0.6297, test_acc=0.6906
[sgd][standard][epoch 18] train_loss=1.0385, train_acc=0.6304, test_acc=0.6939
[sgd][standard][epoch 19] train_loss=1.0160, train_acc=0.6405, test_acc=0.6895
[sgd][standard][epoch 20] train_loss=1.0132, train_acc=0.6407, test_acc=0.6791
Files already downloaded and verified
Files already downloaded and verified
[sgd][aggressive][epoch 1] train_loss=2.0499, train_acc=0.2434, test_acc=0.3315
[sgd][aggressive][epoch 2] train_loss=1.7751, train_acc=0.3580, test_acc=0.4525
[sgd][aggressive][epoch 3] train_loss=1.6295, train_acc=0.4092, test_acc=0.4708
[sgd][aggressive][epoch 4] train_loss=1.5567, train_acc=0.4379, test_acc=0.5272
[sgd][aggressive][epoch 5] train_loss=1.5069, train_acc=0.4563, test_acc=0.5268
[sgd][aggressive][epoch 6] train_loss=1.4473, train_acc=0.4804, test_acc=0.5427
[sgd][aggressive][epoch 7] train_loss=1.4167, train_acc=0.4912, test_acc=0.5828
[sgd][aggressive][epoch 8] train_loss=1.3933, train_acc=0.5006, test_acc=0.5861
[sgd][aggressive][epoch 9] train_loss=1.3540, train_acc=0.5145, test_acc=0.6093
[sgd][aggressive][epoch 10] train_loss=1.3268, train_acc=0.5279, test_acc=0.6262
[sgd][aggressive][epoch 11] train_loss=1.2946, train_acc=0.5374, test_acc=0.6210
[sgd][aggressive][epoch 12] train_loss=1.2794, train_acc=0.5441, test_acc=0.6339
[sgd][aggressive][epoch 13] train_loss=1.2606, train_acc=0.5517, test_acc=0.6379
[sgd][aggressive][epoch 14] train_loss=1.2452, train_acc=0.5571, test_acc=0.6558
[sgd][aggressive][epoch 15] train_loss=1.2263, train_acc=0.5650, test_acc=0.6631
[sgd][aggressive][epoch 16] train_loss=1.2119, train_acc=0.5681, test_acc=0.6508
[sgd][aggressive][epoch 17] train_loss=1.2090, train_acc=0.5702, test_acc=0.6643
[sgd][aggressive][epoch 18] train_loss=1.1906, train_acc=0.5780, test_acc=0.6507
[sgd][aggressive][epoch 19] train_loss=1.1747, train_acc=0.5831, test_acc=0.6728
[sgd][aggressive][epoch 20] train_loss=1.1603, train_acc=0.5882, test_acc=0.6703
Files already downloaded and verified
Files already downloaded and verified
[adam][none][epoch 1] train_loss=1.7651, train_acc=0.3486, test_acc=0.4452
[adam][none][epoch 2] train_loss=1.4773, train_acc=0.4608, test_acc=0.4928
[adam][none][epoch 3] train_loss=1.4246, train_acc=0.4883, test_acc=0.5095
[adam][none][epoch 4] train_loss=1.3900, train_acc=0.4974, test_acc=0.5366
[adam][none][epoch 5] train_loss=1.3695, train_acc=0.5090, test_acc=0.5367
[adam][none][epoch 6] train_loss=1.3548, train_acc=0.5146, test_acc=0.5403
[adam][none][epoch 7] train_loss=1.3448, train_acc=0.5149, test_acc=0.5363
[adam][none][epoch 8] train_loss=1.3417, train_acc=0.5190, test_acc=0.5294
[adam][none][epoch 9] train_loss=1.3385, train_acc=0.5203, test_acc=0.5552
[adam][none][epoch 10] train_loss=1.3314, train_acc=0.5228, test_acc=0.5559
[adam][none][epoch 11] train_loss=1.3147, train_acc=0.5289, test_acc=0.5765
[adam][none][epoch 12] train_loss=1.3206, train_acc=0.5280, test_acc=0.5784
[adam][none][epoch 13] train_loss=1.3099, train_acc=0.5291, test_acc=0.5604
[adam][none][epoch 14] train_loss=1.3168, train_acc=0.5275, test_acc=0.5766
[adam][none][epoch 15] train_loss=1.3134, train_acc=0.5308, test_acc=0.5413
[adam][none][epoch 16] train_loss=1.3288, train_acc=0.5251, test_acc=0.5474
[adam][none][epoch 17] train_loss=1.3214, train_acc=0.5305, test_acc=0.5339
[adam][none][epoch 18] train_loss=1.3235, train_acc=0.5274, test_acc=0.5621
[adam][none][epoch 19] train_loss=1.3163, train_acc=0.5307, test_acc=0.5786
[adam][none][epoch 20] train_loss=1.3079, train_acc=0.5337, test_acc=0.5658
Files already downloaded and verified
Files already downloaded and verified
[adam][standard][epoch 1] train_loss=2.0309, train_acc=0.2476, test_acc=0.3421
[adam][standard][epoch 2] train_loss=1.7958, train_acc=0.3385, test_acc=0.3857
[adam][standard][epoch 3] train_loss=1.7349, train_acc=0.3550, test_acc=0.4019
[adam][standard][epoch 4] train_loss=1.7112, train_acc=0.3655, test_acc=0.4141
[adam][standard][epoch 5] train_loss=1.6914, train_acc=0.3727, test_acc=0.4395
[adam][standard][epoch 6] train_loss=1.6767, train_acc=0.3770, test_acc=0.3837
[adam][standard][epoch 7] train_loss=1.6701, train_acc=0.3838, test_acc=0.4161
[adam][standard][epoch 8] train_loss=1.6569, train_acc=0.3897, test_acc=0.4351
[adam][standard][epoch 9] train_loss=1.6578, train_acc=0.3908, test_acc=0.4555
[adam][standard][epoch 10] train_loss=1.6537, train_acc=0.3912, test_acc=0.4293
[adam][standard][epoch 11] train_loss=1.6380, train_acc=0.4010, test_acc=0.4145
[adam][standard][epoch 12] train_loss=1.6417, train_acc=0.3960, test_acc=0.3761
[adam][standard][epoch 13] train_loss=1.6474, train_acc=0.3965, test_acc=0.4443
[adam][standard][epoch 14] train_loss=1.6316, train_acc=0.4004, test_acc=0.4553
[adam][standard][epoch 15] train_loss=1.6246, train_acc=0.4048, test_acc=0.4794
[adam][standard][epoch 16] train_loss=1.6243, train_acc=0.4045, test_acc=0.4646
[adam][standard][epoch 17] train_loss=1.6160, train_acc=0.4067, test_acc=0.4644
[adam][standard][epoch 18] train_loss=1.6250, train_acc=0.4038, test_acc=0.4734
[adam][standard][epoch 19] train_loss=1.6166, train_acc=0.4085, test_acc=0.3933
[adam][standard][epoch 20] train_loss=1.6181, train_acc=0.4059, test_acc=0.4394
Files already downloaded and verified
Files already downloaded and verified
[adam][aggressive][epoch 1] train_loss=1.9924, train_acc=0.2727, test_acc=0.3942
[adam][aggressive][epoch 2] train_loss=1.7828, train_acc=0.3478, test_acc=0.4111
[adam][aggressive][epoch 3] train_loss=1.7247, train_acc=0.3694, test_acc=0.4465
[adam][aggressive][epoch 4] train_loss=1.6994, train_acc=0.3762, test_acc=0.4365
[adam][aggressive][epoch 5] train_loss=1.6984, train_acc=0.3784, test_acc=0.4367
[adam][aggressive][epoch 6] train_loss=1.6805, train_acc=0.3851, test_acc=0.4524
[adam][aggressive][epoch 7] train_loss=1.6757, train_acc=0.3902, test_acc=0.4264
[adam][aggressive][epoch 8] train_loss=1.6852, train_acc=0.3837, test_acc=0.4287
[adam][aggressive][epoch 9] train_loss=1.6674, train_acc=0.3918, test_acc=0.4576
[adam][aggressive][epoch 10] train_loss=1.6614, train_acc=0.3929, test_acc=0.4195
[adam][aggressive][epoch 11] train_loss=1.6710, train_acc=0.3891, test_acc=0.4564
[adam][aggressive][epoch 12] train_loss=1.6781, train_acc=0.3856, test_acc=0.3965
[adam][aggressive][epoch 13] train_loss=1.6682, train_acc=0.3879, test_acc=0.3940
[adam][aggressive][epoch 14] train_loss=1.6546, train_acc=0.3930, test_acc=0.4598
[adam][aggressive][epoch 15] train_loss=1.6645, train_acc=0.3913, test_acc=0.4527
[adam][aggressive][epoch 16] train_loss=1.6632, train_acc=0.3918, test_acc=0.4523
[adam][aggressive][epoch 17] train_loss=1.6621, train_acc=0.3942, test_acc=0.4648
[adam][aggressive][epoch 18] train_loss=1.6693, train_acc=0.3915, test_acc=0.4499
[adam][aggressive][epoch 19] train_loss=1.6572, train_acc=0.3933, test_acc=0.4209
[adam][aggressive][epoch 20] train_loss=1.6555, train_acc=0.3930, test_acc=0.4500
SEED 123
Files already downloaded and verified
Files already downloaded and verified
[sgd][none][epoch 1] train_loss=1.9336, train_acc=0.2973, test_acc=0.4190
[sgd][none][epoch 2] train_loss=1.5059, train_acc=0.4574, test_acc=0.4962
[sgd][none][epoch 3] train_loss=1.3496, train_acc=0.5174, test_acc=0.5525
[sgd][none][epoch 4] train_loss=1.2513, train_acc=0.5546, test_acc=0.5781
[sgd][none][epoch 5] train_loss=1.1647, train_acc=0.5883, test_acc=0.6106
[sgd][none][epoch 6] train_loss=1.0901, train_acc=0.6127, test_acc=0.6397
[sgd][none][epoch 7] train_loss=1.0262, train_acc=0.6359, test_acc=0.6398
[sgd][none][epoch 8] train_loss=0.9832, train_acc=0.6515, test_acc=0.6642
[sgd][none][epoch 9] train_loss=0.9299, train_acc=0.6718, test_acc=0.6715
[sgd][none][epoch 10] train_loss=0.8931, train_acc=0.6846, test_acc=0.6734
[sgd][none][epoch 11] train_loss=0.8506, train_acc=0.6991, test_acc=0.6856
[sgd][none][epoch 12] train_loss=0.8163, train_acc=0.7120, test_acc=0.6771
[sgd][none][epoch 13] train_loss=0.7825, train_acc=0.7232, test_acc=0.6900
[sgd][none][epoch 14] train_loss=0.7470, train_acc=0.7376, test_acc=0.6945
[sgd][none][epoch 15] train_loss=0.7195, train_acc=0.7479, test_acc=0.6951
[sgd][none][epoch 16] train_loss=0.6972, train_acc=0.7545, test_acc=0.6973
[sgd][none][epoch 17] train_loss=0.6697, train_acc=0.7627, test_acc=0.6851
[sgd][none][epoch 18] train_loss=0.6414, train_acc=0.7776, test_acc=0.6949
[sgd][none][epoch 19] train_loss=0.6034, train_acc=0.7887, test_acc=0.6954
[sgd][none][epoch 20] train_loss=0.5873, train_acc=0.7941, test_acc=0.7002
Files already downloaded and verified
Files already downloaded and verified
[sgd][standard][epoch 1] train_loss=2.0545, train_acc=0.2484, test_acc=0.3766
[sgd][standard][epoch 2] train_loss=1.7023, train_acc=0.3811, test_acc=0.4511
[sgd][standard][epoch 3] train_loss=1.5391, train_acc=0.4401, test_acc=0.5054
[sgd][standard][epoch 4] train_loss=1.4802, train_acc=0.4615, test_acc=0.5222
[sgd][standard][epoch 5] train_loss=1.4121, train_acc=0.4886, test_acc=0.5524
[sgd][standard][epoch 6] train_loss=1.3602, train_acc=0.5106, test_acc=0.5765
[sgd][standard][epoch 7] train_loss=1.3003, train_acc=0.5304, test_acc=0.5892
[sgd][standard][epoch 8] train_loss=1.2587, train_acc=0.5499, test_acc=0.6125
[sgd][standard][epoch 9] train_loss=1.2182, train_acc=0.5647, test_acc=0.6210
[sgd][standard][epoch 10] train_loss=1.1902, train_acc=0.5738, test_acc=0.6269
[sgd][standard][epoch 11] train_loss=1.1583, train_acc=0.5865, test_acc=0.6385
[sgd][standard][epoch 12] train_loss=1.1428, train_acc=0.5913, test_acc=0.6493
[sgd][standard][epoch 13] train_loss=1.1167, train_acc=0.6027, test_acc=0.6567
[sgd][standard][epoch 14] train_loss=1.1067, train_acc=0.6082, test_acc=0.6520
[sgd][standard][epoch 15] train_loss=1.0920, train_acc=0.6126, test_acc=0.6679
[sgd][standard][epoch 16] train_loss=1.0732, train_acc=0.6178, test_acc=0.6692
[sgd][standard][epoch 17] train_loss=1.0547, train_acc=0.6266, test_acc=0.6852
[sgd][standard][epoch 18] train_loss=1.0448, train_acc=0.6293, test_acc=0.6878
[sgd][standard][epoch 19] train_loss=1.0325, train_acc=0.6332, test_acc=0.7026
[sgd][standard][epoch 20] train_loss=1.0181, train_acc=0.6410, test_acc=0.6951
Files already downloaded and verified
Files already downloaded and verified
[sgd][aggressive][epoch 1] train_loss=2.0804, train_acc=0.2300, test_acc=0.3649
[sgd][aggressive][epoch 2] train_loss=1.7951, train_acc=0.3517, test_acc=0.4536
[sgd][aggressive][epoch 3] train_loss=1.6375, train_acc=0.4064, test_acc=0.4924
[sgd][aggressive][epoch 4] train_loss=1.5572, train_acc=0.4352, test_acc=0.5132
[sgd][aggressive][epoch 5] train_loss=1.5133, train_acc=0.4531, test_acc=0.5399
[sgd][aggressive][epoch 6] train_loss=1.4705, train_acc=0.4701, test_acc=0.5457
[sgd][aggressive][epoch 7] train_loss=1.4199, train_acc=0.4887, test_acc=0.5757
[sgd][aggressive][epoch 8] train_loss=1.3825, train_acc=0.5033, test_acc=0.5862
[sgd][aggressive][epoch 9] train_loss=1.3494, train_acc=0.5169, test_acc=0.6043
[sgd][aggressive][epoch 10] train_loss=1.3266, train_acc=0.5264, test_acc=0.6032
[sgd][aggressive][epoch 11] train_loss=1.2990, train_acc=0.5361, test_acc=0.6181
[sgd][aggressive][epoch 12] train_loss=1.2720, train_acc=0.5476, test_acc=0.6288
[sgd][aggressive][epoch 13] train_loss=1.2523, train_acc=0.5540, test_acc=0.6344
[sgd][aggressive][epoch 14] train_loss=1.2364, train_acc=0.5605, test_acc=0.6526
[sgd][aggressive][epoch 15] train_loss=1.2198, train_acc=0.5675, test_acc=0.6531
[sgd][aggressive][epoch 16] train_loss=1.2122, train_acc=0.5668, test_acc=0.6472
[sgd][aggressive][epoch 17] train_loss=1.1860, train_acc=0.5809, test_acc=0.6590
[sgd][aggressive][epoch 18] train_loss=1.1860, train_acc=0.5799, test_acc=0.6720
[sgd][aggressive][epoch 19] train_loss=1.1793, train_acc=0.5787, test_acc=0.6784
[sgd][aggressive][epoch 20] train_loss=1.1562, train_acc=0.5907, test_acc=0.6766
Files already downloaded and verified
Files already downloaded and verified
[adam][none][epoch 1] train_loss=1.8579, train_acc=0.3239, test_acc=0.4313
[adam][none][epoch 2] train_loss=1.6378, train_acc=0.4044, test_acc=0.4396
[adam][none][epoch 3] train_loss=1.5882, train_acc=0.4174, test_acc=0.4484
[adam][none][epoch 4] train_loss=1.5531, train_acc=0.4360, test_acc=0.4586
[adam][none][epoch 5] train_loss=1.5475, train_acc=0.4318, test_acc=0.4727
[adam][none][epoch 6] train_loss=1.5150, train_acc=0.4496, test_acc=0.4750
[adam][none][epoch 7] train_loss=1.5142, train_acc=0.4444, test_acc=0.4691
[adam][none][epoch 8] train_loss=1.5065, train_acc=0.4478, test_acc=0.4814
[adam][none][epoch 9] train_loss=1.4982, train_acc=0.4532, test_acc=0.4788
[adam][none][epoch 10] train_loss=1.4954, train_acc=0.4547, test_acc=0.4955
[adam][none][epoch 11] train_loss=1.4775, train_acc=0.4600, test_acc=0.5074
[adam][none][epoch 12] train_loss=1.4788, train_acc=0.4620, test_acc=0.4806
[adam][none][epoch 13] train_loss=1.4817, train_acc=0.4599, test_acc=0.4875
[adam][none][epoch 14] train_loss=1.4779, train_acc=0.4611, test_acc=0.5107
[adam][none][epoch 15] train_loss=1.4713, train_acc=0.4660, test_acc=0.4893
[adam][none][epoch 16] train_loss=1.4835, train_acc=0.4611, test_acc=0.4853
[adam][none][epoch 17] train_loss=1.4730, train_acc=0.4616, test_acc=0.4960
[adam][none][epoch 18] train_loss=1.4708, train_acc=0.4648, test_acc=0.4778
[adam][none][epoch 19] train_loss=1.4695, train_acc=0.4686, test_acc=0.5112
[adam][none][epoch 20] train_loss=1.4658, train_acc=0.4660, test_acc=0.4857
Files already downloaded and verified
Files already downloaded and verified
[adam][standard][epoch 1] train_loss=2.0278, train_acc=0.2494, test_acc=0.3251
[adam][standard][epoch 2] train_loss=1.8144, train_acc=0.3310, test_acc=0.4045
[adam][standard][epoch 3] train_loss=1.7265, train_acc=0.3622, test_acc=0.4111
[adam][standard][epoch 4] train_loss=1.6720, train_acc=0.3814, test_acc=0.4100
[adam][standard][epoch 5] train_loss=1.6580, train_acc=0.3885, test_acc=0.4350
[adam][standard][epoch 6] train_loss=1.6298, train_acc=0.3997, test_acc=0.4597
[adam][standard][epoch 7] train_loss=1.6190, train_acc=0.4032, test_acc=0.4422
[adam][standard][epoch 8] train_loss=1.6199, train_acc=0.4080, test_acc=0.4565
[adam][standard][epoch 9] train_loss=1.6146, train_acc=0.4075, test_acc=0.4629
[adam][standard][epoch 10] train_loss=1.6216, train_acc=0.4045, test_acc=0.4081
[adam][standard][epoch 11] train_loss=1.6055, train_acc=0.4083, test_acc=0.4358
[adam][standard][epoch 12] train_loss=1.6176, train_acc=0.4069, test_acc=0.4722
[adam][standard][epoch 13] train_loss=1.5999, train_acc=0.4124, test_acc=0.4715
[adam][standard][epoch 14] train_loss=1.5934, train_acc=0.4140, test_acc=0.4626
[adam][standard][epoch 15] train_loss=1.5934, train_acc=0.4137, test_acc=0.4468
[adam][standard][epoch 16] train_loss=1.5965, train_acc=0.4130, test_acc=0.4670
[adam][standard][epoch 17] train_loss=1.6136, train_acc=0.4071, test_acc=0.4527
[adam][standard][epoch 18] train_loss=1.5965, train_acc=0.4156, test_acc=0.4593
[adam][standard][epoch 19] train_loss=1.5915, train_acc=0.4165, test_acc=0.4642
[adam][standard][epoch 20] train_loss=1.5891, train_acc=0.4160, test_acc=0.4536
Files already downloaded and verified
Files already downloaded and verified
[adam][aggressive][epoch 1] train_loss=2.0048, train_acc=0.2625, test_acc=0.3807
[adam][aggressive][epoch 2] train_loss=1.8032, train_acc=0.3402, test_acc=0.4277
[adam][aggressive][epoch 3] train_loss=1.7539, train_acc=0.3595, test_acc=0.4400
[adam][aggressive][epoch 4] train_loss=1.7228, train_acc=0.3677, test_acc=0.4412
[adam][aggressive][epoch 5] train_loss=1.7074, train_acc=0.3770, test_acc=0.4460
[adam][aggressive][epoch 6] train_loss=1.6873, train_acc=0.3853, test_acc=0.4534
[adam][aggressive][epoch 7] train_loss=1.6828, train_acc=0.3875, test_acc=0.4678
[adam][aggressive][epoch 8] train_loss=1.6679, train_acc=0.3955, test_acc=0.4569
[adam][aggressive][epoch 9] train_loss=1.6778, train_acc=0.3893, test_acc=0.4535
[adam][aggressive][epoch 10] train_loss=1.6620, train_acc=0.3933, test_acc=0.4733
[adam][aggressive][epoch 11] train_loss=1.6635, train_acc=0.3955, test_acc=0.4761
[adam][aggressive][epoch 12] train_loss=1.6477, train_acc=0.3989, test_acc=0.4825
[adam][aggressive][epoch 13] train_loss=1.6429, train_acc=0.4028, test_acc=0.4554
[adam][aggressive][epoch 14] train_loss=1.6476, train_acc=0.4008, test_acc=0.4971
[adam][aggressive][epoch 15] train_loss=1.6472, train_acc=0.3994, test_acc=0.4897
[adam][aggressive][epoch 16] train_loss=1.6327, train_acc=0.4031, test_acc=0.4766
[adam][aggressive][epoch 17] train_loss=1.6346, train_acc=0.4026, test_acc=0.4602
[adam][aggressive][epoch 18] train_loss=1.6377, train_acc=0.4003, test_acc=0.4795
[adam][aggressive][epoch 19] train_loss=1.6307, train_acc=0.4048, test_acc=0.4869
[adam][aggressive][epoch 20] train_loss=1.6381, train_acc=0.4030, test_acc=0.4542
SEED 999
Files already downloaded and verified
Files already downloaded and verified
[sgd][none][epoch 1] train_loss=1.9614, train_acc=0.2839, test_acc=0.4046
[sgd][none][epoch 2] train_loss=1.5448, train_acc=0.4462, test_acc=0.4981
[sgd][none][epoch 3] train_loss=1.3840, train_acc=0.5048, test_acc=0.5481
[sgd][none][epoch 4] train_loss=1.2757, train_acc=0.5418, test_acc=0.5712
[sgd][none][epoch 5] train_loss=1.1857, train_acc=0.5770, test_acc=0.5998
[sgd][none][epoch 6] train_loss=1.1045, train_acc=0.6085, test_acc=0.6177
[sgd][none][epoch 7] train_loss=1.0466, train_acc=0.6309, test_acc=0.6266
[sgd][none][epoch 8] train_loss=0.9939, train_acc=0.6514, test_acc=0.6429
[sgd][none][epoch 9] train_loss=0.9526, train_acc=0.6655, test_acc=0.6542
[sgd][none][epoch 10] train_loss=0.9012, train_acc=0.6840, test_acc=0.6643
[sgd][none][epoch 11] train_loss=0.8650, train_acc=0.6964, test_acc=0.6760
[sgd][none][epoch 12] train_loss=0.8224, train_acc=0.7095, test_acc=0.6767
[sgd][none][epoch 13] train_loss=0.7874, train_acc=0.7230, test_acc=0.6790
[sgd][none][epoch 14] train_loss=0.7571, train_acc=0.7337, test_acc=0.6858
[sgd][none][epoch 15] train_loss=0.7221, train_acc=0.7464, test_acc=0.6937
[sgd][none][epoch 16] train_loss=0.6927, train_acc=0.7568, test_acc=0.6978
[sgd][none][epoch 17] train_loss=0.6688, train_acc=0.7631, test_acc=0.7009
[sgd][none][epoch 18] train_loss=0.6569, train_acc=0.7690, test_acc=0.6999
[sgd][none][epoch 19] train_loss=0.6169, train_acc=0.7803, test_acc=0.6992
[sgd][none][epoch 20] train_loss=0.5989, train_acc=0.7879, test_acc=0.6961
Files already downloaded and verified
Files already downloaded and verified
[sgd][standard][epoch 1] train_loss=2.0310, train_acc=0.2551, test_acc=0.3568
[sgd][standard][epoch 2] train_loss=1.7172, train_acc=0.3778, test_acc=0.4514
[sgd][standard][epoch 3] train_loss=1.5605, train_acc=0.4315, test_acc=0.4787
[sgd][standard][epoch 4] train_loss=1.4770, train_acc=0.4596, test_acc=0.5318
[sgd][standard][epoch 5] train_loss=1.4138, train_acc=0.4877, test_acc=0.5538
[sgd][standard][epoch 6] train_loss=1.3561, train_acc=0.5129, test_acc=0.5827
[sgd][standard][epoch 7] train_loss=1.3055, train_acc=0.5291, test_acc=0.6042
[sgd][standard][epoch 8] train_loss=1.2567, train_acc=0.5527, test_acc=0.6148
[sgd][standard][epoch 9] train_loss=1.2256, train_acc=0.5610, test_acc=0.6215
[sgd][standard][epoch 10] train_loss=1.1950, train_acc=0.5733, test_acc=0.6431
[sgd][standard][epoch 11] train_loss=1.1655, train_acc=0.5847, test_acc=0.6515
[sgd][standard][epoch 12] train_loss=1.1399, train_acc=0.5936, test_acc=0.6378
[sgd][standard][epoch 13] train_loss=1.1240, train_acc=0.6021, test_acc=0.6656
[sgd][standard][epoch 14] train_loss=1.1052, train_acc=0.6086, test_acc=0.6585
[sgd][standard][epoch 15] train_loss=1.0886, train_acc=0.6120, test_acc=0.6714
[sgd][standard][epoch 16] train_loss=1.0744, train_acc=0.6197, test_acc=0.6851
[sgd][standard][epoch 17] train_loss=1.0608, train_acc=0.6246, test_acc=0.6838
[sgd][standard][epoch 18] train_loss=1.0403, train_acc=0.6299, test_acc=0.6894
[sgd][standard][epoch 19] train_loss=1.0399, train_acc=0.6298, test_acc=0.6966
[sgd][standard][epoch 20] train_loss=1.0233, train_acc=0.6382, test_acc=0.6896
Files already downloaded and verified
Files already downloaded and verified
[sgd][aggressive][epoch 1] train_loss=2.0627, train_acc=0.2416, test_acc=0.3478
[sgd][aggressive][epoch 2] train_loss=1.7933, train_acc=0.3513, test_acc=0.4216
[sgd][aggressive][epoch 3] train_loss=1.6581, train_acc=0.3992, test_acc=0.4786
[sgd][aggressive][epoch 4] train_loss=1.5639, train_acc=0.4357, test_acc=0.5008
[sgd][aggressive][epoch 5] train_loss=1.5055, train_acc=0.4540, test_acc=0.5423
[sgd][aggressive][epoch 6] train_loss=1.4502, train_acc=0.4790, test_acc=0.5579
[sgd][aggressive][epoch 7] train_loss=1.4208, train_acc=0.4934, test_acc=0.5692
[sgd][aggressive][epoch 8] train_loss=1.3702, train_acc=0.5092, test_acc=0.5956
[sgd][aggressive][epoch 9] train_loss=1.3449, train_acc=0.5183, test_acc=0.6007
[sgd][aggressive][epoch 10] train_loss=1.3101, train_acc=0.5339, test_acc=0.6170
[sgd][aggressive][epoch 11] train_loss=1.2958, train_acc=0.5399, test_acc=0.6201
[sgd][aggressive][epoch 12] train_loss=1.2760, train_acc=0.5451, test_acc=0.6332
[sgd][aggressive][epoch 13] train_loss=1.2568, train_acc=0.5538, test_acc=0.6380
[sgd][aggressive][epoch 14] train_loss=1.2407, train_acc=0.5593, test_acc=0.6393
[sgd][aggressive][epoch 15] train_loss=1.2321, train_acc=0.5595, test_acc=0.6450
[sgd][aggressive][epoch 16] train_loss=1.2164, train_acc=0.5673, test_acc=0.6538
[sgd][aggressive][epoch 17] train_loss=1.2027, train_acc=0.5725, test_acc=0.6540
[sgd][aggressive][epoch 18] train_loss=1.1870, train_acc=0.5768, test_acc=0.6696
[sgd][aggressive][epoch 19] train_loss=1.1842, train_acc=0.5796, test_acc=0.6555
[sgd][aggressive][epoch 20] train_loss=1.1647, train_acc=0.5845, test_acc=0.6630
Files already downloaded and verified
Files already downloaded and verified
[adam][none][epoch 1] train_loss=1.8653, train_acc=0.3280, test_acc=0.3995
[adam][none][epoch 2] train_loss=1.6121, train_acc=0.4129, test_acc=0.4098
[adam][none][epoch 3] train_loss=1.5402, train_acc=0.4404, test_acc=0.4697
[adam][none][epoch 4] train_loss=1.5276, train_acc=0.4490, test_acc=0.4802
[adam][none][epoch 5] train_loss=1.4979, train_acc=0.4543, test_acc=0.4818
[adam][none][epoch 6] train_loss=1.4916, train_acc=0.4601, test_acc=0.4988
[adam][none][epoch 7] train_loss=1.4729, train_acc=0.4647, test_acc=0.4972
[adam][none][epoch 8] train_loss=1.4770, train_acc=0.4638, test_acc=0.4687
[adam][none][epoch 9] train_loss=1.4653, train_acc=0.4690, test_acc=0.4816
[adam][none][epoch 10] train_loss=1.4635, train_acc=0.4718, test_acc=0.4935
[adam][none][epoch 11] train_loss=1.4643, train_acc=0.4703, test_acc=0.4782
[adam][none][epoch 12] train_loss=1.4603, train_acc=0.4717, test_acc=0.4873
[adam][none][epoch 13] train_loss=1.4479, train_acc=0.4763, test_acc=0.4706
[adam][none][epoch 14] train_loss=1.4543, train_acc=0.4767, test_acc=0.5077
[adam][none][epoch 15] train_loss=1.4511, train_acc=0.4727, test_acc=0.5074
[adam][none][epoch 16] train_loss=1.4691, train_acc=0.4710, test_acc=0.5053
[adam][none][epoch 17] train_loss=1.4495, train_acc=0.4772, test_acc=0.5045
[adam][none][epoch 18] train_loss=1.4601, train_acc=0.4717, test_acc=0.5149
[adam][none][epoch 19] train_loss=1.4620, train_acc=0.4741, test_acc=0.5031
[adam][none][epoch 20] train_loss=1.4535, train_acc=0.4741, test_acc=0.5189
Files already downloaded and verified
Files already downloaded and verified
[adam][standard][epoch 1] train_loss=1.9290, train_acc=0.2975, test_acc=0.4071
[adam][standard][epoch 2] train_loss=1.7239, train_acc=0.3633, test_acc=0.3631
[adam][standard][epoch 3] train_loss=1.6749, train_acc=0.3821, test_acc=0.4274
[adam][standard][epoch 4] train_loss=1.6455, train_acc=0.3956, test_acc=0.4514
[adam][standard][epoch 5] train_loss=1.6245, train_acc=0.4029, test_acc=0.4313
[adam][standard][epoch 6] train_loss=1.6053, train_acc=0.4100, test_acc=0.4484
[adam][standard][epoch 7] train_loss=1.6106, train_acc=0.4080, test_acc=0.4302
[adam][standard][epoch 8] train_loss=1.5953, train_acc=0.4148, test_acc=0.4639
[adam][standard][epoch 9] train_loss=1.5825, train_acc=0.4168, test_acc=0.4662
[adam][standard][epoch 10] train_loss=1.5836, train_acc=0.4205, test_acc=0.4595
[adam][standard][epoch 11] train_loss=1.5734, train_acc=0.4241, test_acc=0.4862
[adam][standard][epoch 12] train_loss=1.5816, train_acc=0.4209, test_acc=0.4603
[adam][standard][epoch 13] train_loss=1.5812, train_acc=0.4215, test_acc=0.4889
[adam][standard][epoch 14] train_loss=1.5848, train_acc=0.4202, test_acc=0.4823
[adam][standard][epoch 15] train_loss=1.5768, train_acc=0.4227, test_acc=0.4809
[adam][standard][epoch 16] train_loss=1.5763, train_acc=0.4241, test_acc=0.4911
[adam][standard][epoch 17] train_loss=1.5560, train_acc=0.4306, test_acc=0.4727
[adam][standard][epoch 18] train_loss=1.5524, train_acc=0.4348, test_acc=0.4581
[adam][standard][epoch 19] train_loss=1.5581, train_acc=0.4291, test_acc=0.4822
[adam][standard][epoch 20] train_loss=1.5584, train_acc=0.4282, test_acc=0.4934
Files already downloaded and verified
Files already downloaded and verified
[adam][aggressive][epoch 1] train_loss=2.0259, train_acc=0.2653, test_acc=0.3501
[adam][aggressive][epoch 2] train_loss=1.8678, train_acc=0.3130, test_acc=0.3679
[adam][aggressive][epoch 3] train_loss=1.8263, train_acc=0.3308, test_acc=0.3729
[adam][aggressive][epoch 4] train_loss=1.8109, train_acc=0.3348, test_acc=0.3847
[adam][aggressive][epoch 5] train_loss=1.7937, train_acc=0.3411, test_acc=0.3855
[adam][aggressive][epoch 6] train_loss=1.7862, train_acc=0.3438, test_acc=0.3771
[adam][aggressive][epoch 7] train_loss=1.7757, train_acc=0.3419, test_acc=0.3899
[adam][aggressive][epoch 8] train_loss=1.7809, train_acc=0.3414, test_acc=0.3915
[adam][aggressive][epoch 9] train_loss=1.7794, train_acc=0.3387, test_acc=0.3913
[adam][aggressive][epoch 10] train_loss=1.7733, train_acc=0.3430, test_acc=0.3706
[adam][aggressive][epoch 11] train_loss=1.7688, train_acc=0.3444, test_acc=0.3919
[adam][aggressive][epoch 12] train_loss=1.7673, train_acc=0.3452, test_acc=0.4055
[adam][aggressive][epoch 13] train_loss=1.7586, train_acc=0.3477, test_acc=0.4183
[adam][aggressive][epoch 14] train_loss=1.7682, train_acc=0.3431, test_acc=0.3904
[adam][aggressive][epoch 15] train_loss=1.7510, train_acc=0.3507, test_acc=0.3796
[adam][aggressive][epoch 16] train_loss=1.7584, train_acc=0.3480, test_acc=0.3948
[adam][aggressive][epoch 17] train_loss=1.7581, train_acc=0.3510, test_acc=0.4044
[adam][aggressive][epoch 18] train_loss=1.7501, train_acc=0.3506, test_acc=0.4180
[adam][aggressive][epoch 19] train_loss=1.7574, train_acc=0.3461, test_acc=0.4032
[adam][aggressive][epoch 20] train_loss=1.7578, train_acc=0.3469, test_acc=0.4039
saved results to results.json
anova on test accuracy:
                                sum_sq    df           F        PR(>F)
C(optimizer)                  0.201909   1.0  366.885184  2.308516e-10
C(augmentation)               0.010412   2.0    9.459614  3.417556e-03
C(optimizer):C(augmentation)  0.002980   2.0    2.707481  1.070415e-01
Residual                      0.006604  12.0         NaN           NaN
saved plot to test_acc_comparison.png
Message sent successfully!
python main.py --analyze
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:138: UserWarning: CUDA initialization: CUDA driver initialization failed, you might not have a CUDA gpu. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.)
  return torch._C._cuda_getDeviceCount() > 0
Message sent successfully!
Namespace(batch_size=128, lr=0.01, epochs=20, analyze=True)
SEED 42
Files already downloaded and verified
Files already downloaded and verified
[sgd][none][epoch 1] train_loss=2.0053, train_acc=0.2661, test_acc=0.3923
[sgd][none][epoch 2] train_loss=1.5552, train_acc=0.4410, test_acc=0.4985
[sgd][none][epoch 3] train_loss=1.3659, train_acc=0.5116, test_acc=0.5425
[sgd][none][epoch 4] train_loss=1.2634, train_acc=0.5483, test_acc=0.5884
[sgd][none][epoch 5] train_loss=1.1752, train_acc=0.5810, test_acc=0.5867
[sgd][none][epoch 6] train_loss=1.0963, train_acc=0.6116, test_acc=0.6368
[sgd][none][epoch 7] train_loss=1.0310, train_acc=0.6359, test_acc=0.6424
[sgd][none][epoch 8] train_loss=0.9726, train_acc=0.6574, test_acc=0.6589
[sgd][none][epoch 9] train_loss=0.9323, train_acc=0.6723, test_acc=0.6647
[sgd][none][epoch 10] train_loss=0.8843, train_acc=0.6885, test_acc=0.6754
[sgd][none][epoch 11] train_loss=0.8454, train_acc=0.7028, test_acc=0.6839
[sgd][none][epoch 12] train_loss=0.8084, train_acc=0.7146, test_acc=0.6844
[sgd][none][epoch 13] train_loss=0.7736, train_acc=0.7275, test_acc=0.6905
[sgd][none][epoch 14] train_loss=0.7405, train_acc=0.7391, test_acc=0.6847
[sgd][none][epoch 15] train_loss=0.7178, train_acc=0.7473, test_acc=0.7029
