Table 3 Comparison with the original SWP on CIFAR-10
From: A statistical approach for neural network pruning with application to internet of things
Backbone | Metrics | Params | FLOPS | Accuracy |
|---|---|---|---|---|
VGG16 | Baseline | 14.76M | 627.37 M | 93.76% |
Original (\(\alpha =1\)e−5) | 3.62M | 350.28 M | 93.46% | |
Original (\(\alpha =5\)e−5) | could not converge | |||
Ours (\(\alpha =1\)e−5, \(T=0.0001\)) | 4.63 M | 385.49 M | 93.43% | |
Ours (\(\alpha =5\)e−5, \(T=0.005\)) | 0.84 M | 126.03 M | 93.06% | |
ResNet56 | Baseline | 0.87M | 251.50 M | 93.11% |
Original (\(\alpha =1\)e−5) | 0.60M | 150.63 M | 93.41% | |
Ours (\(\alpha =5\)e−5, \(T=0.001\)) | 0.23 M | 60.76 M | 92.96% | |