Model,Inference Latency (ms),Accuracy (%)
"25% width, Exit 1",0.2,94.13
"25% width, Exit 2",0.22,94.61
"50% width, Exit 1",0.31,95.5
"75% width, Exit 1",0.42,97.02
"50% width, Exit 2",0.51,97.85
"100% width, Exit 1",0.54,97.56
"75% width, Exit 2",0.89,97.9
"100% width, Exit 2",1.35,98.33
,,
"Res 14, Exit 1",0.17,72.67
"Res 20, Exit 1",0.25,74.21
"Res 14, Exit 2",0.31,76.89
"Res 28, Exit 1",0.42,74.96
"Res 20, Exit 2",0.92,83.29
"Res 28, Exit 2",1.16,90.95
,,
"Exit at layer 1, Confidence > 0.7",0.32,86.71
"Exit at the first 2 layers, Confidence > 0.7",0.45,91.2
"Exit at the first 2 layers, Confidence > 0.7",0.66,95.29
"Exit at the first 4 layers, Confidence > 0.7",0.94,97.68
"Exit at layer 1, Confidence > 0.5",0.32,84.5
"Exit at the first 2 layers, Confidence > 0.5",0.39,88.52
"Exit at the first 3 layers, Confidence > 0.5",0.46,93.1
"Exit at the first 4 layers, Confidence > 0.5",0.76,94.27