accuracy not increasing

[yangyifei-gogogo]

I use your center loss in my own vgg19. Although my loss decreasing slowly, but the acc on test set never changed, I'm sure I update both opimizer's params, what's wrong with my code?