Switched the original project to Fashion MNIST dataset to see how capsule network handle this compared to digits.
Reconstruction result
Images at top 5 rows are real images from Fashion MNIST and images at bottom are corresponding reconstructed images after 4 epochs.