Supplement material for “Walsh-Hadamard Variational Inference for Bayesian Deep Learning”