So, my question is basically a follow-p of this:
Is batch-norm suitable for my situation where the batch size can fluctuate between 1 and 10? I know that there is no batchnorm for batch size of 1. So, is that a hard no for my situation or is there something I could do?
with that low batch size, you are probably better just not use batch norm at all.