I want to create a nn model by pytorch to implement reinforcement.
I need to use this model to interact with the environment, so I want to set the batch_size=1.
But the model cannot perform well, so I want to train the model firstly by supervised learning in order to enhance the performance of my model, so I want to set the batch_size>1(like 64) to accelerate the training process.