Virtual batches of SGD optimization?

Yes, you could use the approaches described here.

1 Like