On Google colab they provide options for both gpu and the tpu? Which is better to use in terms of memory usage? Does TPU usage memory the same way as GPU? In GPU I am frequently getting out of memory error? Can that be avoided with TPU?
This is a hard question to answer without more details on your workload. Google Colab might not provide you to the same GPU or TPU every time you login, typically it’s best to benchmark and see. So benchmark and see!
1 Like