Hi. I want to use my model built for pytorch for android. For windows, during inference the model takes about 5-6 GB of GPU memory. Can you please tell me how to find out if it can run on an android device? Will the model use the android GPU in the same way as it does on the pc?
I would also be grateful if you could give me materials to read for this task. Thanks.