It absolutely can be done. It would just take some work But we would be more than happy to see improvements here, so please feel free to send PRs! See this issue we have open.
One reason AI compilers might not support training is that inference is just an easier place to start. That doesn’t mean training is too hard, though. We would like to eventually expand our training support.
Yes, as long as you can get it into a format Glow can import, such as ONNX proto. See this post.