Spatial Transformer Layer

pvskand · July 27, 2017, 4:22pm

Is there any Spatial Transformer Layer kind of a thing in pytorch? I could find TransformerLayer in Lasagne which is the STN layer implementation.

EDIT 1:

If there is any example of STN with affine_grid and grid_sample as mentioned below, it would be of great help.

ajbrock · July 27, 2017, 5:06pm

See http://pytorch.org/docs/master/nn.html#torch.nn.functional.grid_sample and http://pytorch.org/docs/master/nn.html#torch.nn.functional.affine_grid .

pvskand · July 28, 2017, 4:55am

Thanks for the links.
I would like to ask if there any example to depict the combination of the the affine_grid and grid_sample along with the localization network (which is essentially a set of conv layers ending up to regress the 6 parameters of the transformation)?

YongyiTang92 · August 2, 2017, 8:00am

I just try an example without adding localization network but a pre-defined parameters for transformation. I think it’s straight forward to be modified.

github.com

YongyiTang92/pytorch-tutorial/blob/master/tutorials/05-mytest/STN_test.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pytorch spatial tranformer Example\n",
    "See also https://github.com/fxia22/stn.pytorch\n",
    "Note that torch.nn.functional.affine_grid and torch.nn.functional.grid_sample only in Pytorch v0.2.0 or above"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "%matplotlib inline\n",

This file has been truncated. show original

D-X-Y · August 3, 2017, 9:01am

@YongyiTang92 For Pytorch v0.2.0, is there a direct link that we can download the builded whl file, or we have to build from the source file?

YongyiTang92 · August 3, 2017, 12:32pm

Only source file is the only way to install v0.2.0 currently.