Phased LSTMs implementation in Pytorch

Mina_soltan · September 20, 2019, 3:18pm

Has anyone implemented phased LSTM in Pytorch? I can’t find anything useful online.

marchinidavide · October 1, 2019, 9:52pm

I searched the same months ago and no one did. Maybe we should just do it ourself!
Any interest in team up?

Mina_soltan · November 23, 2019, 10:08pm

I can contribute but I have very limited hours I can put in.

Ginsunuva · January 16, 2020, 1:13pm

A bit late, but I made an implementation in a couple hours here if anyone else still needs a Torch version:

gist.github.com

https://gist.github.com/AAnoosheh/c6877583ee5c46d6adf81b5bc355379d

phased_lstm.py

import math

import torch
import torch.nn as nn
import torch.nn.init as init
from torch.nn import functional as F


class PhasedLSTMCell(nn.Module):
    """Phased LSTM recurrent network cell.

This file has been truncated. show original

cstsunfu · May 10, 2020, 2:57pm

Hi, I am learning the PhasedLSTM now, and I want to refer to your torch version code. And the link couldn’t found now, do you have the backup of this code?

Ginsunuva · May 11, 2020, 8:04am

Hi,
Sorry don’t know why it’s gone.

Here’s a re-upload of the gist, slightly modified:

gist.github.com

https://gist.github.com/AAnoosheh/b3cce037ae24a86d89505907ec098d62

phased_lstm.py

import math

import torch
import torch.nn as nn



class PhasedLSTMCell(nn.Module):
    """Phased LSTM recurrent network cell.
    https://arxiv.org/pdf/1610.09513v1.pdf

This file has been truncated. show original

I just modified it from the version in my codebase, deleting unnecessary code.
Haven’t tried running it for now, but should be fine. Hopefully no typos.