How can I get the Hidden Embeddings from the 2nd last fully connected layer for t-SNE visualization?

Assuming you are looking for the output activations of self.fc1 (unsure what embeddings would mean in this context), you could use forward hooks as described here.