How to sample unique data？

guotong1988 · January 15, 2018, 8:40am

samples=torch.multinomial(probs,5)

but samples data may be duplicate

chenyuntc · January 15, 2018, 9:02am

TLDR: use WeightedRandomSampler with replace=False

chenyuntc/pytorch-book/blob/master/chapter5-常用工具/chapter5.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 第五章  PyTorch常用工具模块"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "在训练神经网络过程中，需要用到很多工具，其中最重要的三部分是：数据、可视化和GPU加速。本章主要介绍Pytorch在这几方面的工具模块，合理使用这些工具能够极大地提高编码效率。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [

This file has been truncated. show original