# OOM when allocating tensor with shape

i got this problem with using embedding for 150.000 sentences using BERT model
`tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[1619381,768] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomUniform]`

as the layer of embedding is
` embed = Embedding(1619381, 768, mask_zero=True)(sentence)`
i got this number 1619381 from `embeddings = torch.cat(embeddings,dim=0)`
which contains all embedding for 150.000 sentences .

Note that this is a tensorflow error…