Read dataset from TFRecord format

FYI there is also a tfrecord reader in xla: https://github.com/pytorch/xla/blob/master/torch_xla/utils/tf_record_reader.py

3 Likes

Have you compared this implementation to other ones? I guess it is good enough, so I will give it a try. :ok_hand:

Hi,
I’ve tried a few then but could not get anything working reasonably with multiple files, unfortunately…
I wonder if we can actually use tf.data.TFRecordDataset and convert like torch.from_numpy(tf_tensor.numpy())

Please let us know if you find a good way.
I think it’s a common request, and I (and perhaps many more) would very interested to know!
Cheers

1 Like

Cool,thank you,guys。 :grin: :grin: