BERT without text

1

can I train my model for BERT on a dataset where I do not have textual content, for example I have newsItemID but not whole story(textual)