How to annotate non-object image

If non-object images are in training data set,
how should i annotate it?
If annotation vector form is like [bbox, cls], can [-1,-1,-1,-1,-1] be annotation?
This annotation padding is needed for batch training i think.
But [-1,-1,-1,-1,-1] is right? if right, why?
thanks for answer in advance.